6 ms·
Google Titans Model Explained: The Future of Memory-Driven AI Architectures
- brrrrrm 2y agoPaper https://arxiv.org/abs/2501.00663 https://arxiv.org/abs/2501.00663
- ajcp 2y ago> opening doors to innovations in AI-driven reasoning, healthcare, and beyond. You went with "healthcare"?
- mattigames 2y agoIt's Google, so it means healthcare as in the business not the practice, "help me squeeze more money out of people that desperately need this medicine to survive"
- sva_ 2y agoIf by "You" you mean some LLM, then probably yes.
- cscurmudgeon 2y agoMor businesses participating in health care should drive costs down.
- barbazoo 2y agoNot if they’re additional middlepersons.
- vessenes 2y agoFWIW, Phil Wang (lucidrains) has been working on Titans reimplementation since roughly the day the paper was released. It looks to me from the repository that some of the paper's claims have not been reproduced yet, and reading between the lines, it might be Wang considers the paper to not be that groundbreaking after all -- hard to say definitively but the commit speed has definitely slowed down, and the last comments involve failing to replicate some of the key claims. Unfortunately. The paper looks really good, and I'd like for it to be true. https://github.com/lucidrains/titans-pytorch https://github.com/lucidrains/titans-pytorch
- thunderbird120 2y agoYeah, that's the normal outcome for papers like this. Papers which claim to be groundbreaking improvements on Transformers universally aren't. Same story roughly once a month for the past 5 years.
- codelion 2y agoIt's a shame when potentially interesting papers don't hold up in practice. I've seen a few cases where the real-world performance didn't match the initial claims.
- wstrange 2y agoFor those of you in the field, this seems like a big deal? ELI5
- llm_trw 2y agoI don't know. Google has some great papers but a lot more hot air. The best thing to do when you see a google paper is ignore it until someone you trust more writes a second paper about it.
- bloomingkales 2y agoTo your own peril. Ignoring the stuff that comes out of Google caused Google itself harm. Some language is clickbait, some isn't. A Titan, that's a word if there ever was one. The Bitter Truth, a sentence if there ever was one. Language is a thing, and so I have to ask - why is language like this coming to these researchers? Off topic: Waymo is a verb, and Google owns it. The concept of AV will be overwhelmingly introduced to the world as Waymo. Not everything has to come out of left field.
- daedrdev 2y agoTheir model on protein folding was obviously very impactful. Their model for new chemicals has to my understanding provided no value. Based on this track record, who knows.
- bglazer 2y agoThis article gives off really strong chatgpt vibes. Bullet points! Confidently stated but quite vague statements! Integration, key innovations, more bullet points! Distinct lack of personal viewpoints or unique opinions! Very long! Maybe I’m being uncharitable and this is just the way things are written on Medium, but man this was not an easy or particularly enlightening read.
- sky2224 2y agoNah it's definitely AI generated. I used to like Medium a lot, but ever since AI Models became mainstream, it's just been a cesspool of horribly written articles.
- the_arun 2y agoSo are they generating blog from arxiv papers?
- spookie 2y agoBinoculars, a llm detector, gives a "most likely AI-generated".
- pyinstallwoes 2y ago100% Header Paragraph List items Delve, here’s why, conclusion.
- ryanseys 2y agoAnd clearly has screenshots from ChatGPT with the same wording as the post itself. Lazy research, lazy writing, disappointing but not surprising.
- danpalmer 2y agoThis is how I write, it’s how I was taught to write. It’s how ChatGPT writes because ChatGPT was trained to write in a clear way. Intro, paragraphs, and a conclusion are just table stakes for writing to persuade. List items are a very common way of communicating complex things. “Delve” is a common word. By all means assume this was AI drafted (there are enough grammar mistakes that it has clearly been edited by a human with English as a second language), but this list of reasons is a bad one.
- nonfamous 2y agoThis is seemingly unrelated to the Amazon Titan foundational models available on Bedrock. As if things weren’t confusing enough with OpenAI’s naming scheme…
- mmoskal 2y agoMy favorites are Nvidia Triton (server) and Openai Triton (compiler)
- barbazoo 2y ago> Healthcare I wish I could go back to a time where I thought this meant that it would lead to better health outcomes, not knowing what they actually mean is just reducing cost by decreasing accuracy.
- Sincere6066 2y ago[flagged]
- klipt 2y ago"That's why we're working on an AI to hear about AI for you, so you don't have to!" - someone probably
- leosanchez 2y agoMe too. Just hide the articles about AI from HN and move on.
- imjonse 2y agoSomething like this, using Simon Willison's llm cli, will give you a better experience than such generated articles unless your goal is explicitly to read blogs. wget https://arxiv.org/pdf/2501.00663 https://arxiv.org/pdf/2501.00663 -O - | pdftotext - - | llm -s "Explain the following paper assuming I am familiar with deep learning" -m gpro Advantages: * put in any prompt you like * pick any model (above gpro is alias for latest gemini pro if you have the llm-gemini plugin installed) * ask for clarifications using llm chat -c (continue last conversation) * no annoying random image For another approach for this particular paper, Umal Jamil's videos are always high quality: https://www.youtube.com/watch?v=A6kPQVejN4o https://www.youtube.com/watch?v=A6kPQVejN4o
- lincpa 2y ago[dead]