6 ms·
Is there any (near future) technology that would permit burning this terrabyte into some kind of ROM chip?
by bertili 2mo ago
Is there any (near future) technology that would permit burning this terrabyte into some kind of ROM chip?
- davidricodias 2mo agoYes, from 6 days ago: https://news.ycombinator.com/item?id=48986351 https://news.ycombinator.com/item?id=48986351
- bertili 2mo agoThat looks promising! As models become a commodity, this may turn out to be the real AI gold rush.
- trollbridge 2mo agoA question of course would be "is 15,000 tok/s Gemini better than 100 tok/s Opus 5"?
- pimeys 2mo agoDepends what you do. We have certain tasks we spend money on where Gemini 4.6 definitely is better than Opus 5.
- quantumleaper 2mo agoIt's better for the billions of free users that Google serves.
- brute 2mo agoThe path to ubiquitous AI (17k tokens/sec) https://news.ycombinator.com/item?id=47086181 https://news.ycombinator.com/item?id=47086181 You can still try it at https://chatjimmy.ai/ https://chatjimmy.ai/, but it's running the rather outdated Llama 3.1 8B
- antiloper 2mo agoGiven how fast models are improving, burning the weights into actual ROM is prohibitively expensive if you need (or want) to replace the chip every couple of months. The alternative is on-TPU flash for storing the weights.
- trollbridge 2mo agoYes. We're still a ways off from this being ubiquitous, but I am convinced it's coming.