6 ms·
c.f. https://news.ycombinator.com/item?id=49403836 https://news.ycombinator.com/item?id=49403836, then from there, you'd need to see a couple of orders of magni
by refulgentis 25d ago
c.f. https://news.ycombinator.com/item?id=49403836 https://news.ycombinator.com/item?id=49403836, then from there, you'd need to see a couple of orders of magnitude before it's tractable for LLMs.
Bottom of page linked from HN (currently https://www.mythic.ai/ https://www.mythic.ai/) indicates they're hoping to demonstrate something that could that in 2028 or later, and both Nvidia and Cerebra are looking at 10x'ing models to 10T+ plus in 2027.
So they may never catch up on LLMs.
They're a good fit for the companies they're working with and have taken investment from, ex. Toyota, that aren't doing LLMs.
- vatsachak 25d agoThey plan to be able to run 1T parameter models next year https://www.mythic.ai/vanguard https://www.mythic.ai/vanguard Seems big, IF true