5 ms·
Isn't it the cost we care about, rather than the speed? All we know know is that a frontier AI lab was able to do it in 11 days, we have no idea how much comput
by doctoboggan 12d ago
Isn't it the cost we care about, rather than the speed? All we know know is that a frontier AI lab was able to do it in 11 days, we have no idea how much compute they threw at it.
- SoMomentary 12d agoThey said 6 billion tokens, which isn't as much as I thought it might be.
- trostaft 12d agoAm I doing my napkin math correct? The post says it's using a model comparable to Fable 5.1, which is $50 per million output tokens. So this is ~$300K? Surely an over-estimate due to caching.
- FartyMcFarter 11d agoSurely input tokens are also involved, and not necessarily only for the initial prompt if there are feedback loops or agent interactions.