13 ms·
The token price seems like a poor measure. Building the LLM that could do this work in 11 days cost multi billions. The economics probably only make sense if
by 2muchcoffeeman 12d ago
The token price seems like a poor measure.
Building the LLM that could do this work in 11 days cost multi billions.
The economics probably only make sense if LLMs prove to be a benefit to almost everyone in a way we can all accept.
Otherwise this cost a lot more than we’d otherwise pay. It was incredibly fast though. But we all know: cost, speed, quality. Pick two.
- eproxus 12d agoThis the correct way to look at it. Just as the person spending 5 years working on this will have learnt many things which will be useful after this problem is solved, you have to factor in the training cost (sure it's only done "once", but that is the same for the person too once they jump on the next problem). The model wouldn't not be able to solve this without all the training leading up to the actual execution, so counting only the tokens of the execution doesn't give the full picture.
- aurareturn 11d agoHuman mathematicians also have to eat right, trained, etc.
- 2muchcoffeeman 11d agoChatGPT has raised over 120 billion USD in funding. For argument let’s just say we paid all the mathematicians 200k in salary from graduation till retirement. Say 40 years. That’s about 8 million. Let’s round that up to USD 10 million. We can see the future and pay to raise all the baby mathematicians. For 100 billion that’s 10000 mathematician lifetimes. For 1 AI company _so far_. There’s no value for money in AI yet.
- aurareturn 11d agoWell, it's taken 4 billion years for life to evolve into humans to be able to do math. That's a lot of resources, right? Likewise, LLMs also needed the same amount of evolution. My point is that it's silly to make these comparisons on resources. A single SOTA trained LLM isn't just doing advanced math research. It's used by hundreds of millions or even billions daily for various tasks. It's just a tool humans invented.
- Brian_K_White 11d agoIt's just a wildly inefficient tool whos inefficiency is obscured so no one realizes how bad it is and everyone thinks the good part is the only part.
- aurareturn 11d agoIt doesn’t seem so inefficient to me. It seems incredibly efficient in workplace productivity.
- Brian_K_White 10d agoLe duh.