6 ms·
You need to separate training and inference usage of GPUs for this analysis.
by loandbehold 5mo ago
You need to separate training and inference usage of GPUs for this analysis.
- Mathnerd314 5mo ago"Inference consumes 60–90% of total AI lifecycle costs." So shovel is not the right analogy, more like GPU = coal burning engine. And yes, coal was a big railroad expense, more so than financing construction debt.