6 ms·
350x is only about 10-20 years of improvement, using CPU FLOPS as the benchmark.
by dpedu 1mo ago
350x is only about 10-20 years of improvement, using CPU FLOPS as the benchmark.
- 8note 1mo agowouldnt you want gpu, fpga, or dsp as the benchmark? its lots of parallel calculations, rather than one blazing fast one
- paulryanrogers 1mo agoHaven't CPUs largely plateaued? They're just getting bigger, more power hungry, and multiplying cores. Physics has hard limits and Moore's law is long dead.
- girishso 1mo agoAFAIK these don't have to be CPUs. ASICS are well suited for this purpose. This will be the most cost effective way to run LLMs.