5 ms·
My thought was that ASICs turned out not to be worth it for crypto mining because consumer hardware evolved fast enough to do it, while also being cheaper and h
by SPascareli13 7d ago
My thought was that ASICs turned out not to be worth it for crypto mining because consumer hardware evolved fast enough to do it, while also being cheaper and having some resale value, while ASICs are useless besides mining and have no resale value.
So I'm extrapolating this same idea to LLM inference.
- mhast 7d agoFor the problems ASICs exist they vastly outperform general hardware. Typically both in absolute speed and efficiency. But it's only possible to make custom ASICs when you have a specific problem to solve. For newer crypto systems they can vary enough parameters that building a flexible enough ASIC to recoup the investment before the algorithm changes and makes your hardware useless. For problems where the problem to solve remain in the problem space the ASIC can solve there is no point to use a thing else.
- infecto 6d agoYou’re extrapolating on something that is false. Consumer hardware never caught up to asic.