8 ms·
The gains wouldn't be "free lunch", it's the result of time and effort researching optimal design and architecture. Even if the idea of "no free lunch" was tak
by notnullorvoid 1mo ago
The gains wouldn't be "free lunch", it's the result of time and effort researching optimal design and architecture.
Even if the idea of "no free lunch" was taken liberally discounting the cost of research, it would only be limiting to systems built from a foundation of optimization, but that's not the case. The foundation so far has been one of brute force scaling. Usually meaning there is lots of room for optimization.
- dofm 1mo ago> The foundation so far has been one of brute force scaling. In cloud AI, sure. But in the smaller open weights model territory it feels like we're well into optimisation?
- fwipsy 1mo agoWhy do you think cloud AI doesn't also use these optimizations? They are also compute-constrained. I expect optimization and scale have a multiplicative effect. Surely all the serious players care about both.