6 ms·
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
by anthonypasq 22d ago
no they dont because inference stacks are getting more efficient and models are getting more intelligent per parameter.
- vlovich123 22d agoI would posit there’s no way in hell they’re getting sufficiently cheaper on a short enough time frame vs how much demand is sky rocketing. AI companies are seeing quarterly doubling of revenue if not more.