23 ms·
Its so much stuff going through them, how would they monitor it all?
by faeyanpiraat 2mo ago
Its so much stuff going through them, how would they monitor it all?
- ericpauley 2mo agoAI is big in GPU terms but in raw bytes the whole token economy is laughably tractable. Case in point: OpenRouter is serving 60T tokens a week, but this is all human text and code (and cache hits!), which is almost certainly compressible enough that you could fit the whole week’s usage on a single hard drive.