5 ms·
There's three options here: - The provider has a massive amount of (unused) hardware. Google or Cursor seem most likely - The model is extremely efficient, be
by LaurensBER 23d ago
There's three options here:
- The provider has a massive amount of (unused) hardware. Google or Cursor seem most likely
- The model is extremely efficient, beyond anything we've seen so far
- Whomever made the model has improved the cache efficiency in such a way that it's very cheap to serve. See e.g Deepseeks or Xiaomi caching (pre-price increase)
- re-thc 23d agoOption 4: the claimed capacity is not true. Real world usage hasn’t reached anywhere close to it.