5 ms·

Often people are counting all tokens, including cached input tokens, for those more impressive "billions of tokens" quotes.

• rpdillon 1mo ago
  Ah, thanks, I'd missed that nuance in the other reply!