6 ms·

It feels lke they replace older models with "optimised" versions which are cheaper to run, but keep the same name.

• unclebucknasty 25d ago
  You mean like quantized?
  • richardfey 25d ago
    Yes; or something which has a similar effect.
    • ethbr1 24d ago
      It would describe the observed behavior. Especially if there were an internal quant/efficiency team that wasn't as diligent about regressions as the primary model team.
    • unclebucknasty 23d ago
      That's exactly what it feels like and it makes perfect sense, given the known compute constraints.