6 ms·
The goal is to encourage users to move to the next generation. The fewer models they serve, the less excess capacity they need to provision. Serving more model
by hiddencost 14d ago
The goal is to encourage users to move to the next generation. The fewer models they serve, the less excess capacity they need to provision.
Serving more models also adds a significant ops burden on the SREs and trust& safety teams.