6 ms·
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
by csullivannet 24d ago
API calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
- camdenreslink 24d agoThere is caching to consider. Switching models throws away the cached tokens.