23 ms·
Write a detailed plan using a more expensive model and implement it using the cheaper one.
by denverllc 24d ago
Write a detailed plan using a more expensive model and implement it using the cheaper one.
- blfr 24d agoHow much are you saving once the more expensive model already has all the context loaded and ready to go?
- csullivannet 24d agoAPI calls get more expensive, not less, as you've loaded more context. This is exactly when you want to switch to cheaper models.
- camdenreslink 24d agoThere is caching to consider. Switching models throws away the cached tokens.