8 ms·
Hard agree. The hidden cost of 'cheap' models is the complexity of the retry logic you have to write around them. If a cheaper model hallucinates halfway throu
by leo_e 10mo ago
Hard agree. The hidden cost of 'cheap' models is the complexity of the retry logic you have to write around them.
If a cheaper model hallucinates halfway through a multi-step agent workflow, I burn more tokens on verification and error correction loops than if I just used the smart model upfront. 'Cost per successful task' is the only metric that matters in production.