7 ms·
But will the wrapper apps cover token cost, or will tokens act more like electricity?
by derwiki 1mo ago
But will the wrapper apps cover token cost, or will tokens act more like electricity?
- lumost 1mo agoToken cost is falling rapidly for a given quality. We don't think about this too much as newer models have made legacy apps obsolete - but its an interesting question what the cheapest text to sql or similar model would be. I still go by 10x cost decrease per 6 months for any given model quality.