5 ms·
A good reason to have LLM provider swapping built into these things
by exrhizo 1y ago
A good reason to have LLM provider swapping built into these things
- sfitz 1y agoI think this will be difficult for LLM vendors to implement in the near term, as the cost of switching vendors is near zero. If vendor A implemented ads, preferential treatment to things, and it was very evident, switching to vendor B would take almost no time.
- wmf 1y agoThere won't be swapping when it's vertically integrated. Independent "GPT wrappers" is probably a temporary phase.