5 ms·
It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
by shekhar101 2y ago
It's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
- gardenfelder 2y agohttps://github.com/BerriAI/liteLLM-proxy https://github.com/BerriAI/liteLLM-proxy