Where I work, our legal department requires making use of LLMs only through our own contractual relationships with model providers. Given that, BYOK is table st

Where I work, our legal department requires making use of LLMs only through our own contractual relationships with model providers. Given that, BYOK is table stakes for me at least. Litellm is what we use internally, so we can support any LLM backend with any open source tool, and create virtual keys for each developer to monitor and manage usage limits etc.