ij23

5 ms·

1.
LiteLLM (YC W23) Is Hiring – Rust / Performance Engineers(jobs.ashbyhq.com)
1 points by ij23 26d ago
2.
by ij23 3mo ago
LiteLLM maintainer here. Some context on why we are doing this Over the past year we've heard the same thing from our users and community, they want the fastest and litest AI gateway. This change allows us to address two of the most co
3.
Show HN: LiteHarness – One SDK for Claude Agent, OpenAI Agent, Pi AI(github.com)
2 points by ij23 4mo ago|2 comments
4.
LiteLLM Agent Platform: Run Claude Code/Codex On-Prem Sandboxes and Vaults(github.com)
3 points by ij23 4mo ago|0 comments
5.
by ij23 6mo ago
Hi all, Ishaan from LiteLLM here (LiteLLM maintainer) The compromised PyPI packages were litellm==1.82.7 and litellm==1.82.8. Those packages have now been removed from PyPI. We have confirmed that the compromise originated from the Trivy de
6.
LiteLLM (YC W23): Founding Reliability Engineer – $200K-$270K and 0.5-1.0% equity(ycombinator.com)
1 points by ij23 7mo ago
7.
Open-Swarm – use 100 LLMs on OpenAI swarm framework(github.com)
2 points by ij23 2y ago|1 comments
8.
by ij23 2y ago
OpenAI's multi-agent framework swarm only supports models from OpenAI. OpenSwarm uses LiteLLM to add support for any LLM AnthropicAI, MistralAI, Ollama, Huggingface, GroqInc, Replicate
9.
by ij23 2y ago
Canary is awesome! we use Canary for our doc search at LiteLLM (you can see it here: https://docs.litellm.ai/docs/ ) It's really useful to be able to specify the search space for a specific query (example: Canary a
10.
by ij23 3y ago
hi i'm the maintainer of litellm - we persist rate limits, they're written to a DB: https://docs.litellm.ai/docs/proxy/virtual_keys - LiteLLM Proxy IS Exactly Compatible with the OpenAI SDK
11.
by ij23 3y ago
I'm the LiteLLM maintainer, can you elaborate what you're looking for us to do here?
12.
FastRepl – open-source evals for RAG, Agents(github.com)
3 points by ij23 3y ago|0 comments
13.
React Library to Build Dashboards(tremor.so)
1 points by ij23 3y ago|0 comments
14.
Open Interpreter: Code Interpreter in your terminal, running locally(100 LLMs)(github.com)
4 points by ij23 3y ago|0 comments
15.
EvaDB – SQL Queries Using Hugging Face, Open AI, Ultralytics, PyTorch(github.com)
6 points by ij23 3y ago|1 comments
16.
Show HN: LiteLLM - Open source library A/B test LLMs in Production(litellm.vercel.app)
2 points by ij23 3y ago|0 comments
17.
Llama2 on Replicate faster than ChatGPT?(github.com)
1 points by ij23 3y ago|2 comments
18.
by ij23 3y ago
Ran some testing and discovered llama2 on replicate is faster than chatgpt! Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua... Are others seeing similar results?
19.
by ij23 3y ago
What local/in-K8-cluster models servers would you recommend adding ? Should we add support for llama.cpp and vllm.ai in the proxy server ? Or should we assume you can host them on your own infra and the proxy server requests your hoste
20.
by ij23 3y ago
Yes, you use your own API keys. You can set them as env variables. Either set them as os.environ['OPENAI_API_KEY'] or set them in .env files: https://litellm.readthedocs.io/en/latest/supported/
21.
Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching(github.com)
140 points by ij23 3y ago|34 comments
22.
Show HN: LiteLLM -Open-Source Library for Anthropic,Azure,OpenAI, etc. API Calls(litellm.ai)
5 points by ij23 3y ago|1 comments
23.
by ij23 3y ago
thanks for sharing, while your library looks really powerful my goal with Litellm is simplicity
24.
by ij23 3y ago
good points, probably going to add streaming output, function calling support. As for retries tenacity does a great job already
25.
by ij23 3y ago
azure models have custom names - eg I call mine 'chat-gpt-test1', I require some flag to know if it's an azure model
26.
by ij23 3y ago
Thank you !
27.
by ij23 3y ago
Thanks!
28.
Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O(github.com)
62 points by ij23 3y ago|17 comments
29.
Show HN: ReliableKeys – Set Spend Limits on OpenAI Keys(reliablegpt.dev)
3 points by ij23 3y ago|0 comments
30.
Show HN: ReliableGPT run 200 GPT-4 requests in parallel(colab.research.google.com)
14 points by ij23 3y ago|3 comments

More ›