6 ms·
Ask HN: What are some good APIs to interact with large language models?
I am looking to do simple things like image classification/text classification using APIs without running the LLMs in my local machine. What are some APIs that provide a uniform interface to access different LLMs?
- vismit2000 2y agohttps://github.com/simonw/llm https://github.com/simonw/llm
- logankeenan 2y agoI used runpod.io prior to buying a pair of 3090s. They make it easy to run vllm too so you can experiment with different models. I also rented a GPU vm from them and ran huggingface models on it. That did require lot more coding and learning. https://docs.runpod.io/serverless/workers/vllm/get-started https://docs.runpod.io/serverless/workers/vllm/get-started
- Tostino 2y agoAs far as what 'API' to use, please just coalesce around the OpenAI API for your client software. You can start up an OpenAI compatible endpoint with vLLM for example. Just stick with that. You can use LiteLLM as a proxy to convert your client side requests to whatever server side format is expected for e.g. Claude.
- etcd 2y agolmstudio.io
- PenisBanana 2y agodead . . . recently registered with Namecheap
- etcd 2y agoSorry ai https://lmstudio.ai/ https://lmstudio.ai/
- anonzzzies 2y agoOpenroute.ai works very well; we use it for everything.
- anonzzzies 2y ago+r Sorry, didn't see till now ; openrouteR.ai
- emmanueloga_ 2y agoGoing through middle layers has pros and cons. You'll likely find better docs and experience by going through the official APIs directly. Maybe start with OpenAI and/or Claude official libraries, both provide pretty good docs. If you really must use a wrapper, a strategy I use is to look into open-source apps I like and see what they are using. Aider for instance seems to be using this "litellm" thing... If I were to need cross API support for AI, I would probably look into that [1]. llm uses opeanai directly [2]. Etc, etc. -- 1: https://github.com/Aider-AI/aider/blob/e76704e261647348fd7c18931fd0c1f9ac370408/requirements/requirements.in#L23 https://github.com/Aider-AI/aider/blob/e76704e261647348fd7c1... 2: https://github.com/simonw/llm/blob/d654c9521235a737e59a4f1d77cf4682589123ec/setup.py#L40 https://github.com/simonw/llm/blob/d654c9521235a737e59a4f1d7...
- Gooblebrai 2y agoReplicate.com? Has a good variety of models
- anon1094 2y agoI'm using Lemonfox for barebones speech-to-text translation.
- constantinum 2y agoUnstract, if you are into automating document processing > https://github.com/Zipstack/unstract?tab=readme-ov-file#-ecosystem-support https://github.com/Zipstack/unstract?tab=readme-ov-file#-eco...