5 ms·
AnyLanguageModel: One API for Local and Remote LLMs on Apple Platforms
- _mattt 10mo agoAuthor / creator here. I built this because integrating LLMs into Swift apps meant juggling completely different APIs for MLX, llama.cpp, CoreML, Ollama, and cloud providers. AnyLanguageModel gives you a single interface modeled on Apple's Foundation Models framework. GitHub repo here: https://github.com/mattt/AnyLanguageModel https://github.com/mattt/AnyLanguageModel Happy to answer questions about the implementation or trade-offs we made.