11 ms·
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
by codexb 2mo ago
Does this support using only private LLM instances? Does it integrate with Amazon Bedrock?
- segmenta 2mo agoYou can use both private LLM instances or hosted ones. On private we support Ollama, LM Studio and any OpenAI compatible API. In hosted, we support: OpenAI, Anthropic, Gemini, OpenRouter, Vercel AI Gateway. No native Amazon Bedrock support, but you could use OpenRouter or LiteLLM with the Bedrock key and point Rowboat to that today.