7 ms·
It seems to be limited to certain LLM servers, on of which is OpenAI, none of which includes e.g. Mystral and popular OSS LLMs. I wonder if that will change -
by gardenfelder 2y ago
It seems to be limited to certain LLM servers, on of which is OpenAI, none of which includes e.g. Mystral and popular OSS LLMs.
I wonder if that will change - eventually.
Discord channels are named in Chinese, though there are English posts.
- shekhar101 2y agoIt's trivial to run a proxy server that routes all OpenAi calls to another LLM, even local ones. See litellm-proxy.
- gardenfelder 2y agohttps://github.com/BerriAI/liteLLM-proxy https://github.com/BerriAI/liteLLM-proxy
- _akhe 2y agoI see a `LocalLLM` chat model where it looks like you can pass a host/port (for example, ollama's)
- gardenfelder 2y agowhere do you see that?
- _akhe 2y agohttps://github.com/infiniflow/ragflow/blob/main/rag/llm/chat_model.py#L132 https://github.com/infiniflow/ragflow/blob/main/rag/llm/chat...
- rosspackard 2y agoLooks like they do but aren't really documented yet: https://github.com/infiniflow/ragflow/pull/119 https://github.com/infiniflow/ragflow/pull/119
- vissidarte_choi 2y agoRAGFlow will support more LLMs, including locally deployed LLMs.