5 ms·
How do I connect it to a local llama.cpp instance?
by dur-randir 5mo ago
How do I connect it to a local llama.cpp instance?
- GodelNumbering 5mo agoIt supports LMStudio or you can start a local endpoint, then run OPENAI_COMPATIBLE_CUSTOM_KEY="xxx" dirac -y --provider "https://localhost/v1" --model <model_name> "hi..."