7 ms·
Which LLM are you using?
by decodebytes 3y ago
Which LLM are you using?
- MourningWood 3y agoLooks like gpt4
- michaelmior 3y agoFor the time being, it looks like you can choose between gpt-3.5-turbo-16k and gpt-4. https://github.com/opencopilotdev/opencopilot/blob/d7aa8270db24641723e49d3575f0dc8e94e7ec3e/opencopilot/settings.py#L27C21-L27C48 https://github.com/opencopilotdev/opencopilot/blob/d7aa8270d...
- sq42na 3y agoYep, currently gpt-3.5-16k or gpt-4. We wrote the example prompts in a relatively Llama-compatible way though (we actually started building this onto Llama 1 before switching to OpenAI as default), and make few assumptions about the LLM so it's easy to switch out. Mostly this is waiting behind us adding an option to pass in any LLM, and we're planning to add support for this. Generally, we leave the LLM up to the user -- if OpenAI or Google is a no-go, then you probably are anyway in the territory of self-hosting or even self-training your LLM, which means you're fine setting up your own inference endpoints as well.