5 ms·
I'll add if folks want to submit a PR to turn on other LLMs (or have Cody talk to the base LLM provider directly, sans Sourcegraph), we're happy to accept those
by beyang 3y ago
I'll add if folks want to submit a PR to turn on other LLMs (or have Cody talk to the base LLM provider directly, sans Sourcegraph), we're happy to accept those. Literally the only thing preventing us from doing that right now is prioritization (our team is 4 people and we're scrambling to improve context fetching and implement autocomplete rn :sweat-laugh-emoji:)
- wsxiaoys 3y agoThat‘ll be super interesting! Local context is definitely the key factor for small models achieving better quality than copilot (related: [1], [2]) . One things I’d really wanna have in Sourcegraph: A Search API supports custom retrieval / ranking. Research works (e.g [2]) show simple BoW fetched context is more efficient for code completion tasks. Disclaimer: I’m building https://github.com/TabbyML/tabby https://github.com/TabbyML/tabby an open source alternative of copilot. [1]: https://arxiv.org/abs/2206.12839 https://arxiv.org/abs/2206.12839 [2]: https://arxiv.org/abs/2303.12570 https://arxiv.org/abs/2303.12570