5 ms·
How do you use these models with your editor? (E. vscode or Emacs etc)
by hskalin 3y ago
How do you use these models with your editor? (E. vscode or Emacs etc)
- tarruda 3y agoAn easy way is to use an OpenAI compatible server, which means you can use any GPT plugin to integrate with your editor
- eyegor 3y agoI run tabby [0] which uses llama.cpp under the hood and they ship a vscode extension [1]. Going above 1.3b, I find the latency too distracting (but the highest end gpu I have nearby is some 16gb rtx quadro card that's a couple years old, and usually I'm running a consumer 8gb card instead). [0] https://tabby.tabbyml.com/ https://tabby.tabbyml.com/ [1] https://marketplace.visualstudio.com/items?itemName=TabbyML.vscode-tabby https://marketplace.visualstudio.com/items?itemName=TabbyML....
- tarasglek 3y agoWould you mind sharing your tabby invocation to launch this model?