5 ms·
Show HN: Privy - Open-source, privacy oriented alternative to GitHub Copilot
- ignoramous 3y agoNice. > Some of the popular LLMs that we recommend are: Mistral, CodeLLama 1. Surprised Mistral (Mixtral?) is recommended for code generation / explanation alongside a fine-tuned CodeLlama? 2. Recent human evals put Microsoft's WaveCoder-Ultra-6.7B (SoTA w/ GPT4) at the top of the rankings with WizardCoder-33B, Magiccoder-S-DS-6.7B trailing: https://twitter.com/TeamCodeLLM_AI/status/1747551286877450647 https://twitter.com/TeamCodeLLM_AI/status/174755128687745064...
- ParetoOptimal 3y agoTypically when a 6.7B model or similar beats a 33B model it's not really true in my experience. At the least I have very a high burden of proof before believing it.
- austhrow743 3y agoAre you able explain what the charts mean? Only one of the three has wavecoder at the top.
- ignoramous 3y agoThose charts show pass@k metric (expectation at least k generated samples are correct out of n) on OpenAI and Octopack problem evals for code. WaveCoder: https://arxiv.org/abs/2312.14187 https://arxiv.org/abs/2312.14187 (section 3.2) Octopack: https://github.com/bigcode-project/octopack https://github.com/bigcode-project/octopack
- srikanth235 3y agoWhile testing internally, Mistral worked well. But these models are just starting points. Will add support for the models WaveCoder-Ultra-6.7B, WizardCoder-33B, Magiccoder-S-DS-6.7B, etc soon.
- oakhaven 3y agoI root for this, but runnign LLM locally disqualifies a lot of workstations, for example laptops with integrated graphics.
- accelbred 3y agoYou can run it on a different machine. I've set up my desktop to host ollama, and use it from my laptop just fine.
- jstummbillig 3y ago[flagged]
- ignoramous 3y ago> I am fairly confused by the amount of work people are willing to devote to runner-up work You're not entirely wrong, even if off-topic. See also: https://apenwarr.ca/log/20211229 https://apenwarr.ca/log/20211229
- cybrox 3y agoThanks for linking. This is actually very well written!
- chrisweekly 3y agoWow, that was an awesome post; funny and insightful. Thanks for sharing!
- falserum 3y agoStopped reading after this: > Recently
- falserum 3y ago/s
- jstummbillig 3y agoInteresting read. Please note that this quote partial as it stands is misrepresenting what I meant, but it's for all to see and also not that important :)
- monknomo 3y agomaybe I'm showing my rural roots here, but a privy is an outhouse. Of course, it also has the "secret" meaning, but...
- srikanth235 3y agoI was thinking more in terms of something like secret or private :)
- tweetle_beetle 3y agoI suspect it's making use of the 'trusted personal advisor' connotations, similar to the metaphor of having a co-pilot if you will - https://en.wikipedia.org/wiki/Privy_council https://en.wikipedia.org/wiki/Privy_council
- zik 3y agoMaybe it's referring to "code smell"?
- deleted 3y ago[deleted]
- deleted 3y ago[deleted]
- spott 3y agoHow is this different from continue.dev?
- rbut 3y agoTabby is another alternative. https://github.com/TabbyML/tabby https://github.com/TabbyML/tabby
- Havoc 3y agoTabby does completion while continue is more chat from memory? There is also refact
- srikanth235 3y agoYes, Tabby focuses on auto-completion. We're more similar to continue.dev at this point of time. Will add comparison table soon.
- Havoc 3y agoReally wish both completion and chat could be run against the same LLM end point. Most of these seem to be doing their own incompatible docker thing which is annoying
- lxe 3y agoDoes it do AI autocomplete?
- srikanth235 3y agoNot as of now!
- mmcclure 3y agoThis seems really cool, thanks for sharing! The thing I find the most valuable about Copilot is it living directly in VSCode. Understand it's not trivial and this has one public commit, but long-term do you have plans to move closer to the editor? How do you see this in relation to other projects like continue.dev?
- srikanth235 3y agoYes, absolutely. The goal is to come as close as possible to GitHub copilot in terms of DX. Will add a comparison table soon with other players in the space like continue.dev, TabbyML etc.
- binary132 3y agoI am finding myself questioning the choice of a name that also means “toilet” or “outhouse”, but hey, you do you.
- srikanth235 3y agoI was thinking more in terms of something like secret or private :)
- anakaine 3y agoYes, well, you've basically missed the entirety of the British empire who most of have at some point in not too recent history called a toilet a privy. It's an older term, but still very well recognised.
- lgrammel 3y agoSo, you essentially took my project ( https://github.com/rubberduck-ai/rubberduck-vscode https://github.com/rubberduck-ai/rubberduck-vscode ), and instead of contributing to it or forking it, you recommitted all the code under your own name, with a few small tweaks. To be fair, I saw that you give credit, but it's kind of disappointing still given that prob 98% of the project is the work of the Rubberduck contributors. I know Rubberduck is not that active any more, but it's still disappointing.
- bearjaws 3y agoShout out to OP for ModelFusion. Probably one of the better ways to use LLMs instead of just integrating the OAI API and reinventing the rest of the wheel. Handles lots of corner cases and lets you swap in other models easily. https://github.com/lgrammel/modelfusion https://github.com/lgrammel/modelfusion
- lgrammel 3y agoThanks!
- fuddle 3y agoThey should include the original copyright notice in their version of the software according to your license.
- ui90909090 3y agoI am genuinely curious to know, what is your expectation here? He gave you credit in Github. He called it forever "indebted", which IMO is too much. You put out code under MIT license. MIT license means anyone can take the copy and fork it. Why are you disappointed? Are you disappointed because a person of Indian origin did it better than you Or are you disappointed that because you wanted all fame but he took your code fork (still valid under MIT license) and did a better marketing than you with wrapper. If you don't want people to use your use, put behind paywall. It is not difficult to understand.
- rbut 3y ago
- vunderba 3y agoNice work, but it's unfortunately named. A privy also refers to a latrine. Given that this project was started well after Continue.dev, I think it would be useful to include an FAQ or a comparison table on what exactly makes this different. https://github.com/continuedev/continue https://github.com/continuedev/continue
- srikanth235 3y agoI was thinking more in terms of something like secret or private :) Will add comparison table soon.
- ReD_CoDE 3y agoNice! Sorry if I ask this here, but is there any web-based version of VSCode other than VSCode.dev or any open source alternative? I'm looking for a web-based IDE, something advanced like Project IDX Is there any?
- kaanyalova 3y agohttps://github.com/coder/code-server https://github.com/coder/code-server is like vscode.dev but self hosted