6 ms·
People really should stop calling a glorified openAI API as an open-source software.
by Alex4386 2y ago
People really should stop calling a glorified openAI API as an open-source software.
- jillesvangurp 2y agoThere are several free alternatives to OpenAI that use the same API; which would make it possible to substitute OpenAI for one of those models in this extension. At least on paper. There is an open issue on the github repository requesting something like that. So, it's not as clear cut. The general approach of using LLMs for this is not a bad one; LLMs are pretty good at this stuff.
- dotancohen 2y agoYes, but the API at the end is providing the core functionality. Simply swapping out one LLM model for another - let alone by a different company altogether - will completely change the effectiveness and usefulness of the application.
- Tepix 2y agoWell, as we see with AI applications like "Leo AI" and "Continue", using a locally run LLM can be fantastic replacements for proprietary offerings.
- dartos 2y agoFWIW I’ve found local models to be essentially useless for coding tasks.
- Tepix 2y agoReally? Maybe your models are too small?
- spmurrayzzz 2y agoThe premier open weight models don't even comparatively perform well on the public benchmarks compared to frontier models. And that's assuming at least some degree of benchmark contamination for the open weight models. While I don't think they're completely useless (though its close), calling them fantastic replacements feels like an egregious overstatement of their value. EDIT: Also wanted to note that I think this becomes as much an expectations-setting exercise as it is evaluation on raw programming performance. Some people are incredibly impressed by the ability to assist in building simple web apps, others not so much. Experience will vary across that continuum.
- dartos 2y agoYeah, in my comparing deepseek coder 2 lite (the best coding model I can find that’ll run on my 4090) to Claud sonnet under aider… Deep seek lite was essentially useless. Too slow and too low quality edits. I’ve been programming for about 17 years, so the things I want aider to do are a little more specific than building simple web apps. Larger models are just better at it. I can run the full deepseek coder model on some cloud and probably get very acceptable results, but then it’s no longer local.
- websap 2y agoWoah woah! Those are fighting words. /s
- JCharante 2y agoeveryone stands on the shoulders of giants.
- sham1 2y agoThings standing on the shoulders of proprietary giants shouldn't claim to be free software/open source.
- t-writescode 2y agoTheir interfacing software __is__ open source; and, they're asking for your OpenAI api key to operate. I would expect / desire open source code if I were to use that, so I could be sure my api key was only being used for my work, so it's only my work that I'm paying for and it's not been stolen in some way.
- noduerme 2y agoMy older brother who got me into coding learned to code in Assembly. He doesn't really consider most of my work writing in high level languages to be "coding". So maybe there's something here. But if I had to get into the underlying structure, I could. I do wonder whether the same can be said for people who just kludge together a bunch of APIs that produce magical result sets.
- dotancohen 2y ago> But if I had to get into the underlying structure, I could. How do you propose to get into the underlying structure of the OpenAPI API? Breach their network and steal their code and models? I don't understand what you're arguing.
- latexr 2y ago> How do you propose to get into the underlying structure of the OpenAPI API? The fact that you can’t is the point of the comment. You could get into the underlying structure of other things, like the C interpreter of a scripting language.
- dartos 2y agoOne would hope, that since the problem these models are trying to solve is language modeling, they would eventually converge around similar capabilities
- deleted 2y ago[deleted]
- guappa 2y agoThis stuff is starting to enter debian as well -_-'
- zlwaterfield 2y agoPlan is to add local LLM support so goal is fully OSS, agree initial wording could have been better.
- deleted 2y ago[deleted]