5 ms·
Ask HN: Best cheap decent LLM for handling code, social media profiles?
Hi,
I'm looking for a LLM that can be used to have decent answers to stuff like:
"what libraries do this code import?"
"does this code follow this design pattern?"
"do the variables used in this code have a meaningful name?"
GPT 3.5 turbo can do it pretty well, but it's out of my budget, as I would need to make a LOT of requests.
I have about 8,000$ in AWS credits for self hosting
Is there any LLM you'd recommend for this?
I was thinking of reverse engineering copilot and using its internal API directly, do you know if there is a big rate limit?
thanks
- extasia 3y agoWhat's your expected usage, volume wise?
- throwawayadvsec 3y agohundred of thousand of requests monthly
- extasia 3y agoHow much would GPT cost?
- i_have_an_idea 3y agoI like this one: https://huggingface.co/junelee/wizard-vicuna-13b https://huggingface.co/junelee/wizard-vicuna-13b I am not affiliated with the project. I like that LLM because it runs on my Mac and it performs fairly close to GPT 3.5