HACKER Q&A
📣 throwawayadvsec

Best cheap decent LLM for handling code, social media profiles?


Hi, I'm looking for a LLM that can be used to have decent answers to stuff like: "what libraries do this code import?" "does this code follow this design pattern?" "do the variables used in this code have a meaningful name?"

GPT 3.5 turbo can do it pretty well, but it's out of my budget, as I would need to make a LOT of requests.

I have about 8,000$ in AWS credits for self hosting

Is there any LLM you'd recommend for this?

I was thinking of reverse engineering copilot and using its internal API directly, do you know if there is a big rate limit?

thanks


  👤 i_have_an_idea Accepted Answer ✓
I like this one: https://huggingface.co/junelee/wizard-vicuna-13b

I am not affiliated with the project. I like that LLM because it runs on my Mac and it performs fairly close to GPT 3.5


👤 extasia
What's your expected usage, volume wise?