GPT 3.5 turbo can do it pretty well, but it's out of my budget, as I would need to make a LOT of requests.
I have about 8,000$ in AWS credits for self hosting
Is there any LLM you'd recommend for this?
I was thinking of reverse engineering copilot and using its internal API directly, do you know if there is a big rate limit?
thanks
I am not affiliated with the project. I like that LLM because it runs on my Mac and it performs fairly close to GPT 3.5