Ask HN: Best cheap decent LLM for handling code, social media profiles?

3 points by throwawayadvsec ↗ HN
Hi, I'm looking for a LLM that can be used to have decent answers to stuff like: "what libraries do this code import?" "does this code follow this design pattern?" "do the variables used in this code have a meaningful name?"

GPT 3.5 turbo can do it pretty well, but it's out of my budget, as I would need to make a LOT of requests.

I have about 8,000$ in AWS credits for self hosting

Is there any LLM you'd recommend for this?

I was thinking of reverse engineering copilot and using its internal API directly, do you know if there is a big rate limit?

thanks

4 comments

[ 3.0 ms ] story [ 23.0 ms ] thread