9 comments

[ 3.1 ms ] story [ 25.5 ms ] thread
I think we're still waiting for the ultimate coding LLM setup:

1. Able to run locally on a high end GPU (IE. M3 Max/Nvidia 4080)

2. Able to read the entirety of a decent sized codebase

3. As good as GPT4 (coding only)

4. Free or $10 or less/month

Wouldn't ultimate setup be more like "runs on a raspberry pi"?
I don’t think the Pi has enough flops
LICENSE

2. Additional Commercial Terms. If, on the Llama 2 version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee's affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Meta, which Meta may grant to you in its sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until Meta otherwise expressly grants you such rights.

https://github.com/facebookresearch/codellama/blob/main/LICE...

https://github.com/facebookresearch/llama/blob/main/LICENSE

I think this is perfectly reasonable. 700 million is a lot and it would be unreasonable profit to that amount off someone else’s R&D
The best part is tech companies built these models from content they did not pay for.
Seems like a clever way to ensure direct competitors cannot use the service, but otherwise leave it open for everyone else.