> I say LLM, not “AI”, when talking about the text generation models at the heart of most of the “AI” explosion. I’ll prefer technical terms to marketing buzzwords the whole way through, even at the cost of being awkward and definitely a little stodgy. Useful precision beats vacuous true statements every time, and the difference now very much matters.
> A $5000 budget would barely suffice to run something like gpt-oss 120b (OpenAI’s open model that is okay at code-writing tasks).
I play with this model on a $1,200 shoebox-sized PC. If/when I do want to outsource my work, it does perfectly fine. Snappy, even, while sipping <200W. Keeps my data local, too.
9 comments
[ 3.3 ms ] story [ 31.2 ms ] threadYes! Put it directly into my veins^W brains
> A $5000 budget would barely suffice to run something like gpt-oss 120b (OpenAI’s open model that is okay at code-writing tasks).
I play with this model on a $1,200 shoebox-sized PC. If/when I do want to outsource my work, it does perfectly fine. Snappy, even, while sipping <200W. Keeps my data local, too.
Flagged for clickbait and perpetuating the pro-/anti- AI squabble that exists solely to farm karma on the HN frontpage.