When I found Tesla P100s on ebay for $75 I thought I was getting a cheap server, but 1/3 of the total cost was RAM. Sorry, first time I've built a computer since the shortage.
I don't know why we're even talking about Qwen3.6 for writing code when qwen3-coder exists. My experience is there's no contest. I'm using 30b with 96k context on a dedicated server.
Qwen3.6 was the first model I ran locally that seemed smart, but qwen3-coder:30b is way, way more responsive and more accurate for writing code according to my tests, including human-eval. If you can run one than you…
You don't have to have a monopoly to be monopolistic.
I know it uses electricity, but part of the benefit of a local model has to be that you can let it do this while you sleep, and not pay Anthropic for an unknown number of tokens.
Exactly. I have sort of a fetish for trying to make things smaller by trimming out things that aren't needed. Unfortunately this skill has been largely useless since forever, because hardware improves to the point that…
I'm really curious about this, not because I disagree, but because I want to avoid agents going whack. Are you running vllm for yourself only, or a for a team, or for an application, etc? And do you feel there is a…
I saw this years and years ago, and it's actually one of my favorite things I've ever seen on the web. I recommend reading from start to finish.
Or more simply just wrap some orchestrator in a single service file. Could just be a bash script used for ExecStart.
The fact that every job application wants a link to my profile on a platform that tries to push "brain training puzzle and games" on me just makes me angry every single time. I really hate LinkedIn and my active…
Sure. Even a history of safety success contributes to this. We haven't had an accident in 3000 days, what was dangerous about this job again? Also what's this stupid policy for anyway, I've never seen anybody even come…
This is really accurate to my experience learning FreeCAD earlier this year. I am a former professional CAD user (of a lesser software than AutoCAD) and I don't think I would have gotten far without being able to ask…
To be fair, I think human nature is probably a bigger culprit here than the quote. Yes, it was one of the first things told to me as a new programmer. No, I don't think it influenced very heavily how I approach my work.…
DRY is not to avoid writing code (of any amount). DRY is a maintainability feature. "Unless you're very familiar with the code" you probably won't remember that you have to make this change in two places instead of one.…
I think this is a reasonable rule of thumb, but there are also times that the code you are about to write a second time is extremely portable and can easily be made reusable (say less than 5 minutes of extra time to…
I'm sorry that the author got bitten by this. But .com purism is funny to me. I only buy GTLDs for personal projects, and I've never had a problem before. But then, I've never bought .online.
Private keys should never leave the device where they are created.
Right, I'd say this is the best value I've gotten out of it so far: I'm planning to build this thing in this way, does that seem like a good idea to you? Sometimes I get good feedback that something else would be better.
To me, an old guy, I would rather have LLM doing (assisting with) the code review than the actual code production. Is that stupid?
I prefer not, because technically this socialist phase is part of capitalism currently.
Yes - we're in what I like to call the Socialist Phase of AI (user acquisition). We were once in this phase with Google. Eventually we'll move into the as-yet-unnamed-by-me phase that Google (and search in General, also…
A late reply to your outrage: I said I'm in favor, I'm not trying to parent your kids, but the effects of putting a phone (or similar) into most peoples' hands is easily observable and marked. I'm not limiting this to…
As a parent who gave my oldest child a (very used) smartphone just before she turned 14, I would be in favor of making smartphones illegal under age 15 (or some other number, higher or lower I don't care). I'm pretty…
The classic comeback - every time I mention simplicity to a particular team member of mine, this is what he says. Complexity is unavoidable. Yes. But if you don't fight it tooth and nail, spend more time than you want…
This may be a bit pedantic, but Emacs-as-a-hammer metaphor might work better than you intended, since a hammer is definitely useful for more than just hitting nails. This seems pretty neat to me.
When I found Tesla P100s on ebay for $75 I thought I was getting a cheap server, but 1/3 of the total cost was RAM. Sorry, first time I've built a computer since the shortage.
I don't know why we're even talking about Qwen3.6 for writing code when qwen3-coder exists. My experience is there's no contest. I'm using 30b with 96k context on a dedicated server.
Qwen3.6 was the first model I ran locally that seemed smart, but qwen3-coder:30b is way, way more responsive and more accurate for writing code according to my tests, including human-eval. If you can run one than you…
You don't have to have a monopoly to be monopolistic.
I know it uses electricity, but part of the benefit of a local model has to be that you can let it do this while you sleep, and not pay Anthropic for an unknown number of tokens.
Exactly. I have sort of a fetish for trying to make things smaller by trimming out things that aren't needed. Unfortunately this skill has been largely useless since forever, because hardware improves to the point that…
I'm really curious about this, not because I disagree, but because I want to avoid agents going whack. Are you running vllm for yourself only, or a for a team, or for an application, etc? And do you feel there is a…
I saw this years and years ago, and it's actually one of my favorite things I've ever seen on the web. I recommend reading from start to finish.
Or more simply just wrap some orchestrator in a single service file. Could just be a bash script used for ExecStart.
The fact that every job application wants a link to my profile on a platform that tries to push "brain training puzzle and games" on me just makes me angry every single time. I really hate LinkedIn and my active…
Sure. Even a history of safety success contributes to this. We haven't had an accident in 3000 days, what was dangerous about this job again? Also what's this stupid policy for anyway, I've never seen anybody even come…
This is really accurate to my experience learning FreeCAD earlier this year. I am a former professional CAD user (of a lesser software than AutoCAD) and I don't think I would have gotten far without being able to ask…
To be fair, I think human nature is probably a bigger culprit here than the quote. Yes, it was one of the first things told to me as a new programmer. No, I don't think it influenced very heavily how I approach my work.…
DRY is not to avoid writing code (of any amount). DRY is a maintainability feature. "Unless you're very familiar with the code" you probably won't remember that you have to make this change in two places instead of one.…
I think this is a reasonable rule of thumb, but there are also times that the code you are about to write a second time is extremely portable and can easily be made reusable (say less than 5 minutes of extra time to…
I'm sorry that the author got bitten by this. But .com purism is funny to me. I only buy GTLDs for personal projects, and I've never had a problem before. But then, I've never bought .online.
Private keys should never leave the device where they are created.
Right, I'd say this is the best value I've gotten out of it so far: I'm planning to build this thing in this way, does that seem like a good idea to you? Sometimes I get good feedback that something else would be better.
To me, an old guy, I would rather have LLM doing (assisting with) the code review than the actual code production. Is that stupid?
I prefer not, because technically this socialist phase is part of capitalism currently.
Yes - we're in what I like to call the Socialist Phase of AI (user acquisition). We were once in this phase with Google. Eventually we'll move into the as-yet-unnamed-by-me phase that Google (and search in General, also…
A late reply to your outrage: I said I'm in favor, I'm not trying to parent your kids, but the effects of putting a phone (or similar) into most peoples' hands is easily observable and marked. I'm not limiting this to…
As a parent who gave my oldest child a (very used) smartphone just before she turned 14, I would be in favor of making smartphones illegal under age 15 (or some other number, higher or lower I don't care). I'm pretty…
The classic comeback - every time I mention simplicity to a particular team member of mine, this is what he says. Complexity is unavoidable. Yes. But if you don't fight it tooth and nail, spend more time than you want…
This may be a bit pedantic, but Emacs-as-a-hammer metaphor might work better than you intended, since a hammer is definitely useful for more than just hitting nails. This seems pretty neat to me.