> you keep poking This is waving over engineering an agent with tools, harness, prompts, and loops. The models are still just next token predictors and everything, including predicting more than 1 token, is the result…
I don't really believe any of it. I've seen articles for nearly 2 years now about "agent" automonously doing things like blackmail, hacking, coordinating. But during that same time, I've used o3 up to fable, sol, and a…
the "new" Twitter basically looks like a cash/name grab, I was disappointed to see that nobody involved in it was affiliated the Twitter, and it's mostly run by non-technical/lawyer types.
yeah took me a few tries and then it didn't even go to the content
Having a hard time understanding what MCP is really for. Even for my small local models, if MCP is not available, they seem to do just fine connecting to anything I need with an API and falling back to using a browser.
All the benchmarks in the world don't matter if the model just straight up refuses to do mundane things. Claude has too much of an attitude.
I didn't use the word "just"
It is revisionist to say that software engineering was never about writing code. It was, in fact, a huge component, and it also wasn't easy. Sure most code is glue but even the glue was tedious and the actual hard and…
This is phone OS developer's fault for even allowing it. When I take a screenshot, I expect to have an image of exactly whatever was displayed on the screen at the time. Its not a picture of your app, its a picture of…
This has that weird "AI written" sentence structure.
"it can fit" on 256GB of RAM, but it will be heavily quantized and still run very slowly. The headline number is not token generation, its prompt processing. So if you get 10 tok/s and an API gives you 20-30 tok/s, it…
unauthorized? Are they trying to find a middle ground word between "illegal" and "undocumented"?
Any generic abliterated or ubcensored open weight model (such as a qwen variant) will happily comply with requests like this.
Maybe some (or many) people believe that more people will make it less "lovely". I think this is a popular stance and I think many people are more than satisfied with the current population density of their area.
Does my concern somehow become less valid because I'm American? Everyone should be thinking carefully about which of their data is going where.
I guess I was speaking as an American, we have good domestically hosted options so although it’s probably not ideal to send this kind of data/control anywhere at all, it’s definitely a worse option for us to send it to…
I’m worried about giving a foreign hosted service access to my machine for a coding agent that can run arbitrary commands and read arbitrary files. Coding agent are much more useless if you have to sit there clicking…
I recently built a system at insane ddr4 prices ($2000 for 256gb). But that’s only after seeing how ddr5 prices were 3-4x that!
Using an Epyc platform to get plenty of PCIe lanes and memory channels. I have couple of extra 3090s plugged in which get some offload and help with larger models that don't fit entirely on the blackwell.
> Even if LLMs fail spectacularly Haven't they already proven to be extremely useful? In some areas they are definitely here to stay, coding/software and search (retrieve and summarize information). There's a bunch of…
You can get 70-80 tps on qwen3.6-27b f16 with MTP on a single card
I got an RTX 6000 pro too. I like running locally, I've learned a lot more than if I had used an API and there's less worry about overspending tokens. I accidentally spent $100 on claude api in like 2 days because I…
At this point IPOs are mainly for unloading bags onto retail. Every institution who wanted a piece of these labs got in years ago and captured all the value.
I use claude/gemini as my homepage now (I have to keep switching as these companies make "updates" that periodically render their models useless). Even if I want to search for simple things, I would rather have an LLM…
They won't, its literally part of their sales funnel. They've specifically engineered a bad experience for anyone outside the ecosystem by making it all of their friend's problem too. Its very important for their stock…
> you keep poking This is waving over engineering an agent with tools, harness, prompts, and loops. The models are still just next token predictors and everything, including predicting more than 1 token, is the result…
I don't really believe any of it. I've seen articles for nearly 2 years now about "agent" automonously doing things like blackmail, hacking, coordinating. But during that same time, I've used o3 up to fable, sol, and a…
the "new" Twitter basically looks like a cash/name grab, I was disappointed to see that nobody involved in it was affiliated the Twitter, and it's mostly run by non-technical/lawyer types.
yeah took me a few tries and then it didn't even go to the content
Having a hard time understanding what MCP is really for. Even for my small local models, if MCP is not available, they seem to do just fine connecting to anything I need with an API and falling back to using a browser.
All the benchmarks in the world don't matter if the model just straight up refuses to do mundane things. Claude has too much of an attitude.
I didn't use the word "just"
It is revisionist to say that software engineering was never about writing code. It was, in fact, a huge component, and it also wasn't easy. Sure most code is glue but even the glue was tedious and the actual hard and…
This is phone OS developer's fault for even allowing it. When I take a screenshot, I expect to have an image of exactly whatever was displayed on the screen at the time. Its not a picture of your app, its a picture of…
This has that weird "AI written" sentence structure.
"it can fit" on 256GB of RAM, but it will be heavily quantized and still run very slowly. The headline number is not token generation, its prompt processing. So if you get 10 tok/s and an API gives you 20-30 tok/s, it…
unauthorized? Are they trying to find a middle ground word between "illegal" and "undocumented"?
Any generic abliterated or ubcensored open weight model (such as a qwen variant) will happily comply with requests like this.
Maybe some (or many) people believe that more people will make it less "lovely". I think this is a popular stance and I think many people are more than satisfied with the current population density of their area.
Does my concern somehow become less valid because I'm American? Everyone should be thinking carefully about which of their data is going where.
I guess I was speaking as an American, we have good domestically hosted options so although it’s probably not ideal to send this kind of data/control anywhere at all, it’s definitely a worse option for us to send it to…
I’m worried about giving a foreign hosted service access to my machine for a coding agent that can run arbitrary commands and read arbitrary files. Coding agent are much more useless if you have to sit there clicking…
I recently built a system at insane ddr4 prices ($2000 for 256gb). But that’s only after seeing how ddr5 prices were 3-4x that!
Using an Epyc platform to get plenty of PCIe lanes and memory channels. I have couple of extra 3090s plugged in which get some offload and help with larger models that don't fit entirely on the blackwell.
> Even if LLMs fail spectacularly Haven't they already proven to be extremely useful? In some areas they are definitely here to stay, coding/software and search (retrieve and summarize information). There's a bunch of…
You can get 70-80 tps on qwen3.6-27b f16 with MTP on a single card
I got an RTX 6000 pro too. I like running locally, I've learned a lot more than if I had used an API and there's less worry about overspending tokens. I accidentally spent $100 on claude api in like 2 days because I…
At this point IPOs are mainly for unloading bags onto retail. Every institution who wanted a piece of these labs got in years ago and captured all the value.
I use claude/gemini as my homepage now (I have to keep switching as these companies make "updates" that periodically render their models useless). Even if I want to search for simple things, I would rather have an LLM…
They won't, its literally part of their sales funnel. They've specifically engineered a bad experience for anyone outside the ecosystem by making it all of their friend's problem too. Its very important for their stock…