In Bazzite I've had innumerable issues with waking from sleep and display driver crashes, which means a 50 ft walk to press the reset button. If you're cool with that, this appliance isn't for you.
I bought an irresponsible pile of homelab equipment in 24/25. Hard drives, SSD, memory, GPUs. I feel bad for people locked out right now, since it's become more interesting and important than ever. At the time it seemed…
To go further down this pipe dream - Anthropic / OpenAI would buy them all and still price out the consumer. There's no end-run in this scenario.
I can actually use and enjoy Linux. The "year of the desktop" never came for me, but instead I got the "year of the cli". For 20 years I've used Linux in one form or another, but I've felt like I was kneecapped for the…
It's fine for dense models where you need them in VRAM, less so for MoE where you're offloading layers to ram. But 32/32 is pretty good for both in the popular ~30b range right now.
- You can send any amount of money to anyone in the world very quickly and cheaply, and nobody can stop you. - No government can dilute it or limit its supply. Stuff like that. Maybe that matters to you, maybe not, but…
Thank you for the thoughtful reply. I have some smaller 3080's I'm looking to place and this sounds like a good opportunity.
The memory upgrade is $1k on a Macbook Pro. The laptop is ~$5500.
Expect to pay $4k-10k - Your RTX 6000 is closer to $10k now - Sparks are creeping into the $4-5k range - AMD Strix are ~3.5k - Apple depends on chipset and memory. Sweet spot would be 128gb M3 Ultra, probably $6-8k but…
Why this entire tool chain instead of building within something like pi code? I've been exploring this area and a project like https://github.com/itayinbarr/little-coder (not my work) lets me mix and match with my…
It's older, but Hermes Pro 2 (same lab as Hermes agent) is a fine-tune of Mistral 7b for tool calling and structured outputs. This isn't for agentic loops, though. This is for turning simple requests into API calls.
Similarly, the agentic coding success stories are from orgs that had all of these things out of the gate.
It reads like the inventors of Claude can't get Claude to apply a "human in the loop" workflow.
You can fine-tune a model, but there are also smaller models fine-tuned for specific work like structured output and tool calling. You can build automated workflows that are largely deterministic and only slot in these…
Rather, Imagine you have 2-3 of these working 24/7 on top of what you're doing today. What does your backlog look like a month from now?
You're right for the same reason that the original iPhone outranks the iPhone 3Gs.
OpenClaw had a huge viral marketing campaign. It wasn't a coincidence everyone on twitter was talking about it at the same time suddenly. To its credit, it also executed well enough in a few areas that captured people's…
What kind of small tasks do you find it's good at? My non-coding use of agents has been related to server admin, and my local-llm use-case is for 24/7 tasks that would be cost-prohibitive. So my best guess for this…
Maybe for a coding agent, but a daily/weekly report on sensitive info? If it were 2016 and this technology existed but only in 1 t/s, every company would find a way to extract the most leverage out of it.
And here's the blog article describing the widget: https://maurycyz.com/misc/ads/
Remember when Netflix almost split its brand with "Quickster"? It was the dying DVD by mail service, but the whole debacle did nothing but confuse people.
The new Alexa uses Claude under the hood, and it also misinterprets my intent, only with a 2 second longer delay and slightly more approachable tone.
Everyone has their own hill to die on, that's the thing about personal computing. It's the same if you ask why they can't switch mobile OS. It's some seemingly trivial app or feature that almost nobody cares about.
They support their phones for years longer than any vendor. This has been widely understood for probably 10+ years at this point. There's plenty of room for criticism without a blanket conspiracy that doesn't match what…
I was really looking for tangible, actionable advice since I'm facing slow adoption in my org. This post seems to hide behind the "secret sauce" that it claims made all of the difference.
In Bazzite I've had innumerable issues with waking from sleep and display driver crashes, which means a 50 ft walk to press the reset button. If you're cool with that, this appliance isn't for you.
I bought an irresponsible pile of homelab equipment in 24/25. Hard drives, SSD, memory, GPUs. I feel bad for people locked out right now, since it's become more interesting and important than ever. At the time it seemed…
To go further down this pipe dream - Anthropic / OpenAI would buy them all and still price out the consumer. There's no end-run in this scenario.
I can actually use and enjoy Linux. The "year of the desktop" never came for me, but instead I got the "year of the cli". For 20 years I've used Linux in one form or another, but I've felt like I was kneecapped for the…
It's fine for dense models where you need them in VRAM, less so for MoE where you're offloading layers to ram. But 32/32 is pretty good for both in the popular ~30b range right now.
- You can send any amount of money to anyone in the world very quickly and cheaply, and nobody can stop you. - No government can dilute it or limit its supply. Stuff like that. Maybe that matters to you, maybe not, but…
Thank you for the thoughtful reply. I have some smaller 3080's I'm looking to place and this sounds like a good opportunity.
The memory upgrade is $1k on a Macbook Pro. The laptop is ~$5500.
Expect to pay $4k-10k - Your RTX 6000 is closer to $10k now - Sparks are creeping into the $4-5k range - AMD Strix are ~3.5k - Apple depends on chipset and memory. Sweet spot would be 128gb M3 Ultra, probably $6-8k but…
Why this entire tool chain instead of building within something like pi code? I've been exploring this area and a project like https://github.com/itayinbarr/little-coder (not my work) lets me mix and match with my…
It's older, but Hermes Pro 2 (same lab as Hermes agent) is a fine-tune of Mistral 7b for tool calling and structured outputs. This isn't for agentic loops, though. This is for turning simple requests into API calls.
Similarly, the agentic coding success stories are from orgs that had all of these things out of the gate.
It reads like the inventors of Claude can't get Claude to apply a "human in the loop" workflow.
You can fine-tune a model, but there are also smaller models fine-tuned for specific work like structured output and tool calling. You can build automated workflows that are largely deterministic and only slot in these…
Rather, Imagine you have 2-3 of these working 24/7 on top of what you're doing today. What does your backlog look like a month from now?
You're right for the same reason that the original iPhone outranks the iPhone 3Gs.
OpenClaw had a huge viral marketing campaign. It wasn't a coincidence everyone on twitter was talking about it at the same time suddenly. To its credit, it also executed well enough in a few areas that captured people's…
What kind of small tasks do you find it's good at? My non-coding use of agents has been related to server admin, and my local-llm use-case is for 24/7 tasks that would be cost-prohibitive. So my best guess for this…
Maybe for a coding agent, but a daily/weekly report on sensitive info? If it were 2016 and this technology existed but only in 1 t/s, every company would find a way to extract the most leverage out of it.
And here's the blog article describing the widget: https://maurycyz.com/misc/ads/
Remember when Netflix almost split its brand with "Quickster"? It was the dying DVD by mail service, but the whole debacle did nothing but confuse people.
The new Alexa uses Claude under the hood, and it also misinterprets my intent, only with a 2 second longer delay and slightly more approachable tone.
Everyone has their own hill to die on, that's the thing about personal computing. It's the same if you ask why they can't switch mobile OS. It's some seemingly trivial app or feature that almost nobody cares about.
They support their phones for years longer than any vendor. This has been widely understood for probably 10+ years at this point. There's plenty of room for criticism without a blanket conspiracy that doesn't match what…
I was really looking for tangible, actionable advice since I'm facing slow adoption in my org. This post seems to hide behind the "secret sauce" that it claims made all of the difference.