Is it really a VM? I thought CC’s sandbox was based on bubblewrap/seatbelt which don’t use hardware virtualization and share the host OS kernel?
It feels like a weird tension: we worry about AI alignment but also want everyone to have unrestricted local AI hardware. Local compute means no guardrails, fine-tune for whatever you want. Maybe the market pricing…
I actually find that nixpkgs being a monorepo makes it even better. The code is surprisingly easy to navigate and learn if you've worked in large codebases before. The scaling issues are good problems to have, and git…
Not yet! But I will make sure to link here once it's up in a few days (or post to HN? not sure what the etiquette around self-promotion is these days). It's somewhat functional but not usable by anyone other than me at…
Out of curiosity, what would be an ideal UX for you? I'm working on a Rust library for this exact problem (CLI and language bindings should be easy to add). It uses KVM directly on Linux and Virtualization.framework on…
RAM requirements stay the same. You need all 358B parameters loaded in memory, as which experts activate depends on each token dynamically. The benefit is compute: only ~32B params participate per forward pass, so you…
yes, completely agree. having some sort of guardrails for the LLM is extremely important. in the earlier models I would sometimes write tests for checking that my coding patterns were being followed correctly. basic…
I wonder if LLMs can help here to some extent. I agree with others that cooldowns aren't helpful if everyone is doing it. I've been working on automatic updates for some of my [very overengineered] homelab infra and one…
this looks really polished, congrats! in your opinion, how does it compare with alternatives like actualbudget [0]? I've been using Quicken for a long time and might be in the market for a subscription-less alternative…
I've been working on something similar, a typed shell scripting language called shady (hehe). haven't shared it because like 99% of the code was written by claude and I'm definitely not a programming language expert.…
What do you consider "General Intelligence" to be?
Personally, I think this might be an even better approach. The Nest Gen1/2 UI was pretty slick. It would be a shame to have to use a custom firmware.
Oh. Woooosh. Thanks for still being nice about it (-:
Even if consequences for humans are minimal, shouldn't we hold autonomous vehicles to a higher standard?
I think specialized hardware will emerge for specific proven workloads (transformer inference, for example), but GPUs won't become obsolete. They'll remain the experimentation platform for new architectures. You need…
Keyboards were replaced with a touch screen alternative that effectively does the same job though. What is the alternative to a camera? Cameras are way too useful on a mobile device for anyone to even consider dropping…
That's excellent. Somewhat similar to the syntax I went with, but most likely much better implemented. I'm going to give it a go. Thank you!
This is awesome. Thank you for sharing. I have been working on a small interpreted language for shell scripts with lots of help from Claude Code. The main idea is to automatically generate the cli interface for the…
Yeah, from discussing this with friends in academia it seems like this is the biggest hurdle at the moment. Someone on Reddit reached out to arXiv [0] and their response was very negative towards it, which seems…
Hey! I wrote mariner :) There's been people in the community that got the Sonic Mini 4K working. mariner is obviously not as fancy and sophisticated as OctoPrint, but I'm happy to take pull requests and improve it.…
Is it really a VM? I thought CC’s sandbox was based on bubblewrap/seatbelt which don’t use hardware virtualization and share the host OS kernel?
It feels like a weird tension: we worry about AI alignment but also want everyone to have unrestricted local AI hardware. Local compute means no guardrails, fine-tune for whatever you want. Maybe the market pricing…
I actually find that nixpkgs being a monorepo makes it even better. The code is surprisingly easy to navigate and learn if you've worked in large codebases before. The scaling issues are good problems to have, and git…
Not yet! But I will make sure to link here once it's up in a few days (or post to HN? not sure what the etiquette around self-promotion is these days). It's somewhat functional but not usable by anyone other than me at…
Out of curiosity, what would be an ideal UX for you? I'm working on a Rust library for this exact problem (CLI and language bindings should be easy to add). It uses KVM directly on Linux and Virtualization.framework on…
RAM requirements stay the same. You need all 358B parameters loaded in memory, as which experts activate depends on each token dynamically. The benefit is compute: only ~32B params participate per forward pass, so you…
yes, completely agree. having some sort of guardrails for the LLM is extremely important. in the earlier models I would sometimes write tests for checking that my coding patterns were being followed correctly. basic…
I wonder if LLMs can help here to some extent. I agree with others that cooldowns aren't helpful if everyone is doing it. I've been working on automatic updates for some of my [very overengineered] homelab infra and one…
this looks really polished, congrats! in your opinion, how does it compare with alternatives like actualbudget [0]? I've been using Quicken for a long time and might be in the market for a subscription-less alternative…
I've been working on something similar, a typed shell scripting language called shady (hehe). haven't shared it because like 99% of the code was written by claude and I'm definitely not a programming language expert.…
What do you consider "General Intelligence" to be?
Personally, I think this might be an even better approach. The Nest Gen1/2 UI was pretty slick. It would be a shame to have to use a custom firmware.
Oh. Woooosh. Thanks for still being nice about it (-:
Even if consequences for humans are minimal, shouldn't we hold autonomous vehicles to a higher standard?
I think specialized hardware will emerge for specific proven workloads (transformer inference, for example), but GPUs won't become obsolete. They'll remain the experimentation platform for new architectures. You need…
Keyboards were replaced with a touch screen alternative that effectively does the same job though. What is the alternative to a camera? Cameras are way too useful on a mobile device for anyone to even consider dropping…
That's excellent. Somewhat similar to the syntax I went with, but most likely much better implemented. I'm going to give it a go. Thank you!
This is awesome. Thank you for sharing. I have been working on a small interpreted language for shell scripts with lots of help from Claude Code. The main idea is to automatically generate the cli interface for the…
Yeah, from discussing this with friends in academia it seems like this is the biggest hurdle at the moment. Someone on Reddit reached out to arXiv [0] and their response was very negative towards it, which seems…
Hey! I wrote mariner :) There's been people in the community that got the Sonic Mini 4K working. mariner is obviously not as fancy and sophisticated as OctoPrint, but I'm happy to take pull requests and improve it.…