If you want to do a 1-bit model you have to QAT at pre-training with way more data than chinchilla to compensate for the cliffs (like 50x). Quantization on an existing pre-trained model will almost always collapse at…
We use the ONNX runtime for small models in the browser https://github.com/microsoft/onnxruntime
just switched to doom emacs this month, absolutely loving it tbh
yeah, but I mean even prose specific claude-isms aside; the information itself is a weird patchwork of concepts
I notice a lot of these AI written articles share this pattern where they'll present idea 1, then idea 2, and finally idea 3 which is some amalgamation of idea 1 and 2. Claude especially will present hybrid options and…
Has anyone read this yet? I'm extremely skeptical of any book published after ~2024 just because of how much AI slop is in physical books these days. Looks interesting, but I'd like to see some reviews on the content…
I think a part of this is that people tend to undervalue their own skills and expertise when talking about these anecdotes. A lot of people in the comments do have a software engineering background. People at different…
I don't know if I agree with the premise that having access to AI results in dulling human intellect. I feel like to get to Terry's level you need a combination of passion and aptitude for the subject. People that don't…
The big take away for is the fact that the ONLY reason why chatgpt was able to get to this counterexample was because of the knowledge of the person driving the conversation. I don't think chatgpt could have come to…
Nothing wrong with vibecoding a toy project.
We're building a CAD for drug design, we often have to handle large and highly varied file formats. Protein structures, compounds, python scripts, lab notebook entries, instrumentation data, etc. From a data structure…
Does this provide gitflow to handle conflicts from multiple agents touching the same file system or is it purely for single-branch sequential iterations on the filesystem? I have a use case that could use this if it…
[dead]
People often use "non-deterministic" to imply "unreliable" when that's not always the case. You can have an LLM that's clearly non-deterministic but also reliable for tasks.
Great article, but your site background had me trying to clean my laptop screen thinking I splashed coffee on it.
The hardest part about using agents to code for me has always been working in teams. When you can cut through huge parts of the code with a chainsaw, how do you review multi-thousand line PRs? It's really hard to do…
This is why I built [AI slop tool]. [Self promotion link to my vibe coded startup with no users]
A false dichotomy that segments typical replies into one of two groups. Group 1: A thinly veiled straw man that buckets everyone I disagree with, along with an attempt to appear as if I'm being unbiased Group 2: The…
The problem with models like this is they're built on very little actual training data we can trace back to verifiable protein data. The protein data back, and other sources of training data for stuff like this, has a…
This is awesome! The only limiter here is the resolution, I think this is fantastic for cellular level organelles but it doesn't quite get down to the same resolution something like x-ray diffraction does. There's a…
Honestly, this is a good thing. OpenClaw as a concept was rather silly to run such a heavy model for. If you want something like OpenClaw to work you really need to figure out how to do it with an economical model.
Honestly, it'd be really funny to try and make a CLAUDE.md file for slop maxxing.
I'm not convinced people who are doing real work on production applications with any sizable user base is writing code through only agents. There's no way to get acceptable code from these models without really knowing…
Oh my god, this comment gave me flashbacks to when I was writing android apps in Eclipse + ADT
> We very much still believe this That's good to hear, I might have jumped a little too quickly in my opinion. It's a bit of a Pavlovian response at this point seeing a product I very much love embrace a giant chat…
If you want to do a 1-bit model you have to QAT at pre-training with way more data than chinchilla to compensate for the cliffs (like 50x). Quantization on an existing pre-trained model will almost always collapse at…
We use the ONNX runtime for small models in the browser https://github.com/microsoft/onnxruntime
just switched to doom emacs this month, absolutely loving it tbh
yeah, but I mean even prose specific claude-isms aside; the information itself is a weird patchwork of concepts
I notice a lot of these AI written articles share this pattern where they'll present idea 1, then idea 2, and finally idea 3 which is some amalgamation of idea 1 and 2. Claude especially will present hybrid options and…
Has anyone read this yet? I'm extremely skeptical of any book published after ~2024 just because of how much AI slop is in physical books these days. Looks interesting, but I'd like to see some reviews on the content…
I think a part of this is that people tend to undervalue their own skills and expertise when talking about these anecdotes. A lot of people in the comments do have a software engineering background. People at different…
I don't know if I agree with the premise that having access to AI results in dulling human intellect. I feel like to get to Terry's level you need a combination of passion and aptitude for the subject. People that don't…
The big take away for is the fact that the ONLY reason why chatgpt was able to get to this counterexample was because of the knowledge of the person driving the conversation. I don't think chatgpt could have come to…
Nothing wrong with vibecoding a toy project.
We're building a CAD for drug design, we often have to handle large and highly varied file formats. Protein structures, compounds, python scripts, lab notebook entries, instrumentation data, etc. From a data structure…
Does this provide gitflow to handle conflicts from multiple agents touching the same file system or is it purely for single-branch sequential iterations on the filesystem? I have a use case that could use this if it…
[dead]
People often use "non-deterministic" to imply "unreliable" when that's not always the case. You can have an LLM that's clearly non-deterministic but also reliable for tasks.
Great article, but your site background had me trying to clean my laptop screen thinking I splashed coffee on it.
The hardest part about using agents to code for me has always been working in teams. When you can cut through huge parts of the code with a chainsaw, how do you review multi-thousand line PRs? It's really hard to do…
This is why I built [AI slop tool]. [Self promotion link to my vibe coded startup with no users]
A false dichotomy that segments typical replies into one of two groups. Group 1: A thinly veiled straw man that buckets everyone I disagree with, along with an attempt to appear as if I'm being unbiased Group 2: The…
The problem with models like this is they're built on very little actual training data we can trace back to verifiable protein data. The protein data back, and other sources of training data for stuff like this, has a…
This is awesome! The only limiter here is the resolution, I think this is fantastic for cellular level organelles but it doesn't quite get down to the same resolution something like x-ray diffraction does. There's a…
Honestly, this is a good thing. OpenClaw as a concept was rather silly to run such a heavy model for. If you want something like OpenClaw to work you really need to figure out how to do it with an economical model.
Honestly, it'd be really funny to try and make a CLAUDE.md file for slop maxxing.
I'm not convinced people who are doing real work on production applications with any sizable user base is writing code through only agents. There's no way to get acceptable code from these models without really knowing…
Oh my god, this comment gave me flashbacks to when I was writing android apps in Eclipse + ADT
> We very much still believe this That's good to hear, I might have jumped a little too quickly in my opinion. It's a bit of a Pavlovian response at this point seeing a product I very much love embrace a giant chat…