I don’t understand what “floating-point math is non-associative” has to do with the random selection of possible result token set after the soft max operation. The weights of the model are set and don’t change during…
Honest question about the non-deterministic nature of llms. Every programming language provides some way to control the random seed. Is this not true in GPU programming land?
Of course it’s never mentioned that all these hacking techniques are in the training set…
Would you also consider a database of questions and answers smart? LLM are basically lossy text compression databases with a clever query method. Useful for sure but it’s not thinking, it’s recall. Just look at some…
And yet two orders of magnitude from making a profit…
I've been pretty happy with LLM svg based data plots I've asked, including log scaled axises and histograms. Definitely a first world problem of course.
The construction of data centers brings jobs, most of the running of data centers is done remotely. There are more security guards than on site tech workers. Just look at the size of the parking lots. In Ashburn Va, a…
I suspect they knew if oil can’t move out of the gulf, then US oil will gladly step in. Republicans have always had to be Oil company supported. Just look at the number of oil tankers leaving the Gulf of Mexico:…
Then it would be fair game to have an AI answer the hiring AI questions. After all, they now require the use of AI on the job right?
I asked it to write a python program to find the intersection of a line and a circle and it one shot it. Asking for a Swift version worked as well. Rust version goofed with lines of comments and code intertwined. I…
I’m old enough to remember when one checked the assembly a compiler generated because early on they produced terrible assembly. Eventually they got good enough to not needing to check. Coding agents are not close to…
What I found interesting is nanoclaw isn’t a working product out of the box. You must use a coding agent to complete it with features you want. For example add iMessage support, etc. In other words, Claude is the…
What’s interesting is Anthropic being singled out here. That either means: 1- OpenAI, Microsoft, Google, Amazon, etc have no problem with their products being used to kill people so no need to bully them. 2- These other…
I read his book “A new kind of science” and quickly figured out why it was self-published. My goodness it’s bad and need of an editor. A big disappointment as I’m a fan of his technical work.
Last night, I was able to modify nanoclaw, which runs in a container, to use iMessage(instead of whatsapp ) and use GPT-OSS-120B(instead of Claude) hosted on a Nvidia spark running llama.cpp. It works but a bit slow…
Definitely helped that I just missed the punch card era. I know young me would have dropped my stack of cards many times…
Young me remembers fondly poking and peeking system memory locations to see what happens. The manual, if I remember right, had a table of memory locations to system settings. Things like font and background colors. I…
And yet Tesla won’t take responsibility for FSD mistakes. I had one and it’s amazing when it works but it did try to kill me a number of times.
I’ve been doing the same with GPT-OSS-120B and have been impressed. Only gotcha is Claude code expects a 200k context window while that model max supports 130k or so. I have to do a /compress when it gets close. I’ll…
The M-series unified memory is built into the chip itself, not separate components. Of course Apple is going to maintain their margins, but it’s easy to see why with this design more memory is more expensive than drams.…
At least perform a tiny bit of research before you parrot VC talking points on a VC controlled message board. Yes data centers use a shit ton of water daily https://www.eesi.org/articles/view/data-centers-and-water-co...
I agree that’s Zed is very nice but a ticking enshitiation time bomb. However, you do see how this autocomplete “feature” and its whole copilot everywhere strategy, is about M$’s roi of its ai investment right? So if…
Not sure I understand, Mac OS is BSD based. https://en.wikipedia.org/wiki/Darwin_(operating_system)
You could say the same thing about all Microsoft products then. How many full time developers does it take to support Windows 11 when Linux is available, SqlServer when Postgres is available, Office when LibreOffice…
..this is the saddest thing I’ve read in a while if true. Whiteboard sessions with coworkers designing architectures and playing out/bouncing ideas is one of my favorite things to do at work. Just don’t invite the folks…
I don’t understand what “floating-point math is non-associative” has to do with the random selection of possible result token set after the soft max operation. The weights of the model are set and don’t change during…
Honest question about the non-deterministic nature of llms. Every programming language provides some way to control the random seed. Is this not true in GPU programming land?
Of course it’s never mentioned that all these hacking techniques are in the training set…
Would you also consider a database of questions and answers smart? LLM are basically lossy text compression databases with a clever query method. Useful for sure but it’s not thinking, it’s recall. Just look at some…
And yet two orders of magnitude from making a profit…
I've been pretty happy with LLM svg based data plots I've asked, including log scaled axises and histograms. Definitely a first world problem of course.
The construction of data centers brings jobs, most of the running of data centers is done remotely. There are more security guards than on site tech workers. Just look at the size of the parking lots. In Ashburn Va, a…
I suspect they knew if oil can’t move out of the gulf, then US oil will gladly step in. Republicans have always had to be Oil company supported. Just look at the number of oil tankers leaving the Gulf of Mexico:…
Then it would be fair game to have an AI answer the hiring AI questions. After all, they now require the use of AI on the job right?
I asked it to write a python program to find the intersection of a line and a circle and it one shot it. Asking for a Swift version worked as well. Rust version goofed with lines of comments and code intertwined. I…
I’m old enough to remember when one checked the assembly a compiler generated because early on they produced terrible assembly. Eventually they got good enough to not needing to check. Coding agents are not close to…
What I found interesting is nanoclaw isn’t a working product out of the box. You must use a coding agent to complete it with features you want. For example add iMessage support, etc. In other words, Claude is the…
What’s interesting is Anthropic being singled out here. That either means: 1- OpenAI, Microsoft, Google, Amazon, etc have no problem with their products being used to kill people so no need to bully them. 2- These other…
I read his book “A new kind of science” and quickly figured out why it was self-published. My goodness it’s bad and need of an editor. A big disappointment as I’m a fan of his technical work.
Last night, I was able to modify nanoclaw, which runs in a container, to use iMessage(instead of whatsapp ) and use GPT-OSS-120B(instead of Claude) hosted on a Nvidia spark running llama.cpp. It works but a bit slow…
Definitely helped that I just missed the punch card era. I know young me would have dropped my stack of cards many times…
Young me remembers fondly poking and peeking system memory locations to see what happens. The manual, if I remember right, had a table of memory locations to system settings. Things like font and background colors. I…
And yet Tesla won’t take responsibility for FSD mistakes. I had one and it’s amazing when it works but it did try to kill me a number of times.
I’ve been doing the same with GPT-OSS-120B and have been impressed. Only gotcha is Claude code expects a 200k context window while that model max supports 130k or so. I have to do a /compress when it gets close. I’ll…
The M-series unified memory is built into the chip itself, not separate components. Of course Apple is going to maintain their margins, but it’s easy to see why with this design more memory is more expensive than drams.…
At least perform a tiny bit of research before you parrot VC talking points on a VC controlled message board. Yes data centers use a shit ton of water daily https://www.eesi.org/articles/view/data-centers-and-water-co...
I agree that’s Zed is very nice but a ticking enshitiation time bomb. However, you do see how this autocomplete “feature” and its whole copilot everywhere strategy, is about M$’s roi of its ai investment right? So if…
Not sure I understand, Mac OS is BSD based. https://en.wikipedia.org/wiki/Darwin_(operating_system)
You could say the same thing about all Microsoft products then. How many full time developers does it take to support Windows 11 when Linux is available, SqlServer when Postgres is available, Office when LibreOffice…
..this is the saddest thing I’ve read in a while if true. Whiteboard sessions with coworkers designing architectures and playing out/bouncing ideas is one of my favorite things to do at work. Just don’t invite the folks…