How many tokens are you getting, roughly?
I found LLMs circa 4 months ago to be decent at textbook-style electronics, but they choke at anything nontrivial. They approach things like someone that knows the undergrad and grad textbooks, but has absolutely zero…
Why does it work for Red Bull?
It worsens the supply crunch, no? A unit you use sparingly vs that memory going into a GPU that serves many more people.
If you need that precision, especially for position and not values, why use floats at all?
Oh hey, that's cheaper than Kimi K3! Amusing to see a SOTA OpenAI model be cheaper than a Chinese open weight model. Fwiw I love K3 and use it as a daily driver. I haven't tried Sol, as I dislike OpenAI.
I made the move some time ago. There are some unpolished parts here and there, but I'm glad I made the move. Somewhat unrelated criticism of Gmail - during the migration, I found out that there is no way to search for…
Awesome. I'd love if Flutter could also finally get Impeller on Web (I'm tracking the GitHub issues, seems like there's progress at least). I personally would like for it to pick up some ideas from Svelte.
In one of their dev surveys, they did float the idea of divesting Flutter.
I wonder how much effect the CPU's register remapping has on these results. Also, they ran it on an ancient CPU, but I'm not sure how much that matters.
I love the hackability of Thinkpads circa that generation.
Very much agreed. Even more basic than that - memory access patterns are important. The amusing thing is that you end up writing GPU-style code even for CPU. For example - instead of an array of objects, using…
What are some good tools for _authoring_ HDR photography? Lightroom still seems to be mostly SDR. The new Resolve will probably have the tooling, but I haven't tried it.
I meant that they're increasingly converging to be Oppo phones (now running the same OS, hardware is a slightly tweaked Oppo phone variant, etc).
I wonder if this tool can help with EMC compliance testing. My TinySA needs an LNA, so I wonder if this has the required noise floor.
The FIRE net worth seems unrealistically low.
Huh. When I rented a Z7 ii about 5 years ago, I found their Android app to be pretty great. (My next big camera is likely to be a Nikon, in part due to the nice app)
I've spent the last several years of building a very, very fancy scale (well, more of an industrial and R&D lab tool that can be used as a scale). The reason is that most people use a dirt cheap HX711 or cheaper. A…
I remember a story on HN from a while back. The idea is that the larger the org, the simpler the message and the tool has to be to reach everyone. The comment author was saying that as a junior, his company implemented…
Not necessarily. I'm a proponent of (admittedly not very popular) methodology of "train, do interpretability analysis, adjust model architecture". It's not more popular for a few reasons: 1) you first need to train a…
Yes it would. Or, rather, labeling (not extra tokens).
Really neat findings. I've personally had a line of thought where you bake in the role into the token. Basically have an embedding (same dim as token dim) for each role, add it to each token. This adds an unambiguous,…
I think this also stems from ML being more like biology or alchemy and less like math or programming (where you can get down to the first principles, abstractions are rock solid, and non-determinism is limited in scope).
Krazam already has a video covering this exact idea.
I'm personally heavily testing LLMs on electrical engineering problems. I'm finding that it's not meaningfully better at figuring out what's up than the other models. To give you an idea - here's a very abridged summary…
How many tokens are you getting, roughly?
I found LLMs circa 4 months ago to be decent at textbook-style electronics, but they choke at anything nontrivial. They approach things like someone that knows the undergrad and grad textbooks, but has absolutely zero…
Why does it work for Red Bull?
It worsens the supply crunch, no? A unit you use sparingly vs that memory going into a GPU that serves many more people.
If you need that precision, especially for position and not values, why use floats at all?
Oh hey, that's cheaper than Kimi K3! Amusing to see a SOTA OpenAI model be cheaper than a Chinese open weight model. Fwiw I love K3 and use it as a daily driver. I haven't tried Sol, as I dislike OpenAI.
I made the move some time ago. There are some unpolished parts here and there, but I'm glad I made the move. Somewhat unrelated criticism of Gmail - during the migration, I found out that there is no way to search for…
Awesome. I'd love if Flutter could also finally get Impeller on Web (I'm tracking the GitHub issues, seems like there's progress at least). I personally would like for it to pick up some ideas from Svelte.
In one of their dev surveys, they did float the idea of divesting Flutter.
I wonder how much effect the CPU's register remapping has on these results. Also, they ran it on an ancient CPU, but I'm not sure how much that matters.
I love the hackability of Thinkpads circa that generation.
Very much agreed. Even more basic than that - memory access patterns are important. The amusing thing is that you end up writing GPU-style code even for CPU. For example - instead of an array of objects, using…
What are some good tools for _authoring_ HDR photography? Lightroom still seems to be mostly SDR. The new Resolve will probably have the tooling, but I haven't tried it.
I meant that they're increasingly converging to be Oppo phones (now running the same OS, hardware is a slightly tweaked Oppo phone variant, etc).
I wonder if this tool can help with EMC compliance testing. My TinySA needs an LNA, so I wonder if this has the required noise floor.
The FIRE net worth seems unrealistically low.
Huh. When I rented a Z7 ii about 5 years ago, I found their Android app to be pretty great. (My next big camera is likely to be a Nikon, in part due to the nice app)
I've spent the last several years of building a very, very fancy scale (well, more of an industrial and R&D lab tool that can be used as a scale). The reason is that most people use a dirt cheap HX711 or cheaper. A…
I remember a story on HN from a while back. The idea is that the larger the org, the simpler the message and the tool has to be to reach everyone. The comment author was saying that as a junior, his company implemented…
Not necessarily. I'm a proponent of (admittedly not very popular) methodology of "train, do interpretability analysis, adjust model architecture". It's not more popular for a few reasons: 1) you first need to train a…
Yes it would. Or, rather, labeling (not extra tokens).
Really neat findings. I've personally had a line of thought where you bake in the role into the token. Basically have an embedding (same dim as token dim) for each role, add it to each token. This adds an unambiguous,…
I think this also stems from ML being more like biology or alchemy and less like math or programming (where you can get down to the first principles, abstractions are rock solid, and non-determinism is limited in scope).
Krazam already has a video covering this exact idea.
I'm personally heavily testing LLMs on electrical engineering problems. I'm finding that it's not meaningfully better at figuring out what's up than the other models. To give you an idea - here's a very abridged summary…