If it is to be believed—which I wouldn't count on—it sounds like the intention of the prompt was to keep the model focused, but the model's interpretation of it was to keep you focused.
Some guesses: - A lot more direction-dependent. - More maintenance related to keeping the right direction, maintaining more moving parts, etc. - Less convenient form factor, more susceptible to wind, more unsightly. -…
Simply by the fact that you say computer engineering, you already went deeper than 99% of "computer people" in 2010
With a car, when I turn the steering wheel a quarter turn, the car immediately starts to turn at a known rate (I can't quantify it, but my muscle memory knows it). With an LLM, if I ask it to "turn the car", my…
This matches my experience coding, and the expectations I (and many other) have been voicing for years about why AI is still a ways away from solving coding. The hard part of programming isn't pressing the keys to put…
I'm also curious, specifically about the cost of training vs inference, and comparing that to other industries that can have high R&D costs. My instinct says that open weights aren't feasible because of the obvious…
To me, hippopotomonstrosesquippedaliophobia feels less like vocabulary and more like trivia
It's a bad aphorism if you take it literally and don't think about any nuance, but it's the correct priority. In many cases each of the three steps can take longer than the last, and each step is useless if the previous…
I have a similar anxiety about emailing or messaging people directly. If I'm just posting a comment on HN or reddit, there's not much commitment and if someone responds but I don't feel like continuing the thread, it's…
This feels like less of a gamma issue and more of a color space and monitor calibration issue. Possibly affected by the fact that oklab didn't exist when this article was written and the general awareness of color…
As someone with no plans to live or vacation in the caribbean, I'm curious. Is there a specific notable reason, or is it just a combination of littler things (cost, convenience, politics, weather, etc.)?
Part of the premise of the article is blatantly wrong. Distillation prevention was always visible. The only invisible safeguard was against frontier model development like development of training pipelines. This doesn't…
Our logic at the time was that the relatively fixed cost of figuring out the hardware and developing device-specific software was less than the variable cost-per-board delta of like $20.
Huh. I had a work project a decade ago where we were evaluating SBCs as drivers for kiosks. At that time, the prevailing wisdom was that the Pi was specifically not for industry, as its main advantage was the strong…
genius
This misses the point of the discussion. Yes, we can understand what it is like to be a human with echolocation. However, we can't understand what it is like to be a bat.
Anyone not familiar with "JPL" will not be helped by spelling out "Jet Propulsion Laboratory", since it's a misnomer anyways.
TFA addresses this > Now, we all know that it can take a while to find a long sequence of digits in π, so for practical reasons, we should break the files up into smaller chunks that can be more readily found. > In this…
I work on "AI" stuff. Not LLMs, but large neural nets that include transformers and are as big as the smaller LLMs of today. Half the prompts I give fit their category of examples like "building pretraining pipelines,…
In addition to what mbauman said, hair follicles and the hair itself are not single-cell. I can't immediately find the composition and average cell size, but even a long and thick strand of hair is less than 2 orders of…
Some back of the envelope math says this is true. A conservative estimate for the size of an alpha motor neuron axon is 10μm diameter and 1m long, which already puts it over an order of magnitude larger than the…
I'm kinda of surprised that so many here on HN were dismissive/unaware of the capabilities and potential in the DALL-E days and earlier. I feel like this is the sort of forum where most people would be both aware of…
I'd say that broadly speaking, a system understands things when it can interact with them "correctly". I agree a pocket calculator understands math, but I'd say a pocket translator understands grammar, not language as a…
I think most debates about LLMs understanding boil down to different definitions of the word "understand." For example, with the definition of "understand" that I typically use in my daily life, I would argue that in…
The data on the graph is real, but the labels are made up for vibes.
If it is to be believed—which I wouldn't count on—it sounds like the intention of the prompt was to keep the model focused, but the model's interpretation of it was to keep you focused.
Some guesses: - A lot more direction-dependent. - More maintenance related to keeping the right direction, maintaining more moving parts, etc. - Less convenient form factor, more susceptible to wind, more unsightly. -…
Simply by the fact that you say computer engineering, you already went deeper than 99% of "computer people" in 2010
With a car, when I turn the steering wheel a quarter turn, the car immediately starts to turn at a known rate (I can't quantify it, but my muscle memory knows it). With an LLM, if I ask it to "turn the car", my…
This matches my experience coding, and the expectations I (and many other) have been voicing for years about why AI is still a ways away from solving coding. The hard part of programming isn't pressing the keys to put…
I'm also curious, specifically about the cost of training vs inference, and comparing that to other industries that can have high R&D costs. My instinct says that open weights aren't feasible because of the obvious…
To me, hippopotomonstrosesquippedaliophobia feels less like vocabulary and more like trivia
It's a bad aphorism if you take it literally and don't think about any nuance, but it's the correct priority. In many cases each of the three steps can take longer than the last, and each step is useless if the previous…
I have a similar anxiety about emailing or messaging people directly. If I'm just posting a comment on HN or reddit, there's not much commitment and if someone responds but I don't feel like continuing the thread, it's…
This feels like less of a gamma issue and more of a color space and monitor calibration issue. Possibly affected by the fact that oklab didn't exist when this article was written and the general awareness of color…
As someone with no plans to live or vacation in the caribbean, I'm curious. Is there a specific notable reason, or is it just a combination of littler things (cost, convenience, politics, weather, etc.)?
Part of the premise of the article is blatantly wrong. Distillation prevention was always visible. The only invisible safeguard was against frontier model development like development of training pipelines. This doesn't…
Our logic at the time was that the relatively fixed cost of figuring out the hardware and developing device-specific software was less than the variable cost-per-board delta of like $20.
Huh. I had a work project a decade ago where we were evaluating SBCs as drivers for kiosks. At that time, the prevailing wisdom was that the Pi was specifically not for industry, as its main advantage was the strong…
genius
This misses the point of the discussion. Yes, we can understand what it is like to be a human with echolocation. However, we can't understand what it is like to be a bat.
Anyone not familiar with "JPL" will not be helped by spelling out "Jet Propulsion Laboratory", since it's a misnomer anyways.
TFA addresses this > Now, we all know that it can take a while to find a long sequence of digits in π, so for practical reasons, we should break the files up into smaller chunks that can be more readily found. > In this…
I work on "AI" stuff. Not LLMs, but large neural nets that include transformers and are as big as the smaller LLMs of today. Half the prompts I give fit their category of examples like "building pretraining pipelines,…
In addition to what mbauman said, hair follicles and the hair itself are not single-cell. I can't immediately find the composition and average cell size, but even a long and thick strand of hair is less than 2 orders of…
Some back of the envelope math says this is true. A conservative estimate for the size of an alpha motor neuron axon is 10μm diameter and 1m long, which already puts it over an order of magnitude larger than the…
I'm kinda of surprised that so many here on HN were dismissive/unaware of the capabilities and potential in the DALL-E days and earlier. I feel like this is the sort of forum where most people would be both aware of…
I'd say that broadly speaking, a system understands things when it can interact with them "correctly". I agree a pocket calculator understands math, but I'd say a pocket translator understands grammar, not language as a…
I think most debates about LLMs understanding boil down to different definitions of the word "understand." For example, with the definition of "understand" that I typically use in my daily life, I would argue that in…
The data on the graph is real, but the labels are made up for vibes.