https://en.wikipedia.org/wiki/Liquid_droplet_radiator
> LLMs cannot offer that promise by design, so it remains your job to find and fix any deviations from the abstraction you intended. LLMs are clumsy interns now, very leaky. But we know human experts can be leak-proof.…
As IMO medalists they would be expected to I'm sure. But this can be verified because the results are public: https://github.com/aw31/openai-imo-2025-proofs/
Yes, OpenAI: https://x.com/alexwei_/status/1946477754372985146 > 6/N In our evaluation, the model solved 5 of the 6 problems on the 2025 IMO. For each problem, three former IMO medalists independently graded the model’s…
Thank you, amazing, fresh.
The goal here is not to replace transformers but combine them with RNN so you get both good short-term memory (self-attention) and much improved long-term memory (ATLAS recurrent memory). "Empirically, our…
100% agreed with your experience, AI provides little value to one's area of expertise (10+ years or more). It's the context length -- AI needs comparable training or inference-time cycles. But just wait for the next…
> To understand the capabilities of LLMs, we evaluate GPT3 (text-davinci-003) [11], ChatGPT (GPT-3.5-turbo) [57] and GPT4 (gpt-4) Oh dear, this is embarrassing. Anil Anathaswamy, are you aware a year in AI research now…
Well the Franks study probably destroyed any chance for natural sleep conditions. Nedergaard is scathing: https://www.thetransmitter.org/glymphatic-system/new-method-... > The new paper used many of the techniques…
Seems to me o3 prices would be what the consumer pays, not what OpenAI pays. That would mean o3 could be more efficient in-house than paying subject-matter experts.
I always get the feeling he's subconsciously inserting a "magical" step here with reference to "synthesis"-- invoking a kind of subtle dualism where human intelligence is just different and mysteriously better than…
> One random example to illustrate the distinction: training gaps can easily decrease uncertainty. You have lots of mammals in your training data, and none of them lay eggs. You ask "The duck-billed platypus is my…
> ...proving that this one particular piece of the hallucination problem may be conceptually simple. Everything mentioned in the article boils down to that one particular piece-- non-detected uncertainty. The…
The article referenced the Oxford semantic entropy study but failed to clarify that the issue greatly simplifies LLM hallucination (making most of the article outdated). When we are not sure of an answer we have two…
"Why PCIe Risers suck and the importance of using SAS Device Adapters, Redrivers, and Retimers for error-free PCIe connections." I'm a believer! Can't wait to hear more about this.
Sure looks like a typo. Contact author? https://x.com/fchollet https://x.com/arcprize https://x.com/mikeknoop
https://mathshistory.st-andrews.ac.uk/HistTopics/Bakhshali_m... has some examples. |One person possesses seven asava horses, another nine haya horses, and another ten camels. Each gives two animals, one to each of the…
So this is old news?
All cynicism aside, there's vastly more in the collective writings of humans on empathy than medicine.
From the article: "April 3, 2023 - Real Humans Can’t Tell the Difference Between a 13B Open Model and ChatGPT Berkeley launches Koala, a dialogue model trained entirely using freely available data. They take the crucial…
Ah, that's it; polite fictions are scored higher than uncomfortable facts.
That's weird. Having the community study this would certainly help them. They're afraid this is giving too much insight into their proprietary training/modeling methods?
That should be okay though, 10 good answers will still report the score of the best one chosen. I think the GPTs are using beam search which is projecting out a "beam" (looks more like a tree to me) of probable answers…
> A probable guess will lower loss much better than "I don't know" or whatever equivalent. Guessing only reduces loss as much as the dataset allows -- a bad guess will give a higher loss. The model learns to assign…
Earth's crust: not quite the same as Cu/Zn but way more than I expected: https://periodictable.com/Properties/A/CrustAbundance.an.htm... Lithium: 0.0017% Copper: 0.0068% Zinc: 0.0078% Seawater:…
https://en.wikipedia.org/wiki/Liquid_droplet_radiator
> LLMs cannot offer that promise by design, so it remains your job to find and fix any deviations from the abstraction you intended. LLMs are clumsy interns now, very leaky. But we know human experts can be leak-proof.…
As IMO medalists they would be expected to I'm sure. But this can be verified because the results are public: https://github.com/aw31/openai-imo-2025-proofs/
Yes, OpenAI: https://x.com/alexwei_/status/1946477754372985146 > 6/N In our evaluation, the model solved 5 of the 6 problems on the 2025 IMO. For each problem, three former IMO medalists independently graded the model’s…
Thank you, amazing, fresh.
The goal here is not to replace transformers but combine them with RNN so you get both good short-term memory (self-attention) and much improved long-term memory (ATLAS recurrent memory). "Empirically, our…
100% agreed with your experience, AI provides little value to one's area of expertise (10+ years or more). It's the context length -- AI needs comparable training or inference-time cycles. But just wait for the next…
> To understand the capabilities of LLMs, we evaluate GPT3 (text-davinci-003) [11], ChatGPT (GPT-3.5-turbo) [57] and GPT4 (gpt-4) Oh dear, this is embarrassing. Anil Anathaswamy, are you aware a year in AI research now…
Well the Franks study probably destroyed any chance for natural sleep conditions. Nedergaard is scathing: https://www.thetransmitter.org/glymphatic-system/new-method-... > The new paper used many of the techniques…
Seems to me o3 prices would be what the consumer pays, not what OpenAI pays. That would mean o3 could be more efficient in-house than paying subject-matter experts.
I always get the feeling he's subconsciously inserting a "magical" step here with reference to "synthesis"-- invoking a kind of subtle dualism where human intelligence is just different and mysteriously better than…
> One random example to illustrate the distinction: training gaps can easily decrease uncertainty. You have lots of mammals in your training data, and none of them lay eggs. You ask "The duck-billed platypus is my…
> ...proving that this one particular piece of the hallucination problem may be conceptually simple. Everything mentioned in the article boils down to that one particular piece-- non-detected uncertainty. The…
The article referenced the Oxford semantic entropy study but failed to clarify that the issue greatly simplifies LLM hallucination (making most of the article outdated). When we are not sure of an answer we have two…
"Why PCIe Risers suck and the importance of using SAS Device Adapters, Redrivers, and Retimers for error-free PCIe connections." I'm a believer! Can't wait to hear more about this.
Sure looks like a typo. Contact author? https://x.com/fchollet https://x.com/arcprize https://x.com/mikeknoop
https://mathshistory.st-andrews.ac.uk/HistTopics/Bakhshali_m... has some examples. |One person possesses seven asava horses, another nine haya horses, and another ten camels. Each gives two animals, one to each of the…
So this is old news?
All cynicism aside, there's vastly more in the collective writings of humans on empathy than medicine.
From the article: "April 3, 2023 - Real Humans Can’t Tell the Difference Between a 13B Open Model and ChatGPT Berkeley launches Koala, a dialogue model trained entirely using freely available data. They take the crucial…
Ah, that's it; polite fictions are scored higher than uncomfortable facts.
That's weird. Having the community study this would certainly help them. They're afraid this is giving too much insight into their proprietary training/modeling methods?
That should be okay though, 10 good answers will still report the score of the best one chosen. I think the GPTs are using beam search which is projecting out a "beam" (looks more like a tree to me) of probable answers…
> A probable guess will lower loss much better than "I don't know" or whatever equivalent. Guessing only reduces loss as much as the dataset allows -- a bad guess will give a higher loss. The model learns to assign…
Earth's crust: not quite the same as Cu/Zn but way more than I expected: https://periodictable.com/Properties/A/CrustAbundance.an.htm... Lithium: 0.0017% Copper: 0.0068% Zinc: 0.0078% Seawater:…