Ads don't necessarily work through the use of "reason". They work because you are infinity percent more likely to buy something you know exists vs something you don't know exists.
Right if it was literally the processing they make the claim about and not the molecular ingredients. Then they basically have a result that points to there being something fundamentally wrong with our model of physics.…
The title of the article is irresponsibly chosen. - My time in the field of psychology has made me think that the use of imprecise language for describing psychology has a large and problematic societal impact ADHD is…
When i look at the things said by LLMs i clearly see stuff that i would call reasoning. Its reasoning does however have certain "bugs" that a humans reasoning would never have. In my mind probably cause the reasoning…
Dont be fooled. Reasoning does not happen in the prediction of the next token, it happens virtually in the text that is created. The next token prediction is just "the hardware" following the underlying rules. Like the…
Clearly.. this is not some new revelation, it has been the default assumption for a very long time, probably over a hundred years. Damage to the hind brain results in behavioural changes that are blatantly different…
Biological minds in biological organisms are self referential in the way that you have a neural network that forms a model of the world. That model then "discovers" that it is "it self a part of the world" so it tries…
It's likely/It could be an effect of more reinforcement learning in training compared to earlier. You need loots of RL to learn to code well.
(1) LLMs collapse and start outputting garbage after a number of tokens if you do not sample and just pick the "best token" each time. This is a consequence of how they are trained.
Presumably it is just that no one has tried to do it all the way yet. But i know there is some experimental work out there. https://x.com/comma_ai/status/1956879764829995394
Interesting topic. That said I don't know how useful this is since LLMs are primarily trained using mode-covering training rather than Mode-seeking(RL) training, which means LLMs can not form (and does not have) the…
Yes there is. The use of Gödel numbers to represent a system that contain itself is infinite regression.
Gödels incompleteness is just an example of the fact that you cant determine the outcome of infinite regression (in the general case). The same as me asking you to give me the last digit of pi. I am a bit annoyed by pop…
I would think coaxial designs suffer as the lower rotor works in more turbulent non laminar air.
That would "using reason in chain of thought".
That would not be intuition that is just randomness. Intuition is not randomness. A jump in intuition comes from automatic processes reorganising the relational structure of conceptual models. There is no reorganisation…
Clearly it impossible to observe brain chemistry by looking at a person. Psychedelics does however have longterm behavioural effects that are statistically significant and to some extent observable. Using a definition…
Clearly LLMs cant do leaps of intuition since their "intuition" is locked after training ends. The only way a LLM can come up with new ideas if the "idea" appeared as a generalisation durring training or if it was…
It certainly looks like a Claude design to some extent; not all they way however.
Nice job, i have also been working on a few JEPA based models during the last few months. Trying to make more efficient LLMs. I feel like you hit the main issues in the use of jepa models (well except collapse but…
Wont this kill the kv cache? Also i am pretty sure neither open ai or anthropic leets you seed the agents own tokens.
Is the thinking even done in real tokens? I thought it was done using the pure residual stream. That is instead of collapsing the residual stream to a token you treat the final layers output as a vector of size d_model…
If you have a number that is 1000^90000000 that number is larger than the number of atoms in the observable universe.
The issue is apparently this commit (someone did a git bisect): https://github.com/RsyncProject/rsync/commit/859d44fa4f14207... Which is a fix to the security issue CVE-2026-29518:…
"A is not B instead A is blah blah" instead of just saying "A" is a very common pattern have seen in Claude. It is strange to read as the topic A has often not been introduced and introducing it by saying what it is not…
Ads don't necessarily work through the use of "reason". They work because you are infinity percent more likely to buy something you know exists vs something you don't know exists.
Right if it was literally the processing they make the claim about and not the molecular ingredients. Then they basically have a result that points to there being something fundamentally wrong with our model of physics.…
The title of the article is irresponsibly chosen. - My time in the field of psychology has made me think that the use of imprecise language for describing psychology has a large and problematic societal impact ADHD is…
When i look at the things said by LLMs i clearly see stuff that i would call reasoning. Its reasoning does however have certain "bugs" that a humans reasoning would never have. In my mind probably cause the reasoning…
Dont be fooled. Reasoning does not happen in the prediction of the next token, it happens virtually in the text that is created. The next token prediction is just "the hardware" following the underlying rules. Like the…
Clearly.. this is not some new revelation, it has been the default assumption for a very long time, probably over a hundred years. Damage to the hind brain results in behavioural changes that are blatantly different…
Biological minds in biological organisms are self referential in the way that you have a neural network that forms a model of the world. That model then "discovers" that it is "it self a part of the world" so it tries…
It's likely/It could be an effect of more reinforcement learning in training compared to earlier. You need loots of RL to learn to code well.
(1) LLMs collapse and start outputting garbage after a number of tokens if you do not sample and just pick the "best token" each time. This is a consequence of how they are trained.
Presumably it is just that no one has tried to do it all the way yet. But i know there is some experimental work out there. https://x.com/comma_ai/status/1956879764829995394
Interesting topic. That said I don't know how useful this is since LLMs are primarily trained using mode-covering training rather than Mode-seeking(RL) training, which means LLMs can not form (and does not have) the…
Yes there is. The use of Gödel numbers to represent a system that contain itself is infinite regression.
Gödels incompleteness is just an example of the fact that you cant determine the outcome of infinite regression (in the general case). The same as me asking you to give me the last digit of pi. I am a bit annoyed by pop…
I would think coaxial designs suffer as the lower rotor works in more turbulent non laminar air.
That would "using reason in chain of thought".
That would not be intuition that is just randomness. Intuition is not randomness. A jump in intuition comes from automatic processes reorganising the relational structure of conceptual models. There is no reorganisation…
Clearly it impossible to observe brain chemistry by looking at a person. Psychedelics does however have longterm behavioural effects that are statistically significant and to some extent observable. Using a definition…
Clearly LLMs cant do leaps of intuition since their "intuition" is locked after training ends. The only way a LLM can come up with new ideas if the "idea" appeared as a generalisation durring training or if it was…
It certainly looks like a Claude design to some extent; not all they way however.
Nice job, i have also been working on a few JEPA based models during the last few months. Trying to make more efficient LLMs. I feel like you hit the main issues in the use of jepa models (well except collapse but…
Wont this kill the kv cache? Also i am pretty sure neither open ai or anthropic leets you seed the agents own tokens.
Is the thinking even done in real tokens? I thought it was done using the pure residual stream. That is instead of collapsing the residual stream to a token you treat the final layers output as a vector of size d_model…
If you have a number that is 1000^90000000 that number is larger than the number of atoms in the observable universe.
The issue is apparently this commit (someone did a git bisect): https://github.com/RsyncProject/rsync/commit/859d44fa4f14207... Which is a fix to the security issue CVE-2026-29518:…
"A is not B instead A is blah blah" instead of just saying "A" is a very common pattern have seen in Claude. It is strange to read as the topic A has often not been introduced and introducing it by saying what it is not…