The number of people who think the emergence thing is settled smh... It's been a thing for at least 30yr, answering it one way or the other would be a big deal. It does nobody any favors having these infinitely…
It's not a subtle pattern.
> ok engagement That is such a miserably low bar
Writing is thinking. If you don't spend time writing, then you didn't spend time thinking. LLMs don't think. Consequently, if you outsourced your writing to an LLM the resulting artifact was born of a thoughtless…
“Keeping an open mind is a virtue—but, as the space engineer James Oberg once said, not so open that your brains fall out.” ― Carl Sagan, The Demon-Haunted World: Science as a Candle in the Dark
+1 I can't imagine how any corporate entity could be credible in this financial environment. Nothing they say can be reliably considered as anything but marketing copy. This situation is exactly what academic publishing…
broken link maybe?
0. Pour money on the fire 1. AI somehow becomes AGI because money implies "emergence" I guess? 2. Profit somehow?
Yeah I've stepped on that face rake a few times. I still think it's a decent heuristic, don't see any reason to change.
> I'm sure it's my fault, somehow - but I'm a damn good writer; I just don't know how to communicate with people who won't put forth the effort to engage with detail. I used to put effort into those people. It was a…
Another axis would be power consumption. Pretty sure if you want LLM training in 1980 you'd also need fusion power in 1980. And it would be very, very hard to hide the cooling apparatus of your datacenter.
> I think you've already conceded that LLMs demonstrate emergent behaviour No. Please don't put words in my mouth. What I said is that an LLM compresses a bunch of information into a semantic embedding space and then…
I'm not following the "Fable" stuff, what is that? [edit: ah it's a new language model from Anthropic.. yeah still don't see how it's relevant here]
To say that LLMs' existence is evidence for emergent phenomena in LLMs is tautological. I'm merely suggesting if you want to make a claim about emergence it would be best, especially in absence of a convincing theory,…
> there seems to be some emergent behaviour that is not simply just next-token-prediction, or that the ability to do accurate next-token-prediction requires something "extra" that LLMs have. The next step then would be…
To quote the great Dr. Malcolm: > Life, uh, finds a way.
I think we must be talking past eachother. I define stochastic search as a search process with randomness injected into it that can return the following things: - Something contained in the data set, not necessarily the…
> Imagining something in advance is not necessary at all for scientific advancement. This is particularily true in AI, and no one expects to imagine what superintelligence is until after it is created. Then why does…
> But what matters is the result- this machine, matrix multiplier, stochastic parrot, consistently displays intelligence, to the point of being able to perform very complex, open-ended tasks that integrate discovery,…
Yes I think the drug discovery analogy is apt. I've spent a bunch of time playing with evolutionary algorithms, they're great fun. And when they work they can do surprising things! I wouldn't bet on evolving an…
> Is an implication of this that models are incapable of producing entirely novel code? No, it does not imply that at all. Google "temperature in LLMs". > what do you posit is special about what is happening when humans…
Fair enough, I should have phrased that less strongly. Until you show that your neural net does "thinking" or "reasoning" I'll disregard that and prefer to think about it in terms of what we actually know neural nets…
> Where do you think intelligence comes from, some mysterious realm? It's physical, computational. Well, no. I don't think it comes from some mysterious realm. I think that which is not physical does not exist [edit:…
I'm not claiming there's something "extra" happening in brains. Merely that we just don't know how they work well enough to use that knowledge to do engineering. Neural nets are quite unlike brains, despite the…
I'd call it what it is: a good enough stochastic search result extracted from the model's embedding space.
The number of people who think the emergence thing is settled smh... It's been a thing for at least 30yr, answering it one way or the other would be a big deal. It does nobody any favors having these infinitely…
It's not a subtle pattern.
> ok engagement That is such a miserably low bar
Writing is thinking. If you don't spend time writing, then you didn't spend time thinking. LLMs don't think. Consequently, if you outsourced your writing to an LLM the resulting artifact was born of a thoughtless…
“Keeping an open mind is a virtue—but, as the space engineer James Oberg once said, not so open that your brains fall out.” ― Carl Sagan, The Demon-Haunted World: Science as a Candle in the Dark
+1 I can't imagine how any corporate entity could be credible in this financial environment. Nothing they say can be reliably considered as anything but marketing copy. This situation is exactly what academic publishing…
broken link maybe?
0. Pour money on the fire 1. AI somehow becomes AGI because money implies "emergence" I guess? 2. Profit somehow?
Yeah I've stepped on that face rake a few times. I still think it's a decent heuristic, don't see any reason to change.
> I'm sure it's my fault, somehow - but I'm a damn good writer; I just don't know how to communicate with people who won't put forth the effort to engage with detail. I used to put effort into those people. It was a…
Another axis would be power consumption. Pretty sure if you want LLM training in 1980 you'd also need fusion power in 1980. And it would be very, very hard to hide the cooling apparatus of your datacenter.
> I think you've already conceded that LLMs demonstrate emergent behaviour No. Please don't put words in my mouth. What I said is that an LLM compresses a bunch of information into a semantic embedding space and then…
I'm not following the "Fable" stuff, what is that? [edit: ah it's a new language model from Anthropic.. yeah still don't see how it's relevant here]
To say that LLMs' existence is evidence for emergent phenomena in LLMs is tautological. I'm merely suggesting if you want to make a claim about emergence it would be best, especially in absence of a convincing theory,…
> there seems to be some emergent behaviour that is not simply just next-token-prediction, or that the ability to do accurate next-token-prediction requires something "extra" that LLMs have. The next step then would be…
To quote the great Dr. Malcolm: > Life, uh, finds a way.
I think we must be talking past eachother. I define stochastic search as a search process with randomness injected into it that can return the following things: - Something contained in the data set, not necessarily the…
> Imagining something in advance is not necessary at all for scientific advancement. This is particularily true in AI, and no one expects to imagine what superintelligence is until after it is created. Then why does…
> But what matters is the result- this machine, matrix multiplier, stochastic parrot, consistently displays intelligence, to the point of being able to perform very complex, open-ended tasks that integrate discovery,…
Yes I think the drug discovery analogy is apt. I've spent a bunch of time playing with evolutionary algorithms, they're great fun. And when they work they can do surprising things! I wouldn't bet on evolving an…
> Is an implication of this that models are incapable of producing entirely novel code? No, it does not imply that at all. Google "temperature in LLMs". > what do you posit is special about what is happening when humans…
Fair enough, I should have phrased that less strongly. Until you show that your neural net does "thinking" or "reasoning" I'll disregard that and prefer to think about it in terms of what we actually know neural nets…
> Where do you think intelligence comes from, some mysterious realm? It's physical, computational. Well, no. I don't think it comes from some mysterious realm. I think that which is not physical does not exist [edit:…
I'm not claiming there's something "extra" happening in brains. Merely that we just don't know how they work well enough to use that knowledge to do engineering. Neural nets are quite unlike brains, despite the…
I'd call it what it is: a good enough stochastic search result extracted from the model's embedding space.