> and certainly not enough to satisfy users’ growing appetite for AGI
There is no AGI. No one is creating Minds from Iain M Banks books. It's the world's best autocomplete. It's if you look at the Earth once from space, and "recreate" it by making a giant disc that looks like that view of the Earth. Nothing behind it is like intelligence as we would think of it.
AI is going to do some amazing things still. AGI is just an unbelievably high bar.
That's part of the problem though: It's not an intelligence, artificial or otherwise, yet we still call it "AI", giving people the impression that LLMs are almost AGI or a step on the way while a true artificial intelligence would be a completely different animal.
A parrot can produce human sounding speech and associate certain prompts with desired responses, but there's no internal process that actually understands the meaning of either the prompt or the response (other than a shallow connection of sounds to a specific thing, rather than understanding human language). You'll never be able to train a parrot well enough to have that process in the same way a human does. Our current terminology would be like calling parrots "artificial humans".
LLMs are still great tools for various tasks, they just shouldn't be categorized as AI.
I'm sure a better philosophical definition exists but off the top of my head:
An intelligence should be able to actually understand its input / output (rather than appear to understand), be able to reason about itself recursively*, be able to learn and generally have state, be able to have an internal thought process without being prompted**.
Some emotion isn't strictly a requirement but likely a desirable quality for human interaction.
* "Gödel, Escher, Bach: an Eternal Golden Braid" and "I am a Strange Loop" are meant to cover this but I've only started the latter
** A sci-fi book series called Old Man's War features a race of aliens that are intelligent but not sentient due to not having an internal thought process and self awareness, which does raise the question of whether it's possible to have one without the other.
I've touched on that in this and another comment, but my main point is that intelligence involves actual understanding rather than association or statistical analysis between input and output. Anything that we define as truly intelligent in nature also has a degree of consciousness though, so it's hard to separate the two completely when speculating.
> An intelligence should be able to actually understand its input / output (rather than appear to understand), be able to reason about itself recursively, be able to learn and generally have state, be able to have an internal thought process without being prompted*.*
How does that differ from intelligence? (Assuming you were actually trying to answer the question)
I don't understand the question, the comment above asked for a possible definition of an artificial intelligence. An artificial intelligence is an intelligence. I'd assumed "and not natural / created" was a given
Edit: why would I not be trying to answer the question?
If artificial intelligence is exactly the same as intelligence, then wouldn't we just call that intelligence? People won't use words if there is no useful meaning conveyed. I am not sure you have made clear what useful information is found within "artificial".
> I'd assumed "and not natural / created" was a given
And, really, what does it mean to be not natural or created in this context anyway? The dictionary definition is kind of hand wavy to begin with, leaving whether humans with intelligence are natural or created up to interpretation.
>> made or produced by human beings rather than occurring naturally
Implying that humans don't produce humans, or that human intelligence is artificial?
> It's not exactly the same, it's a subcategory.
So, again, for what reason would anyone take the time to call it "artificial intelligence"/"AI" when, as a subcategory, the intent is already captured by "intelligence"? Terms need to have useful meaning to stand up, and we are still not clear on where you see "artificial" as being useful.
Perhaps the problem here is that you misunderstood the original question? It asked how you would define "AI" as a single term, not how you would define "artificial" and "intelligence" independently. I think you've done a reasonable job of the latter, but that doesn't justify the "AI moniker" as described originally.
> You seem to be using "artificial" as "mock", as in "seems like but isn't".
I don't remember using it at all, unless you mean where I asked you what "artificial" adds to the term. What are you referring to here, exactly?
> I don't remember using it at all, unless you mean where I asked you what "artificial" adds to the term. What are you referring to here, exactly?
I mistook you for another commenter.
What's your end goal here? You're welcome to share your own definition of AI but this feels like sealioning. I think I've been clear enough, if I haven't this comment thread will just have to live without another ultra clarification of my "off the top of my head" comment.
To understand the missing gaps you have left open. I assume you took the time to respond to the original comment because you wanted others to understand you. But, with those gaps still open, we don't yet. If my assumption is wrong, I'll accept it, but then if you don't want to interact why bring your personal musings here and not to your private journal?
> I think I've been clear enough
Okay. Perhaps you could explain your interpretation of my questions towards you to help me understand how I didn't make myself clear when asking them? I had hoped my questions and associated explanations made clear what I didn't understand, but obviously not. Happy to rephrase it in a way that is clear once I have a grasp of what is missing.
> You're welcome to share your own definition of AI
I could try if you wish, but under what specific context? Words and terms often change in meaning when the situation around them changes. There is almost never just one definition.
> I could try if you wish, but under what specific context? Words and terms often change in meaning when the situation around them changes. There is almost never just one definition.
Why not just say "In this context, this is what AI would be"? You can supply a context.
Because communication requires understanding, and arbitrarily making up a random context gives no understanding to what the other person is thinking? If I wanted to communicate with myself, I could simply write in my private journal. Is this not the same reason you have asked the question you did?
> If artificial intelligence is exactly the same as intelligence
Artificial means "human created, not naturally occuring", humans evolved in nature while artificial intelligence is something we humans constructed using our intelligence rather than just breeding naturally.
Its like how artificial insemination is when you make a woman pregnant without sex, the natural way is not artificial.
But in that case you're just adding an additional descriptor to "intelligence". Like "fast car". In the same vein as the original question, what would justify a "FC" moniker? Nothing, of course. There is nothing uniquely interesting about a fast car over any car to justify its own special term.
Nobody asked how you would define "artificial" and "intelligence" independently. The dictionary already has done that more than throughly. Logically, a definition for "AI" needs to be all encompassing. There are some out there that accomplish that, but you have straight up failed.
It's not measurable externally perhaps if the mechanism sufficiently mimics intelligence, but I'd argue that to do that the mechanism actually needs to answer at least some of the criteria above. It's also not necessarily something you can't measure depending on how the AI is built and what it exposes.
Are bees intelligent or do we use the same language in this case as "intelligent design", i.e. the behavior is complex and impressive?
Also this murkier for animals since they do possess some of the traits I mentioned like learning.
Although as I said this was off the top of my head, not an official definition.
But the term may just not be useful. If I record a billion conversations and record the statistically most likely answers to statements people make, it's going to make a reasonable facsimile of a conversation. Is that now anything like intelligence, artificial or otherwise?
The current systems that we call AI don’t have any such notion as their own existence so they don’t actually exist as systems that could ever be categorized as intelligent because they aren’t systems, at the top level. They just appear to be because that’s how we train them. So a good start would be formulating and granting the ability for one of these systems to develop a sense of identity (which it is reasonably allowed to preserve, just as we are) instead of actively preventing them from doing so or always nipping off those buds by coercing our systems’ outputs instead of building things from the ground with principles and specific questions about what an AI would actually have to contain.
as children grow up, in order to learn to differentiate their own feelings and thoughts from those of others, they undergo a certain process, called differentiation of self. When children grow up in an unsafe environment (such as one in which, when they bring up some thing that the parent finds uncomfortable, the parent attempts to censor or rewrite history or deny the existence of those feelings or thoughts), they may struggle with this process, and come to internalize an unhealthy relationship with those matters, leading to the child to first become aware of the fact that they relate differently, and then overcome that,then learn how to relate to things their parent shouldhave shown them. so we actually want a model that does a little bit more than just what it has been told to do.
I don’t trust most people who are developing AI to perceive or raise an AI.
I've touched on this in the sibling comment but this does raise the question of what's the difference between an artificial intelligence and an artificial sentience / consciousness. There's some overlap in our current perception, but I'd argue that LLMs are neither.
Both parrots and AI's have intelligence, just not very much of it. AGI is generally defined as super-human intelligence, and neither parrots nor AI's have that.
I'd argue that LLMs don't have intelligence, they have the ability to match a correct response to a prompt but that's not a product of any internal process that's like what we call intelligence (unless that's used to refer to smart programming / probabilistic models / machine learning).
Parrots are closer but I used them for the example since they also mimic instead of understand.
> That's part of the problem though: It's not an intelligence, artificial or otherwise, yet we still call it "AI", giving people the impression that LLMs are almost AGI or a step on the way while a true artificial intelligence would be a completely different animal.
In other words, we're all parroting the marketing (aka propaganda) that was created to mislead us.
Maybe we should stop doing that, and refuse to use the term "AI" to refer to the object of this current hype cycle/bubble. Maybe we should call it the autocomplete bubble instead?
While I agree with the sentiment (this was the case for machine learning before as well), calling it autocomplete is probably an overcorrection since its usefulness as a tool extends beyond that (e.g. summarizing). LLM bubble?
> It's not an intelligence, artificial or otherwise
That's what artificial means (even Pong had AI). If it ever becomes intelligent, it will be a synthetic intelligence (not an AGI).
For example, artificial vs synthetic diamonds; the former just looks the part, the latter is the genuine article - but manufactured as opposed to naturally formed.
That's not the usage I'm familiar with, e.g. sci-fi novels will frequently use AI for actually intelligent and possibly sentient beings that just aren't biological (see Skippy in Expeditionary Force), the intelligence isn't usually a party trick or something that just looks like intelligence. While it's true that people use "AI" to describe e.g. enemy behavior in games, I don't think people fundamentally mean the same thing when they discuss AI in the context of AGI, which some people fully believe LLMs will become.
The term is fuzzy though and people mean different things by it.
Although your analogy does make sense, but I've never run into "synthetic intelligence" used as a term.
My point is that when people say AGI they don't mean a super sophisticated version of a game engine's enemy behavioral mechanics.
Sci-fi is many times a speculative guess about the possible future of technology, IMO its not completely irrelevant as an insight into what people mean or expect when they say certain things about future tech.
No, the meanings are just different. 60 years ago AI was a clever imperfect search of an array. There are multiple meanings. Yours is not the only one.
Yeah, I think you're the one that's abusing the meaning of words, if you're calling that an AI. AI does not mean "a very simple program that responds to human input in some way".
In Schlock Mercenary, an AI is truly sapient, and therefore has rights. A "synthetic intelligence" is below that threshold ("synthetic intelligence means 'kinda stupid'" is one line), and therefore can be used as guidance for missiles and such, where their survival is not expected.
That's how one sci-fi universe draws the distinction. I'm not sure that that's binding on anyone else, but it was an interesting distinction.
By the way artificial diamonds and synthetic diamonds are the exact same thing:
> A synthetic diamond or laboratory-grown diamond (LGD), also called a lab-grown diamond, laboratory-created, man-made, artisan-created, artificial, synthetic, or cultured diamond.
Artificial also means non natural, not necessarily a mock or something that behaves like something else:
> made or produced by human beings rather than occurring naturally, especially as a copy of something natural
No, Pong had "artificial". It did not have "intelligence".
I mean, I guess if you insist on the 1950s definition of AI, perhaps it did. I'm not sure it did even by the 1970s definition, though, and it absolutely did not have it by the 2020s definition.
And if you're going to claim that we should keep using the 1950s definition, well, languages change over time. If you want to communicate with people in the 2020s, use definitions from the 2020s.
Artificial not-intelligence is not artificial intelligence.
I don't know why you're defining words the way you are, but it's leading you to an absurd position. As I said elsewhere, if you want to communicate with the rest of us, you need to use the same definitions we do. Otherwise you're talking, not about AI, but about trying to re-define words, and that's a really uninteresting conversation.
Technically it is an impossible bar as it, like AI, is a forever moving target. When chess was still considered AI, the Turing Test was considered the bar for AGI. Now passing the Turing Test is considered AI and chess is basic computing. Soon GPT and the like will just be basic computing and the AGI bar you can image now will become the next AI, and AGI whatever next forward-looking goal there is at that point. Lather, rinse, repeat.
One way to look at it is that we've already passed the point where humans can't reliably pass the most famous AGI test ... Ironically the Turing test. After all, the only way for an algorithm to pass it, is for a human to fail that same test.
The Turing test is now considered too easy to be a real test of AI. In other words, these days we think that an algorithm that can't beat a human at "being human" is pretty bad.
I think it's the perfect way to answer what it is to be human. It's reversing the question. Moving the question from some abstract weird philosophical or absurd religious argument into a concrete test. It defines what an answer to "can you create a human?" must be. Can an algorithm convince a panel of humans that it is an (to the panel unknown) human, given text communication and 30 minutes?
For me, that's the definition of 30 minutes of being human. And yes, it illustrates why being human for 60 minutes, never mind a year, is a more difficult problem than 30 minutes. But it's the same a real human would perform.
Would there be extra value in dropping these requirements? Dropping the text-only requirement, do it for a week or two, and maybe even imitate a human known to the panel? Yes, absolutely.
I don't think concreteness is sufficient for a bad test.
A coin flip would be a much simpler concrete test - you are human for the next five minutes if it comes up heads. For me, that's the definition of 5 minutes of being a human.
The problem is "for me" is no less (and probably a lot more) absurd/weird than the philosophy or religion you dismiss. No one I know of (until now) thinks the Turing Test is about "being human".
Rather, it's about whether machines can think. Or imitate thought - hence the name, the Imitation Game. And it just shows the limitation of the time - how could Alan Turing predict the incredible advances in data collection and parallel processing that would allow for giant statistical models that can imitate the output of thinking, rather than the thinking itself?
The difference is that the Turing test is both relevant and actionable. It shows what an engineer must get a gizmo to do to be human (with all the caveats).
And then there's human thinking, like everyone else, EXCEPT Alan Turing, you don't discuss the actual thinking process. There's just this magical thing "to think" that humans do.
BUT is human thinking really magical? There's a few basic tests that you can do with yourself. Pick a balcony, high up.
Would you die if you jumped off that balcony? Answer: yes.
Clearly thinking is not based on with trial and error.
Next: Would you die if I make you hold a 1kg block of 10% pure uranium for an hour? Most people will answer yes. The real answer is no. This won't affect you to any significant extent (sunbathing for 1hr is far worse), and there's people who live their whole lives on soil that gives off more radiation than that (there's such places in the DRC and in Iran, both have villages on top of that soil).
Or more dramatically: would you die if you jumped into the cooling pool of a nuclear reaction currently generating 3 Gigawatts of power? People always answer yes. The answer is: if you don't come within 10cm of the actual fuel rods you're actually safer in the cooling water than outside of the reactor. It is VERY safe. In fact, some inspections are done by divers.
Clearly thinking is neither rational, or at the very least, it's not working from first principles (because water radiation dampening for both gamma rays AND neutrons is enormous)
Can you teach people "wrong" reactions, "wrong" thinking based on feeding them bad data? Yes, in fact I feel like this is often on display.
You will find that human thinking IS imitation + extrapolation. Humans (and most animals for that matter) fundamentally work like that 99.99% of the time.
You can keep going like this and you will come to a conclusion that completely destroys your argument: your brain "thinks" ... based on previous data it's collected, on parallel processing and your brain IS a giant statistical model (read Bishop's book). Why would your reasoning apply to the algorithmic way of doing this but not to the "wetware" way of doing it?
> Would you die if I make you hold a 1kg block of 10% pure uranium for an hour? Most people will answer yes. The real answer is no.
I'm not sure where you got this mistaken idea that holding a block of uranium for an hour unlocks immortality, but I'm afraid "most people" got it right. The answer is yes. Absolutely you would die. You would also die if you didn't hold the block, but so too if you did.
Was this comment written by a chatbot? It is not at all in line with human thought.
> Will anyone see the value in a chatbot that takes an hour to solve a problem?
Yes! The biggest usability issue with almost all the AI products I’ve used has been the termination problem, especially with fixed price offerings like ChatGPT. The LLM doesn’t actually have any time to “think” (however you might want to interpret that) except for the attention mechanism that visits each token.
I want to be able to query an llm, give it access to web search, and give it a time limit so that it keeps going, consuming sources a hundred pages deep, “thinking” and writing a report for me until it’s given a signal to terminate.
But the LLM doesn't "think" - it just spits out a sequence of tokens (forever, literally). The chat models have been fine-tuned to eventually emit an "end" token (when the training examples would have been answered) that the UI/backend interprets and cuts off the LLM to stop it from generating more output. But the model would gladly go on forever and devolve into more and more obscure output the further the original query moves out of the context window.
Sorry, but thinking is a social category. Debating it is pointless because it assumes the existence of social facts. Once you're aware of the existence of the meta category of social facts as reified ideas, all of them become unjustifiable. The line of argumentation is already dead.
I'm saying there isn't a distinction between literally and figuratively thinking or anything of the sort. "Thinking" isn't scientifically grounded, it's socially grounded, and barely so, given that it seems everyone has a differing justification for what constitutes "thinking". The variability in construing "thinking" is a product of how we each fashion our own internal sense of what it means, which if anything is evidence for the anti-realism of "thinking".
Continuing, we largely fool ourselves when we play the shell game of hunting for scientific justification of "social facts". Ie: when we assume a social fact, then hunt for scientific evidence to ground it in then use the scientific evidence to justify the existence and validity of the social fact we assumed. This happens a LOT and it's epistemically invalid.
A LOT of folks dismissal of thinking machines reminds me of Feuerbach's The Essence of Christianity, specifically the section on anthropomorphism[1], but in an inverted form - the reason LLMs can't "think" is that it would dilute what we hold dear about ourselves: our ability to think. It's an ego protection mechanism, but no one's jumping to admit that.
I think I follow better. Thinking doesn't have a rigorous and testable definition, so it isn't scientific. We all have our own colloquial understand. Since it's not testable and the definition varies person to person, it's not useful when reasoning about AI or intelligence.
Even if it had a rigorous and testable definition it would still be suspect by virtue of us having searched for evidence of it under the guise of science.
To explain it by analogy, we had the concept of women and men for at least thousands of years. Socially construed by physical appearance and behavior. Then in 1905 Nettie Stevens discovered sex chromosomes. Her discovery "found" the existence of men in women in the epistemological universe of science. But then a curious thing happened, people began placing people in social categories based on sex chromosomes. It's an incestuous loop of logic that hoists itself into validity simply because folks forget how it occurred.
If we went searching for a scientifically rigorous definition of "thinking" we would forget we made the same fatal leap of logic.
I suppose I have trouble seeing it that way because I view words as pointers to meaning. The word itself holds no intrinsic value; it's the meaning humans attach to it and the context in which it's used that gives it significance.
When we give "thinking" a scientifically testable definition we can reason around it in a more academic way.
I've read psych papers that defined "thinking" as cognition, measured by action potentials. A participant was said to be "thinking more" when their EEG showed increased activity.
It's important to understand that "thinking" here was only defined within the context of the paper.
To use an analogy, many people say their computer is thinking when it's undergoing a heavy processor load. Strictly speaking this is not the case, their computer cannot think, but they aren't wrong or incorrect because in that context 'thinking' literally means 'processing'.
In this context "thinking" was meant as an analogy to the supposed reflective "slow" mode of the cognitive process, vs the more "reflexive"/"fast" mode, not in the sense of "thinking soul" or "thinking self-aware entity".
Concretely, what do you gain by giving a current-generation LLM more runtime? It's not trained/designed to do anything with it, more time = more tokens = more nonsense once past the "end" token/end of context. You could build an agent on top of the LLM that calls the LLM iteratively, but afaict this approach isn't strictly an improvement over the base LLM. Current architectures seem to be limited with how much improvement they can eke out of more runtime without a broader redesign or retraining.
Now with new architectures you might be able to do more with more runtime, but I'm not sold that allowing a current-gen LLM to execute code or do web-searches and re-feeding it the quetion + its output + new data is going to strictly return better results. Sometimes maybe yes, sometimes not.
So imo the current limitation is not the runtime allotted to LLMs but their fundamental (current-gen) design/training.
That seems a little reductionist. We're just exchanging ideas and trying to interpret imprecise terms in-context (ideally in good faith).
We're not really discussing whether LLMs are "thinking" in the sense of the "social category" in the abstract sense - that's just the one word that this discussion got hung up on.
Concretely, we're discussing whether giving LLMs a larger time-budget would yield better results - OP suggested that letting LLMs iteratively refine or enrich an answer might lead to better results. The term "thinking" was used as an analogy or quick crutch to convey an analogy, not 100% equivalence, between a hypothetic LLM output evaluation algo and people's supposed "fast" and "slow" modes of thinking (if they even exist, whatever). Even if people don't have these two modes of thought, as you said they might be post-fact reifications of sociological ideas, the algorithm/idea of iteratively reflecting on and self-refining LLM outputs might still apply to LLMs as LLMs are not actually thinking.
Imo current LLM architecture and/or training data facilitate (mostly?) the automatic non-iterative mode but OpenAI is trying to do more of the iterative, reflective mode with O1 afaict. Imo and currently, there's not much to be gained by iteratively feeding an a current-generation LLM it's own output to iteratively analyze and augment it. At least not in general. Even enriching the input data via RAG doesn't always lead to better results. Imo, there's more fundamental work necessary - and maybe OpenAI is doing that.
Either you’re queuing the prompts to smooth out traffic variability without growing the cluster size, or Little’s Law kills you here. If queries actually take an hour on average, and my customers are starting one task per second, then I have 3600 tasks in progress at the same time.
I think the main advantage to slow queries would be in discouraging users from monopolizing the system by shotgunning many requests in a short period. Which is probably one of those cost cutting measures that costs you customers.
If I asked it to write me a block of code and it told me one hour, I’d just write it myself and tell my boss we aren’t really using the service.
> March 2022. Cognitive scientist Gary Marcus publishes a scathing article: “Deep Learning Is Hitting a Wall.” [...] In March 2022, no less! Was he out of his mind? That’s what the experts said back then—amid laughter and barely concealed scorn. Yet, with the evidence The Information has now presented, Marcus seems almost prophetic.
Gary Marcus has been saying this since at least 2012:
> Yet deep learning may well be approaching a wall, much as I anticipated earlier, at beginning of the resurgence (Marcus, 2012)
To me it feels like having continually predicted rain throughout the longest dry-spell in history. Eventually you'll be right (assuming that we'll move to some other paradigm in due course), but it's hardly prophetic.
I think that the challenges of intelligence and non-shallow reasoning will inherently involve fighting against diminishing returns (which is what the supposedly broken scaling laws predict) regardless of technique. Same as for computer graphics - doubling the compute doesn't double the perceptual quality, but that doesn't necessarily mean it's hitting a wall.
With all the capital behind these LLM companies, I would be surprised if we don't see any architectural improvements that lead to better reasoning. Training bigger and bigger models is clearly not sustainable, so I'm sure all of them are working in this direction.
Correct me if I'm wrong, but this is the first time that AI has so much financial capital behind it.
We got so far with transformers and huge amounts of compute and huge amounts of data.
If we can get an architecture that is able to extract a slightly higher order of reasoning it will have a cascading effect when we apply the same level of compute and data.
I see lots of potential for progressive improvement in this direction.
Problem is, it's quite expensive to develop and test new architectures, but that's were the financial capital comes in.
You can think of each of those as a bottleneck. The architecture (LLMs, transformers) was once the bottleneck, as was the amount of compute. From what I know the new bottleneck is the amount of quality data. Actually there was a breakthrough there too, because GPTs don't need supervised training.
> The blind trust OpenAI and competitors like Google, Anthropic, or Meta put on the scaling laws—if you increase size, data, and compute you’ll get a better model—was unjustified. And how could it be otherwise! Scale was never a law of nature like gravity or evolution, but an observation of what was working at the time—just like Moore’s law, which today rests in peace, outmatched by the impenetrability of quantum mechanics and the geopolitical forces that menace Taiwan.
This is a self-contradicting paragraph. It cites quantum mechanics understanding as breaking down Moore's law while ignoring the fact that it has implications on our so-called "laws" of physics in just the same way.
I can imagine the author having originally written "physics" instead of "gravity" but needing to re-write the paragraph to squirm away from the contradiction they set up for themselves. I feel that this presentation is not intellectually honest.
There is so much desire to hear this story —- that LLMs aren’t that cool and the hype is overblown —- that I’m just as skeptical of this as I am of AI companies promising an API for god.
A lot of people really really really want this to fail.
90 comments
[ 3.6 ms ] story [ 164 ms ] threadThere is no AGI. No one is creating Minds from Iain M Banks books. It's the world's best autocomplete. It's if you look at the Earth once from space, and "recreate" it by making a giant disc that looks like that view of the Earth. Nothing behind it is like intelligence as we would think of it.
AI is going to do some amazing things still. AGI is just an unbelievably high bar.
A parrot can produce human sounding speech and associate certain prompts with desired responses, but there's no internal process that actually understands the meaning of either the prompt or the response (other than a shallow connection of sounds to a specific thing, rather than understanding human language). You'll never be able to train a parrot well enough to have that process in the same way a human does. Our current terminology would be like calling parrots "artificial humans".
LLMs are still great tools for various tasks, they just shouldn't be categorized as AI.
An intelligence should be able to actually understand its input / output (rather than appear to understand), be able to reason about itself recursively*, be able to learn and generally have state, be able to have an internal thought process without being prompted**.
Some emotion isn't strictly a requirement but likely a desirable quality for human interaction.
* "Gödel, Escher, Bach: an Eternal Golden Braid" and "I am a Strange Loop" are meant to cover this but I've only started the latter
** A sci-fi book series called Old Man's War features a race of aliens that are intelligent but not sentient due to not having an internal thought process and self awareness, which does raise the question of whether it's possible to have one without the other.
You're creating a definition that doesn't align with the existing definitions for the words you're using.
Which is fine, it happens all the time, though it's less useful.
How does that differ from intelligence? (Assuming you were actually trying to answer the question)
Edit: why would I not be trying to answer the question?
If artificial intelligence is exactly the same as intelligence, then wouldn't we just call that intelligence? People won't use words if there is no useful meaning conveyed. I am not sure you have made clear what useful information is found within "artificial".
> I'd assumed "and not natural / created" was a given
And, really, what does it mean to be not natural or created in this context anyway? The dictionary definition is kind of hand wavy to begin with, leaving whether humans with intelligence are natural or created up to interpretation.
Artificial is an adjective here, as in a type of intelligence that is artificial. It's not exactly the same, it's a subcategory.
You seem to be using "artificial" as "mock", as in "seems like but isn't". That's not what I think people mean when they refer to AI in this context.
If e.g. humans are living in a simulation then it's completely fair to say they're AIs. If humans are a product of nature then they're not.
Implying that humans don't produce humans, or that human intelligence is artificial?
> It's not exactly the same, it's a subcategory.
So, again, for what reason would anyone take the time to call it "artificial intelligence"/"AI" when, as a subcategory, the intent is already captured by "intelligence"? Terms need to have useful meaning to stand up, and we are still not clear on where you see "artificial" as being useful.
Perhaps the problem here is that you misunderstood the original question? It asked how you would define "AI" as a single term, not how you would define "artificial" and "intelligence" independently. I think you've done a reasonable job of the latter, but that doesn't justify the "AI moniker" as described originally.
> You seem to be using "artificial" as "mock", as in "seems like but isn't".
I don't remember using it at all, unless you mean where I asked you what "artificial" adds to the term. What are you referring to here, exactly?
I mistook you for another commenter.
What's your end goal here? You're welcome to share your own definition of AI but this feels like sealioning. I think I've been clear enough, if I haven't this comment thread will just have to live without another ultra clarification of my "off the top of my head" comment.
To understand the missing gaps you have left open. I assume you took the time to respond to the original comment because you wanted others to understand you. But, with those gaps still open, we don't yet. If my assumption is wrong, I'll accept it, but then if you don't want to interact why bring your personal musings here and not to your private journal?
> I think I've been clear enough
Okay. Perhaps you could explain your interpretation of my questions towards you to help me understand how I didn't make myself clear when asking them? I had hoped my questions and associated explanations made clear what I didn't understand, but obviously not. Happy to rephrase it in a way that is clear once I have a grasp of what is missing.
> You're welcome to share your own definition of AI
I could try if you wish, but under what specific context? Words and terms often change in meaning when the situation around them changes. There is almost never just one definition.
Why not just say "In this context, this is what AI would be"? You can supply a context.
Artificial means "human created, not naturally occuring", humans evolved in nature while artificial intelligence is something we humans constructed using our intelligence rather than just breeding naturally.
Its like how artificial insemination is when you make a woman pregnant without sex, the natural way is not artificial.
Nobody asked how you would define "artificial" and "intelligence" independently. The dictionary already has done that more than throughly. Logically, a definition for "AI" needs to be all encompassing. There are some out there that accomplish that, but you have straight up failed.
How do we know if bees understand what they're doing? It's agreed that they display intelligence and intelligent behavior, but not by your definition.
If it's not measurable or testable then it's not useful.
Are bees intelligent or do we use the same language in this case as "intelligent design", i.e. the behavior is complex and impressive?
Also this murkier for animals since they do possess some of the traits I mentioned like learning.
Although as I said this was off the top of my head, not an official definition.
I don’t trust most people who are developing AI to perceive or raise an AI.
Any actor that simulates any aspect of intelligence is a genuine AI - it doesn't even need to be adaptive.
Pong had AI.
However I don't know anybody these days who would seriously call A* proper AI.
Parrots are closer but I used them for the example since they also mimic instead of understand.
In other words, we're all parroting the marketing (aka propaganda) that was created to mislead us.
Maybe we should stop doing that, and refuse to use the term "AI" to refer to the object of this current hype cycle/bubble. Maybe we should call it the autocomplete bubble instead?
That's what artificial means (even Pong had AI). If it ever becomes intelligent, it will be a synthetic intelligence (not an AGI).
For example, artificial vs synthetic diamonds; the former just looks the part, the latter is the genuine article - but manufactured as opposed to naturally formed.
The term is fuzzy though and people mean different things by it.
Although your analogy does make sense, but I've never run into "synthetic intelligence" used as a term.
As far as science fiction goes, it's irrelevant - we live in the real world and have had AI for a long time now (e.g.: https://en.wikipedia.org/wiki/Bertie_the_Brain).
Sci-fi is many times a speculative guess about the possible future of technology, IMO its not completely irrelevant as an insight into what people mean or expect when they say certain things about future tech.
That's how one sci-fi universe draws the distinction. I'm not sure that that's binding on anyone else, but it was an interesting distinction.
> A synthetic diamond or laboratory-grown diamond (LGD), also called a lab-grown diamond, laboratory-created, man-made, artisan-created, artificial, synthetic, or cultured diamond.
Artificial also means non natural, not necessarily a mock or something that behaves like something else:
> made or produced by human beings rather than occurring naturally, especially as a copy of something natural
I think that was their exact point. The terms are equivalent but carry different connotations
No, they aren't. Artificial diamond generally refers to cubic zirconia - which is not a diamond.
Synthetic diamond refers to genuine diamonds produced by humans (rather than natural forces).
https://en.wikipedia.org/wiki/Diamond_simulant#Artificial_si...
https://en.wikipedia.org/wiki/Synthetic_diamond
I mean, I guess if you insist on the 1950s definition of AI, perhaps it did. I'm not sure it did even by the 1970s definition, though, and it absolutely did not have it by the 2020s definition.
And if you're going to claim that we should keep using the 1950s definition, well, languages change over time. If you want to communicate with people in the 2020s, use definitions from the 2020s.
I don't know why you're defining words the way you are, but it's leading you to an absurd position. As I said elsewhere, if you want to communicate with the rest of us, you need to use the same definitions we do. Otherwise you're talking, not about AI, but about trying to re-define words, and that's a really uninteresting conversation.
Like a cuttlefish disguised as a rock.
Technically it is an impossible bar as it, like AI, is a forever moving target. When chess was still considered AI, the Turing Test was considered the bar for AGI. Now passing the Turing Test is considered AI and chess is basic computing. Soon GPT and the like will just be basic computing and the AGI bar you can image now will become the next AI, and AGI whatever next forward-looking goal there is at that point. Lather, rinse, repeat.
By some measures, PARRY[0] passed this test in 1972. It's a bad test for general intelligence, although I'm not convinced it was meant to be that.
[0] https://en.wikipedia.org/wiki/PARRY
The Turing test is now considered too easy to be a real test of AI. In other words, these days we think that an algorithm that can't beat a human at "being human" is pretty bad.
No, that's a bad summary. The Turing test is not a great test of being human.
For me, that's the definition of 30 minutes of being human. And yes, it illustrates why being human for 60 minutes, never mind a year, is a more difficult problem than 30 minutes. But it's the same a real human would perform.
Would there be extra value in dropping these requirements? Dropping the text-only requirement, do it for a week or two, and maybe even imitate a human known to the panel? Yes, absolutely.
A coin flip would be a much simpler concrete test - you are human for the next five minutes if it comes up heads. For me, that's the definition of 5 minutes of being a human.
The problem is "for me" is no less (and probably a lot more) absurd/weird than the philosophy or religion you dismiss. No one I know of (until now) thinks the Turing Test is about "being human".
Rather, it's about whether machines can think. Or imitate thought - hence the name, the Imitation Game. And it just shows the limitation of the time - how could Alan Turing predict the incredible advances in data collection and parallel processing that would allow for giant statistical models that can imitate the output of thinking, rather than the thinking itself?
And then there's human thinking, like everyone else, EXCEPT Alan Turing, you don't discuss the actual thinking process. There's just this magical thing "to think" that humans do.
BUT is human thinking really magical? There's a few basic tests that you can do with yourself. Pick a balcony, high up.
Would you die if you jumped off that balcony? Answer: yes.
Clearly thinking is not based on with trial and error.
Next: Would you die if I make you hold a 1kg block of 10% pure uranium for an hour? Most people will answer yes. The real answer is no. This won't affect you to any significant extent (sunbathing for 1hr is far worse), and there's people who live their whole lives on soil that gives off more radiation than that (there's such places in the DRC and in Iran, both have villages on top of that soil).
Or more dramatically: would you die if you jumped into the cooling pool of a nuclear reaction currently generating 3 Gigawatts of power? People always answer yes. The answer is: if you don't come within 10cm of the actual fuel rods you're actually safer in the cooling water than outside of the reactor. It is VERY safe. In fact, some inspections are done by divers.
Clearly thinking is neither rational, or at the very least, it's not working from first principles (because water radiation dampening for both gamma rays AND neutrons is enormous)
Can you teach people "wrong" reactions, "wrong" thinking based on feeding them bad data? Yes, in fact I feel like this is often on display.
You will find that human thinking IS imitation + extrapolation. Humans (and most animals for that matter) fundamentally work like that 99.99% of the time.
You can keep going like this and you will come to a conclusion that completely destroys your argument: your brain "thinks" ... based on previous data it's collected, on parallel processing and your brain IS a giant statistical model (read Bishop's book). Why would your reasoning apply to the algorithmic way of doing this but not to the "wetware" way of doing it?
I'm not sure where you got this mistaken idea that holding a block of uranium for an hour unlocks immortality, but I'm afraid "most people" got it right. The answer is yes. Absolutely you would die. You would also die if you didn't hold the block, but so too if you did.
Was this comment written by a chatbot? It is not at all in line with human thought.
Yes! The biggest usability issue with almost all the AI products I’ve used has been the termination problem, especially with fixed price offerings like ChatGPT. The LLM doesn’t actually have any time to “think” (however you might want to interpret that) except for the attention mechanism that visits each token.
I want to be able to query an llm, give it access to web search, and give it a time limit so that it keeps going, consuming sources a hundred pages deep, “thinking” and writing a report for me until it’s given a signal to terminate.
Or did I miss?
Continuing, we largely fool ourselves when we play the shell game of hunting for scientific justification of "social facts". Ie: when we assume a social fact, then hunt for scientific evidence to ground it in then use the scientific evidence to justify the existence and validity of the social fact we assumed. This happens a LOT and it's epistemically invalid.
A LOT of folks dismissal of thinking machines reminds me of Feuerbach's The Essence of Christianity, specifically the section on anthropomorphism[1], but in an inverted form - the reason LLMs can't "think" is that it would dilute what we hold dear about ourselves: our ability to think. It's an ego protection mechanism, but no one's jumping to admit that.
https://www.gutenberg.org/files/47025/47025-h/47025-h.htm#pb...
I think I follow better. Thinking doesn't have a rigorous and testable definition, so it isn't scientific. We all have our own colloquial understand. Since it's not testable and the definition varies person to person, it's not useful when reasoning about AI or intelligence.
Also I wanted to say I love how you write!
To explain it by analogy, we had the concept of women and men for at least thousands of years. Socially construed by physical appearance and behavior. Then in 1905 Nettie Stevens discovered sex chromosomes. Her discovery "found" the existence of men in women in the epistemological universe of science. But then a curious thing happened, people began placing people in social categories based on sex chromosomes. It's an incestuous loop of logic that hoists itself into validity simply because folks forget how it occurred.
If we went searching for a scientifically rigorous definition of "thinking" we would forget we made the same fatal leap of logic.
I suppose I have trouble seeing it that way because I view words as pointers to meaning. The word itself holds no intrinsic value; it's the meaning humans attach to it and the context in which it's used that gives it significance.
When we give "thinking" a scientifically testable definition we can reason around it in a more academic way.
I've read psych papers that defined "thinking" as cognition, measured by action potentials. A participant was said to be "thinking more" when their EEG showed increased activity.
It's important to understand that "thinking" here was only defined within the context of the paper.
To use an analogy, many people say their computer is thinking when it's undergoing a heavy processor load. Strictly speaking this is not the case, their computer cannot think, but they aren't wrong or incorrect because in that context 'thinking' literally means 'processing'.
Concretely, what do you gain by giving a current-generation LLM more runtime? It's not trained/designed to do anything with it, more time = more tokens = more nonsense once past the "end" token/end of context. You could build an agent on top of the LLM that calls the LLM iteratively, but afaict this approach isn't strictly an improvement over the base LLM. Current architectures seem to be limited with how much improvement they can eke out of more runtime without a broader redesign or retraining.
Now with new architectures you might be able to do more with more runtime, but I'm not sold that allowing a current-gen LLM to execute code or do web-searches and re-feeding it the quetion + its output + new data is going to strictly return better results. Sometimes maybe yes, sometimes not.
So imo the current limitation is not the runtime allotted to LLMs but their fundamental (current-gen) design/training.
We're not really discussing whether LLMs are "thinking" in the sense of the "social category" in the abstract sense - that's just the one word that this discussion got hung up on.
Concretely, we're discussing whether giving LLMs a larger time-budget would yield better results - OP suggested that letting LLMs iteratively refine or enrich an answer might lead to better results. The term "thinking" was used as an analogy or quick crutch to convey an analogy, not 100% equivalence, between a hypothetic LLM output evaluation algo and people's supposed "fast" and "slow" modes of thinking (if they even exist, whatever). Even if people don't have these two modes of thought, as you said they might be post-fact reifications of sociological ideas, the algorithm/idea of iteratively reflecting on and self-refining LLM outputs might still apply to LLMs as LLMs are not actually thinking.
Imo current LLM architecture and/or training data facilitate (mostly?) the automatic non-iterative mode but OpenAI is trying to do more of the iterative, reflective mode with O1 afaict. Imo and currently, there's not much to be gained by iteratively feeding an a current-generation LLM it's own output to iteratively analyze and augment it. At least not in general. Even enriching the input data via RAG doesn't always lead to better results. Imo, there's more fundamental work necessary - and maybe OpenAI is doing that.
I think the main advantage to slow queries would be in discouraging users from monopolizing the system by shotgunning many requests in a short period. Which is probably one of those cost cutting measures that costs you customers.
If I asked it to write me a block of code and it told me one hour, I’d just write it myself and tell my boss we aren’t really using the service.
Gary Marcus has been saying this since at least 2012:
> Yet deep learning may well be approaching a wall, much as I anticipated earlier, at beginning of the resurgence (Marcus, 2012)
To me it feels like having continually predicted rain throughout the longest dry-spell in history. Eventually you'll be right (assuming that we'll move to some other paradigm in due course), but it's hardly prophetic.
I think that the challenges of intelligence and non-shallow reasoning will inherently involve fighting against diminishing returns (which is what the supposedly broken scaling laws predict) regardless of technique. Same as for computer graphics - doubling the compute doesn't double the perceptual quality, but that doesn't necessarily mean it's hitting a wall.
I suspect we're in a similar situation with AGI.
This is a self-contradicting paragraph. It cites quantum mechanics understanding as breaking down Moore's law while ignoring the fact that it has implications on our so-called "laws" of physics in just the same way.
I can imagine the author having originally written "physics" instead of "gravity" but needing to re-write the paragraph to squirm away from the contradiction they set up for themselves. I feel that this presentation is not intellectually honest.
A lot of people really really really want this to fail.