In my opinion, hard AI could be just around the corner. Wonder what kinds of startups would rise up to leverage such a technology that is so natively different.
Humans are built out of neural structures, which are black-box learners. Any AI built out of a white-box learner would at least hypothetically be able to self-improve up to some fundamental physical-mathematical limit imposed by its supply of raw compute-power.
The interesting question is: where is that upper limit on intelligence-per-FLOPS?
EDIT: Fixed it to "FLOPS". We already have AI algorithms that Solve The Problem if given unlimited "thinking time" between steps of interaction with their environment (up to the point of needing a Halting Oracle), and we have extensions of those that are asymptotically speed-optimal modulo some additive or multiplicative constants (which are larger than our current universe). I strongly suspect that scaling down these Idealized AI Agents to real, useful programs isn't going to just involve feeding raw instances of the Ideal Agents small enough environments to be tractable, but actually finding or deriving some algorithm that can scale continuously up and down with available computing power per unit of real time, where the time units are the actual real-time length of an interaction cycle.
> are black-box learners. Any AI built out of a white-box learner
To have a white-box learner would imply that humans were smart enough to build it. Yet it's unlikely that humans can build something significantly smarter than a human, so this AI would have the same limitation: It's unable (not smart enough) to build a smarter AI.
Intelligence is not magic, and in some way almost definitely scales with computing power.
For instance, if you have infinite computing power, you just have to dovetail over every possible Turing Machine until one of them "wakes up" and does AI-y things. Yes, there are in fact real approaches based on a more sophisticated version of such a Universal Search.
In fact, we routinely make use of machine-learning algorithms that are "smarter than a human" in particular narrow domains. Are they smarter than a human at general intelligence, of the kind necessary to start looking more like a scifi "AI" than a cheap trick? No, but they are an indication that such a thing could be possible.
Overall, I would say that with Machine Learning maturing and Universal AI being a formal science at all, we are only just now beginning to find out where the actual tradeoffs lie in the design and construction of intelligent agents.
> Intelligence is not magic, and in some way almost definitely scales with computing power.
The speed of intelligence scales. But not the quality of it.
The quality of intelligence is something very hard to quantify. But as simply as I can state it, it's the quality of coming up with an idea that is not just an extension of an existing one, but an idea that came seemingly from nowhere. To someone else the idea appears magic, and no amount of thinking by that other person can lead him in a path that will end up there.
> but they are an indication that such a thing could be possible.
Real genius is not just "more" intelligence, it's intelligence of a different type that a non-genius simply can not do, no matter how they try. Analogously, just because a computer can do something fast does not give it that hard to define quality of true intelligence.
To make (rather than randomly search for) a computer with real intelligence we need to understand what it is, and where it comes from, and we don't know either one of those things. Our best (smartest) computers are all variations of "search randomly" (for example chess engines). Those can do some amazing things, but their limitations will not be overcome by doing more of the same.
> infinite computing power .. every possible
Talking about infinity is a total red herring and you know that - especially because if your method of increasing intelligence is "search randomly" then an AI will not be able to make a better AI - all it can do is continue the random search humans already started.
>Talking about infinity is a total red herring and you know that - especially because if your method of increasing intelligence is "search randomly" then an AI will not be able to make a better AI - all it can do is continue the random search humans already started.
Well the good approach that requires a halting oracle is AIXI, which uses semi-approximable (IIRC on the terminology) Solomonoff Induction hooked up to an expectimax tree.
So it does have to examine every possible "universe" as a Turing Machine, but it uses proven-convergent probabilistic reasoning to get rid of the bad ones and raise good hypotheses to the top much faster than a universal search.
>The speed of intelligence scales. But not the quality of it.
>
>The quality of intelligence is something very hard to quantify. But as simply as I can state it, it's the quality of coming up with an idea that is not just an extension of an existing one, but an idea that came seemingly from nowhere. To someone else the idea appears magic, and no amount of thinking by that other person can lead him in a path that will end up there.
To be frank, before I'll believe this I want to see studies done on either humans or a mathematical examination of formal models of intelligent agents.
I think "never" is much too strong a word, considering that we seem to have a huge abundance of people capable of learning calculus even though few can rediscover it from scratch. There appear to exist very many people who would require such great efforts to learn certain things that doing so would be unpractical, but very few who simply cannot learn things no matter how much effort they put in.
We're talking about something purely hypothetical at this point, so who knows if they're right... but I'd assume that an AI would benefit from the vastly faster processing speed of a computer, the ability to have a processing facility larger than a blob of fat that fits in our cranium, a more accurate memory, etc... plus the ability to iterate on its own operating system.
Eventually, but strong AI just means intelligence matching or exceeding human intelligence. We already have billions of entities with human intelligence, and it is taking us a long time to produce something smarter than ourselves. If the first strong AI is just a little smarter than us, and if it chooses to put its energy toward the creation of more AIs, then maybe it will eventually produce something smarter than itself. But it's not so simple that we just get to the singularity straight away.
The problem with people is multiplicative intelligence parity. (Like that phrase? Feel free to use it as your own.)
You can find one smart person. But how do you find another smart person for them to work with? With AI-level smarts, you reduce the coordination problem to zero since it can spawn multiple copies of its own brain state (maybe?) and work concurrently and intelligently on the same problem. Just ignore the problem of killing off divergent brain states once the task is complete (nobody cares about the life of a kage bunshin).
I sure could get a lot more done if I had five more of me (unpaid, of course) to tackle a problem all at once.
From the evidence of how fast new botnets spread, and the current prices of 0-day vulnerabilities we can assume that any strong-AI can easily get access to immense computing power (percentage points of globally installed CPU's).
The difference is that it can use them not for sending low-return spam, but for multiplying its power - even if it doesn't give a qualitative difference, there should be a quantitative difference (how many different tasks it can do at once) when a strong AI gains many orders of magnitude more computing power than any laboratory/datacenter where it was initially created.
Latency and bandwidth are going to suck and that might be important.
There's an assumption in most AI discussions that AI "must" be embarrassingly parallelizable. For example, much as my brain is parallelized, surely an AI would have to be the same way, much as all heavier than air human flight required was a faithful reproduction of bird anatomy (LOL).
There's also a certain assumption that intelligence implies a level of self awareness that most humans don't have therefore AI would be highly self aware...
There's also a whole industry of sophistry devoted to proving no humans are intelligent and IQ as a concept or any other numerical measure of intelligence does not exist and there is no way to compare intelligence, and right or wrong those folks will surely make life difficult for people improving / testing / upgrading an AI, either because they're right or they'll be making political protests.
strong-AI can easily get access to immense computing power
But is it the right kind of computing power? The human brain is a very different sort of machine, architecturally speaking, from any computer currently in existence. Current computers have a very difficult time dealing with massive, parallel, random data access. Perhaps strong AI requires billions of threads randomly accessing a database which is terabytes in size? That is going to make the memory bus very, very sad.
To begin with, it may not want to harvest more computational power. Even if, it may be initially too stupid to do this. Even if, the internet speed and small reliability of those nodes may make them unusable to this purpose.
No but it does mean it's possible to automate the work of further improving AI. It will also very likely be much smarter than human. Being exactly the same intelligence as a human is a very narrow target to hit.
On the other hand, I have a hard time thinking that anyone's going to treat virtual reality as all that cool after having seen The Matrix. Our culture now perceives "virtual" as something you're trapped inside, hiding you from the "real", rather than as a pleasant place to spend an afternoon shooting zombies.
Well people still think that NASA Mars mission is kind of cool even after seeing Star Trek and Star Wars. I didn't have a console, PC or powerful laptop for about 6 years. Next year I am going to buy one of those to go with my Oculus. I have tried it on one of the expo's for about half a minute. It's not super mind-blowing as I am spoiled, but it delivers what was promised and it is affordable. And now with Carmack working on it it gives me a hope of good old Doom times coming back (I want to fight demons not fashionable enemies of the moment).
It's going to be as usual: first hackers get it, then geeks, then it becomes a mass pop-phenomenon.
We are far, far from hard AI. If anything, this article shows that we're only just now starting to ask the right questions. And that's even debatable. Plus they're very hard questions.
The problem is we have no theory of intelligence, no theory of psychology. Research in the cognitive fields is fractured, all about tiny insignificant phenomena with little relation to anything else. Our best theory is "the brain is like a computer" which is, frankly, a terrible theory.
Here's something I find more promising: On Intelligence From First Principles: Guidelines for Inquiry Into the Hypothesis of Physical Intelligence [1]
In short, what we really need to understand is self-organization and non-equilibrium thermodynamics. Not image labeling.
I'm already familiar with some of his work. What did you have in mind specifically? In any case, he may be one of the best in the traditional computational approach to AI, but I think framing intelligence in terms of computation is inherently misguided. Of course I'm not going to get far with that unorthodox perspective on HN :)
I think the first true strong AI will come from research on non-equilibrium thermodynamics. We need to get down to the basics: where do entities come from that self-organize, more specifically that are able to use information in structured energy arrays to find and dissipate negentropy deposits, and dissipate that energy in order to maintain their own state away from equilibrium and hence avoid dissipating themselves? In short, strong AI will not come from top-down research on problem solving or learning, but bottom-up research on what makes autonomy and agency possible.
Goedel machines might actually be the closest thing to this in the computing literature, my reaction is less about the work itself than the rhetoric surrounding it, to be honest. JS should collaborate with a physicist on the thermodynamic side of the problem.
If you're intrigued, you could start with the article I linked above, or if you have journal access, anything from the same special issue. I chose that article just because it's the only one not behind a paywall.
Yes I think the same. Understanding how thinking machines self organise out of a set of sufficient conditions is very important. I am commenting mainly so I can read your link later.
I don't think we can have a theory of intelligence. At least in the public consciousness, intelligence is one of those "God-of-the-gaps" style concepts that continually evolves in order to maintain the illusion of human superiority.
Well, to the extent that it's a scientific problem, it sure would help to have a theory. I sure don't expect that theory to enter the public consciousness anytime soon, if at all.
But I do agree with your sentiment as far as the way intelligence is usually discussed, even among the science-literate.
Right. But how do you define it intensionally? Saying that "humans have a lot of it", "chimpanzees have less of it", "ditto for dolphins", "reptiles have very little of it", etc. is defining intelligence extensionally. Why is this a problem? Because an extensional definition doesn't tell you how to add new elements to the set.
I'll try: a system is intelligent if it is able to respond to low-energy deposits (information) with high-energy reactions (e.g., movement) in order to seek non-local sources of negentropy to dissipate.
But then again I'm more interested in the intelligence that differentiates a slime mold from a hurricane than the intelligence that differentiates a human from a chimpanzee.
For example: hurricanes are self-organized, constituted by a structured flow of energy and matter rather than specific pieces of matter. But a hurricane is a slave to the local potential. It will dissipate all the negentropy in its wake, and in doing so maintain its structure. But once there is no more energy differential to dissipate, the hurricane will itself dissipate as it is not able to break free of the local potential and use information to seek out non-local negentropy sources. The question for research is what is necessary to make that jump from self-organization to intelligence, given that operationalization.
Wind is a local potential in this example. An intelligent wildfire would be one whose sparks can go against the wind, because it perceives more fuel in that direction.
Also: my definition is meant to include fish and birds, even plants, as intelligent.
Either the blind person is responding to some low-energy distribution (scattered sound waves, perhaps, or past samplings of the energy distribution, i.e. memory) or the blind person isn't perceiving any more than the spark is (in this example).
In any case my post above implied a definition for perception: responding to low-energy distributions with an asymmetric high-energy response.
It's not just arbitrary examples, there is reasoning behind it. You can look at humans building spaceships and using tools and demonstrating understanding of abstract concepts. There are a number of tests you could do that would confirm something is intelligent like looking for any of those things.
Some rough and imperfect, but still useful, definitions of intelligence could be the ability to make good predictions based on past data, the ability to solve optimization problems well, and learning ability.
Right. That's commonly called the Turing test. This just pushes back the problem of defining intelligence to one of creating a proper Turing test. How do we do that?
The Turing test is actually a pretty decent and straightforward test.
I don't understand why this is an issue though. Testing intelligence was never the hard part of AI. There are so many tasks that computers currently suck at that we would be happy if they were solved, regardless what label you gave the solution. And I don't think many people could see a computer doing tasks like having conversations or solving difficult problems and deny that it is intelligence. Even if there is no formal test to perform that is 100% certain.
The point (maybe irrelevant to the larger discussion) is that as soon as we figure out how to implement intelligent behavior in a machine, it stops seeming intelligent. Chess used to be a prime example of intelligent human strategic thinking. Now it's just an item on that long list of things computers can beat us at (incidentally, I predict Jeopardy will go off-air sometime in the next 10 years due to declining interest now that we have Watson).
Once we figure out all the issues of general intelligence, it will stop seeming so special. We may even begin to think that humans are really bad at it afterall.
Chess playing programs worked because they use unfathomable amounts of computing power to essentially brute force the problem. I don't think there are any chess programs that play anything like a human does.
Because of this there are a number of games that computers still can't beat because just stupidly trying every possible move doesn't work like it does for chess.
Watson actually does use a lot of natural language processing and machine learning so it is kind of intelligent. Though at it's core it's still just a glorified search engine. Jeopardy was always just a game of memorizing facts, not a demonstration of intelligence.
I suggest actually looking into the architecture of deep blue and followon programs, because right now you are exhibiting the very fallacy I was talking about. Exhaustive search over board states would take longer than the lifetime of the universe to compute a single move.master chess for grams work by using sophisticated algorithms to manage the search process. it's not the process that humans use, but it is intelligent nonetheless. Of course now that it is a solved problem, the common perception is different...
It's a guided search, so what? There is no fallacy here, deep blue is not intelligent. You can solve any problem with enough computing power and a basic search. No one has ever claimed otherwise or said that it would be intelligent.
What people did predict wrong is that it would take general intelligence to solve chess. As in, if you solved chess, you could also pass the Turing test and everything else. Here is a quote from Douglas Hofstadter:
>There may be programs which can beat anyone at chess, but they will not be exclusively chess players. They will be programs of general intelligence, and they will be just as temperamental as people. "Do you want to play chess?" "No, I'm bored with chess. Let's talk about poetry." That may be the kind of dialogue you could have with a program that could beat everyone.
And they would have been right if computers hadn't become exponentially faster.
I spend a fair amount of time thinking about this stuff...
Currently, we've got machine learning--I think there's a market for it, but it's early. I think the near term is about automating data science tasks--we won't have a shortage of data scientists because we can automate much of what they do. Even that's a hard problem. Personally, I think deep learning (specifically relatively recent neural net related research) will play an important part in this--as far as automation goes, it will help automate feature engineering (currently a huge cost).
In general, I agree with the sentiment in the comments that "we are a long way from AI". Objectively, we are. However, I think we were similarly a long way from flight when the Wright brothers figured out how to keep a plane in the air. Or towards the end of the human genome project--although at least in that case, we knew what we were doing, whereas AI still doesn't really have a good theory behind it. The first software that seems awfully "AI like" though--I'm thinking that it could very well appear by accident while working on more general machine learning tasks. I don't think we're as far off as most people think, but I certainly don't have a crystal ball (and neither does anyone else)
Maybe in your second paragraph you're discussing science vs engineering? For example from a science perspective the Wright Bros got to check mark "flight" pretty decisively, mostly because of their windtunnel work, although the engineering has mostly failed for most of the species and most of the species has never flown and due to massive resource constraints probably never will, so defining "flight" as a success is iffy.
The genome project is another science to engineering transition problem, where the science check mark is done, but as far as I know there are no widespread engineering applications for the data at all, although someday there might be in the generic sense that all research is potentially useful.
Something like this could happen in AI. OK the science proves conclusively that it could work, its just human engineering might not be up to it for a few centuries (like the Babbage experience WRT computation) or even the engineering is possible but the economics and politics make it impossible (like building a massive power generation dam across the straits of Gibraltar) We could prove the science of AI works, and then nothing happens for the next 500 years. Or maybe not.
That's actually a really good idea, automating data science. Currently it takes a lot of technical knowledge and time/skill. There are a lot of even everyday things where just putting your data into a spreadsheet and asking it for predictions would be useful.
Talking about "the nature of startups" seems pretty shallow in comparison. It's like asking "how close are we to a Mars landing? What could it do to the nature of startups?"
It's funny to see this on HN, because I currently have a copy of one of Dr. Poggio's papers in front of me. I've got to say, from what I've read so far I've gotten more excited by his group's approach than any other's I've seen. If you are mathematically inclined and interested in AI, I highly recommend reading through some of his group's papers, which are available on their site[1]. For those of you commenting that we don't have any theory on how the brain does its magic, this new initiative should excite you because this group is actually approaching the problem from a far more rigorous theoretical viewpoint than before. Specifically, their theory of neurons storing both sample images and common transformations on them fits rather elegantly with what we know about the brain, and seems like a promising route to matching humans' ability to "learn" a new object from just one instance of it.
I think this should be re-stated that a group of respected researchers have revived Artificial Intelligence's original ambitions.
In fact, there have been a handful of folks thinking and working on Strong AI/Artificial General Intelligence steadily for years. Ben Goertzel even started the conference [1] and journal [2] in 2008.
One of the biggest things I see in every one of these conversations and threads is everyone assuming humans are actually good at things, as opposed to just marginally better than most other machines or humans. So people's standards for machine intelligence are way above what they would expect from human standards.
Google translate is a perfect example. People were complaining about it here on HN the other day because it wasn't perfect, however in comparison to any group of average professional linguists (Some of whom I work with daily) Google Translate and some of the other machine translation services' accuracy for it's speed is light years ahead.
People also forget that "Strong AI" and "AI complete" is always a moving target for benchmarking - and there is no benchmarking standard (No, a turing test isn't a robust enough test for an AGI). I posit that humans will never truly accept an AI as smarter than us until it dominates us. It will always be - well yes it can X, but is it really thinking? Does it have consciousness? Great questions philosophically, but practically it really doesn't matter.
This is good though, I think if there is anything the human race should be working on it's this. Everything, and I mean EVERYTHING pales in comparison in my opinion.
75 comments
[ 2.3 ms ] story [ 140 ms ] threadThe interesting question is: where is that upper limit on intelligence-per-FLOPS?
EDIT: Fixed it to "FLOPS". We already have AI algorithms that Solve The Problem if given unlimited "thinking time" between steps of interaction with their environment (up to the point of needing a Halting Oracle), and we have extensions of those that are asymptotically speed-optimal modulo some additive or multiplicative constants (which are larger than our current universe). I strongly suspect that scaling down these Idealized AI Agents to real, useful programs isn't going to just involve feeding raw instances of the Ideal Agents small enough environments to be tractable, but actually finding or deriving some algorithm that can scale continuously up and down with available computing power per unit of real time, where the time units are the actual real-time length of an interaction cycle.
To have a white-box learner would imply that humans were smart enough to build it. Yet it's unlikely that humans can build something significantly smarter than a human, so this AI would have the same limitation: It's unable (not smart enough) to build a smarter AI.
For instance, if you have infinite computing power, you just have to dovetail over every possible Turing Machine until one of them "wakes up" and does AI-y things. Yes, there are in fact real approaches based on a more sophisticated version of such a Universal Search.
In fact, we routinely make use of machine-learning algorithms that are "smarter than a human" in particular narrow domains. Are they smarter than a human at general intelligence, of the kind necessary to start looking more like a scifi "AI" than a cheap trick? No, but they are an indication that such a thing could be possible.
Overall, I would say that with Machine Learning maturing and Universal AI being a formal science at all, we are only just now beginning to find out where the actual tradeoffs lie in the design and construction of intelligent agents.
The speed of intelligence scales. But not the quality of it.
The quality of intelligence is something very hard to quantify. But as simply as I can state it, it's the quality of coming up with an idea that is not just an extension of an existing one, but an idea that came seemingly from nowhere. To someone else the idea appears magic, and no amount of thinking by that other person can lead him in a path that will end up there.
> but they are an indication that such a thing could be possible.
Real genius is not just "more" intelligence, it's intelligence of a different type that a non-genius simply can not do, no matter how they try. Analogously, just because a computer can do something fast does not give it that hard to define quality of true intelligence.
To make (rather than randomly search for) a computer with real intelligence we need to understand what it is, and where it comes from, and we don't know either one of those things. Our best (smartest) computers are all variations of "search randomly" (for example chess engines). Those can do some amazing things, but their limitations will not be overcome by doing more of the same.
> infinite computing power .. every possible
Talking about infinity is a total red herring and you know that - especially because if your method of increasing intelligence is "search randomly" then an AI will not be able to make a better AI - all it can do is continue the random search humans already started.
Well the good approach that requires a halting oracle is AIXI, which uses semi-approximable (IIRC on the terminology) Solomonoff Induction hooked up to an expectimax tree.
So it does have to examine every possible "universe" as a Turing Machine, but it uses proven-convergent probabilistic reasoning to get rid of the bad ones and raise good hypotheses to the top much faster than a universal search.
>The speed of intelligence scales. But not the quality of it. > >The quality of intelligence is something very hard to quantify. But as simply as I can state it, it's the quality of coming up with an idea that is not just an extension of an existing one, but an idea that came seemingly from nowhere. To someone else the idea appears magic, and no amount of thinking by that other person can lead him in a path that will end up there.
To be frank, before I'll believe this I want to see studies done on either humans or a mathematical examination of formal models of intelligent agents.
I think "never" is much too strong a word, considering that we seem to have a huge abundance of people capable of learning calculus even though few can rediscover it from scratch. There appear to exist very many people who would require such great efforts to learn certain things that doing so would be unpractical, but very few who simply cannot learn things no matter how much effort they put in.
You can find one smart person. But how do you find another smart person for them to work with? With AI-level smarts, you reduce the coordination problem to zero since it can spawn multiple copies of its own brain state (maybe?) and work concurrently and intelligently on the same problem. Just ignore the problem of killing off divergent brain states once the task is complete (nobody cares about the life of a kage bunshin).
I sure could get a lot more done if I had five more of me (unpaid, of course) to tackle a problem all at once.
The difference is that it can use them not for sending low-return spam, but for multiplying its power - even if it doesn't give a qualitative difference, there should be a quantitative difference (how many different tasks it can do at once) when a strong AI gains many orders of magnitude more computing power than any laboratory/datacenter where it was initially created.
There's an assumption in most AI discussions that AI "must" be embarrassingly parallelizable. For example, much as my brain is parallelized, surely an AI would have to be the same way, much as all heavier than air human flight required was a faithful reproduction of bird anatomy (LOL).
There's also a certain assumption that intelligence implies a level of self awareness that most humans don't have therefore AI would be highly self aware...
There's also a whole industry of sophistry devoted to proving no humans are intelligent and IQ as a concept or any other numerical measure of intelligence does not exist and there is no way to compare intelligence, and right or wrong those folks will surely make life difficult for people improving / testing / upgrading an AI, either because they're right or they'll be making political protests.
But is it the right kind of computing power? The human brain is a very different sort of machine, architecturally speaking, from any computer currently in existence. Current computers have a very difficult time dealing with massive, parallel, random data access. Perhaps strong AI requires billions of threads randomly accessing a database which is terabytes in size? That is going to make the memory bus very, very sad.
(Ai?)
But I forgot the exact reference (http://en.wikipedia.org/wiki/Dartmouth_Conferences) so I will now edit my original post to include the right numbers...
On the other hand, I have a hard time thinking that anyone's going to treat virtual reality as all that cool after having seen The Matrix. Our culture now perceives "virtual" as something you're trapped inside, hiding you from the "real", rather than as a pleasant place to spend an afternoon shooting zombies.
It's going to be as usual: first hackers get it, then geeks, then it becomes a mass pop-phenomenon.
The problem is we have no theory of intelligence, no theory of psychology. Research in the cognitive fields is fractured, all about tiny insignificant phenomena with little relation to anything else. Our best theory is "the brain is like a computer" which is, frankly, a terrible theory.
Here's something I find more promising: On Intelligence From First Principles: Guidelines for Inquiry Into the Hypothesis of Physical Intelligence [1]
In short, what we really need to understand is self-organization and non-equilibrium thermodynamics. Not image labeling.
[1] http://www.tandfonline.com/doi/pdf/10.1080/10407413.2012.645...
Goedel machines might actually be the closest thing to this in the computing literature, my reaction is less about the work itself than the rhetoric surrounding it, to be honest. JS should collaborate with a physicist on the thermodynamic side of the problem.
If you're intrigued, you could start with the article I linked above, or if you have journal access, anything from the same special issue. I chose that article just because it's the only one not behind a paywall.
I don't think we can have a theory of intelligence. At least in the public consciousness, intelligence is one of those "God-of-the-gaps" style concepts that continually evolves in order to maintain the illusion of human superiority.
But I do agree with your sentiment as far as the way intelligence is usually discussed, even among the science-literate.
But then again I'm more interested in the intelligence that differentiates a slime mold from a hurricane than the intelligence that differentiates a human from a chimpanzee.
For example: hurricanes are self-organized, constituted by a structured flow of energy and matter rather than specific pieces of matter. But a hurricane is a slave to the local potential. It will dissipate all the negentropy in its wake, and in doing so maintain its structure. But once there is no more energy differential to dissipate, the hurricane will itself dissipate as it is not able to break free of the local potential and use information to seek out non-local negentropy sources. The question for research is what is necessary to make that jump from self-organization to intelligence, given that operationalization.
Likewise for seeds, fish eggs (carried in the gut of birds), etc.
Also: my definition is meant to include fish and birds, even plants, as intelligent.
How does your comment about sparks address the alternatively stated requirement: "because it perceives more fuel in that direction"
* A spark flies out randomly and contacts a fuel source
* A blind person reaches out randomly and finds a glass of water
What is the essential difference between these events?
In any case my post above implied a definition for perception: responding to low-energy distributions with an asymmetric high-energy response.
Some rough and imperfect, but still useful, definitions of intelligence could be the ability to make good predictions based on past data, the ability to solve optimization problems well, and learning ability.
OTOH, looks like not very much was actually formalized.
What sort of test can show that a subject demonstrates an understanding of abstract concepts?
So far, from what I've seen, if a test can be written then software can be written to solve the test.
I don't understand why this is an issue though. Testing intelligence was never the hard part of AI. There are so many tasks that computers currently suck at that we would be happy if they were solved, regardless what label you gave the solution. And I don't think many people could see a computer doing tasks like having conversations or solving difficult problems and deny that it is intelligence. Even if there is no formal test to perform that is 100% certain.
How so? To me, it appears completely open-ended. You could sit there forever asking questions and never reach a definitive result.
Once we figure out all the issues of general intelligence, it will stop seeming so special. We may even begin to think that humans are really bad at it afterall.
Because of this there are a number of games that computers still can't beat because just stupidly trying every possible move doesn't work like it does for chess.
Watson actually does use a lot of natural language processing and machine learning so it is kind of intelligent. Though at it's core it's still just a glorified search engine. Jeopardy was always just a game of memorizing facts, not a demonstration of intelligence.
What people did predict wrong is that it would take general intelligence to solve chess. As in, if you solved chess, you could also pass the Turing test and everything else. Here is a quote from Douglas Hofstadter:
>There may be programs which can beat anyone at chess, but they will not be exclusively chess players. They will be programs of general intelligence, and they will be just as temperamental as people. "Do you want to play chess?" "No, I'm bored with chess. Let's talk about poetry." That may be the kind of dialogue you could have with a program that could beat everyone.
And they would have been right if computers hadn't become exponentially faster.
A related HN post from a few weeks ago: https://news.ycombinator.com/item?id=6605015
Currently, we've got machine learning--I think there's a market for it, but it's early. I think the near term is about automating data science tasks--we won't have a shortage of data scientists because we can automate much of what they do. Even that's a hard problem. Personally, I think deep learning (specifically relatively recent neural net related research) will play an important part in this--as far as automation goes, it will help automate feature engineering (currently a huge cost).
In general, I agree with the sentiment in the comments that "we are a long way from AI". Objectively, we are. However, I think we were similarly a long way from flight when the Wright brothers figured out how to keep a plane in the air. Or towards the end of the human genome project--although at least in that case, we knew what we were doing, whereas AI still doesn't really have a good theory behind it. The first software that seems awfully "AI like" though--I'm thinking that it could very well appear by accident while working on more general machine learning tasks. I don't think we're as far off as most people think, but I certainly don't have a crystal ball (and neither does anyone else)
The genome project is another science to engineering transition problem, where the science check mark is done, but as far as I know there are no widespread engineering applications for the data at all, although someday there might be in the generic sense that all research is potentially useful.
Something like this could happen in AI. OK the science proves conclusively that it could work, its just human engineering might not be up to it for a few centuries (like the Babbage experience WRT computation) or even the engineering is possible but the economics and politics make it impossible (like building a massive power generation dam across the straits of Gibraltar) We could prove the science of AI works, and then nothing happens for the next 500 years. Or maybe not.
[1] http://www.youtube.com/watch?v=3PMlDidyG_I
[1]: http://cbcl.mit.edu/publications/index-pubs.html
In fact, there have been a handful of folks thinking and working on Strong AI/Artificial General Intelligence steadily for years. Ben Goertzel even started the conference [1] and journal [2] in 2008.
One of the biggest things I see in every one of these conversations and threads is everyone assuming humans are actually good at things, as opposed to just marginally better than most other machines or humans. So people's standards for machine intelligence are way above what they would expect from human standards.
Google translate is a perfect example. People were complaining about it here on HN the other day because it wasn't perfect, however in comparison to any group of average professional linguists (Some of whom I work with daily) Google Translate and some of the other machine translation services' accuracy for it's speed is light years ahead.
People also forget that "Strong AI" and "AI complete" is always a moving target for benchmarking - and there is no benchmarking standard (No, a turing test isn't a robust enough test for an AGI). I posit that humans will never truly accept an AI as smarter than us until it dominates us. It will always be - well yes it can X, but is it really thinking? Does it have consciousness? Great questions philosophically, but practically it really doesn't matter.
This is good though, I think if there is anything the human race should be working on it's this. Everything, and I mean EVERYTHING pales in comparison in my opinion.
[1] http://www.agi-conference.org/2013/ [2] http://www.degruyter.com/view/j/jagi