The original AI reasoning challenge (ARC) that predates the one recently discussed here on HN by only a year has been solved. And I have no doubt that the new one will also be solved at some point in the near future. Every time someone comes up with a supposed "AGI test" and eventually gets beaten, they just move the goalpost instead of admitting that perhaps human intelligence is not so special after all. It will probably take something truly superhuman that vastly outclasses even the smartest humans in every conceivable way before the remaining majority of humanity will dare to admit that they are now the lesser intelligence.
Your opinion is based on hype, not actually understanding the problems.
The original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks.
The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple.
We are clearly missing something and acknowledging that has nothing to do with admitting we’re the “lesser intelligence”. Frankly your comment sounds cultish.
Lots of people seem to have forgotten that not long ago, these questions were practically unsolvable even by the best models. Similar to how a few years before that it was impossible to come up with a model that could reliably distinguish between between cats and dogs. The frontier is moving all the time and no concrete evaluation has stood the test of time so far.
They said ARC should be beaten in the near future. I don’t think it’ll be as easy as they say since we’ve been using transformers for awhile and they still fail pretty bad at the test.
17 comments
[ 96.8 ms ] story [ 1955 ms ] threadThe original ARC is “grade-school level, multiple-choice science questions” which is not much different than existing benchmarks.
The new ARC is different because it’s resistant to memorization and, as a result, modern AI algorithms do terribly even though the problems themselves are very simple.
We are clearly missing something and acknowledging that has nothing to do with admitting we’re the “lesser intelligence”. Frankly your comment sounds cultish.
> Your opinion is based on hype, not actually understanding the problems.
That's pretty strong wording, easily tantamount to saying it's impossible/improbable