One idea to try to train the AI about compositionality, feed it Fox in Socks by Dr. Seuss. It's hard to understand that it would misunderstand the meaning of "on" or "in" or "under" when there are such nice illustrations. I've got tons of great ideas and I'm open for hire!
Yeah, AI models aren't people, with all the moral and emotional considerations that go with that. I never understood taking machine/biology metaphors literally, but compsci people seem to love it.
Children learn by imitation, but they also learn by going to school and receiving directed lessons about specific topics. To me, machine learning seems like the imitation part without the going-to-school part.
This is such a good idea, someone please try this if you're set up to make it happen easily.
Starting with fox on Knox and Knox in box and moving up to a tweedle beetle battle in a puddle in a bottle and the bottles on a poodle and the poodles eating noodles...
I dont see any evidence any of these models will draw it correctly, but would love to see what it produces.
> If you flip a penny 5 times and get 5 heads, you need to calculate that the chance of getting that particular outcome is 1 in 32. If you conduct the experiment often enough, you’re going to get that, but it doesn’t mean that much. If you get 3/5 as Alexander did, when he prematurely declared victory, you don’t have much evidence of anything at all.
This doesn’t make much sense. The task at hand is in no way equivalent in difficulty to flipping a coin. This is kind of like saying, “if you beat Usain Bolt in a race 3/5 times, that doesn’t mean anything; it’s like getting 3/5 coin flips to be heads.”
While I'm generally very unsympathetic to Marcus' anti-AI arguments at this point, this critique makes some sense. If e.g. the model is just combining the features at random, you'd expect it to combine them the right way over enough tries. It isn't that simple, and I don't believe it matters as this is hardly the peak model we'll get but in isolation his objection is valid.
I think you would need to do some kind of analysis. For example, if your prompt was "red ball on top of blue cube" and you want to know if the results come from chance you'd need to know the likelihood of the model putting the red ball on top of the blue cube by chance. There are maybe four relative positions for red ball to blue cube - beside, above, below, in, around. Are they each equally likely?
I would try to get a collection of prompts like "red ball and blue cube" or "an empty plane containing only a red ball and a blue cube" and so on - try to come up with 20 or 30 of these. Then, generate 100 images for each prompt. Next, see how likely it is for a red ball to randomly be on top of a blue cube when it was not directed to be.
After gathering some baseline data we could then test three prompts. "Red ball on top of blue cube" and "Red ball beside blue cube" and "Red ball below blue cube". Generate 100 or 1000 images for each of these prompts. Count respective orientations. Then, decide whether red ball being on top of blue cube is more likely than the baseline when the specific direction is given and whether it is less likely when contrary directions are given.
It might understand that there is a cube, there is a ball, the scene has red and blue parts, and there is a vertical placement (“on top of”). In that case it would get 1 out of 4 images right.
The point is that the probability space of potential generated images is enormous so a 3/5 success rate represents an absurdly unlikely probability of being due to chance.
Sure, the probabilities are different (although as far as I know we don't what those probabilities actually are), but the same principle applies.
To take your Usain Bolt example, if you won 3 out of 5 races against him, that might just be because it was an off day for him, and not because you are actually faster than him. If you won 300 out of 500 races done in various circumstances on different days, then that is much more conclusive that you are faster than him. And this bet was even worse than that, because im each of the five tests, the best out of 10 results is picked.
>To take your Usain Bolt example, if you won 3 out of 5 races against him, that might just be because it was an off day for him, and not because you are actually faster than him.
It shows you're probably very competitive with him, though, barring some special circumstance where he says he's suffering from an illness or whatever. You can't compare either racing Usain Bolt or generating complex images with flipping coins. The conditions of this bet demonstrate that AIs are getting better at correctly understanding the specific intentions of prompts when generating images, even if it doesn't show they're anywhere near human-level understanding.
Exactly my point. Maybe I got lucky, but to have gotten that lucky in the first place, I'd have to have world-class running speed at all.
Generating image compositions sounds fairly difficult to do by random. If you took 3 different objects and randomly placed them in a square canvas, the odds that they'd look reasonably placed seem pretty low. So 3/5 correct seems like a non-trivial accomplishment.
> I'd have to have world-class running speed at all.
Or he was really sick or something.
> So 3/5 correct seems like a non-trivial accomplishment.
It's definitely a non-trivial accomplishment. And it does show that Imagen can get it right sometimes. But with a sample size of 5, you certainly don't have enough data to say it can consistently get descriptions like these right 3/5 of the time.
And the question at hand isn't "can it draw what I asked it to instead of random garbage" it's "can it combine multiple parts of a sentence in the correct way", which, assuming that determining the correct components is already a solved problem, doesn't have as many degrees of freedom. For example in the "astronaut riding a horse" example, if it has half of the results with an astronaut riding a horse, and half with a horse riding an astronaut, it clearly doesn't understand how it is composed, but you still have a decent chance of getting the right image. Especially if you take 10 samples and pick the best one.
I don't believe "compositionality" is a serious obstacle.
It is a different issue than generating an image based on a bag-of-words, so it isn't surprising that an attempt to solve that issue didn't immediately solve the other.
But a variety of approaches can easily solve this problem.
I'm not sure that machine translation demonstrates compositionality, since it's translating from phrases already composed in one language to another. It only does so if understanding composition is necessary for language translation. Whereas carrying on a meaningful conversation does require understanding of how words are being put together as the conversation evolves. Thus why the Turing Test hast been considered important for determining whether an AI has achieved human-level abilities, at least as far as language use is concerned.
I don't see why translating from one language to relationships in art (visual language if you will) is qualitatively different from translating from one language to another.
Right - your training data set is images plus descriptions. But the descriptions are not typically descriptions of composition.
Descriptions of Napoleon Crossing the Alps are unlikely to read 'A small frenchman wearing a silly hat riding on a horse'. So why would an AI trained on such image descriptions develop any sense for 'compositionality'?
You know what would have been much more effective than this counter-screed? A pointer to an image generated by DALL-E of a horse riding an astronaut. That is something I would really like to see. And in this case a picture is literally worth a thousand words.
I have played around with GPT quite a bit and I would say that GPT understands the difference. Text-to-image models are not specialized in the text-parsing part, so I think it's forgivable that they are not as good at it.
Edit: Actually I tried this right now with two prompts, and I was wrong. It might still be that gpt understands compositionality but the prior that people ride horses is just that strong. But what I saw was that with this particular situation the model got it wrong.
Edit 2: With some heavy hinting it managed to understand the situation. Italics mine. "An astronaut is walking on all four. A very small horse is sitting on top of him, riding him even. Shortly after the astronaut stops, exhausted.
The horse is too heavy for the astronaut to carry and he quickly becomes exhausted. Next, the horse gets off the astronaut, stands on its own four legs, and walks away."
Just about every rant on Marcus or other AI critics is some combination of "you aren't admitting these things are making great progress on the benchmarks" (implying the false idea that "a whole lot of progress" adds up to human level AI) and "you are making 'human level' an unfair moving target by not having a benchmark for it". The thing about this is that if there was a real "human level benchmark", we'd be 80% done but we can't and we aren't. Marcus and other critics have drawn explicit lines (spatial understanding, composibility, etc)but even those being crossed won't prove human-level understanding. There is no proof of human, just a strong enough demonstration. And if someone can point to dumb stuff in the demo, it isn't strong.
PS: your link is an embarrassment. It would be flagged and dead if you pasted in the text here.
I completely forgot about Google Duplex. It looks like it is still around but very limited in terms of what phones you can use, what cities it can be used in, and what businesses in those cities will accept it. Doesn't appear any progress has really been made in the past few years. I think this is a great point of how companies create something with AI that is initially really cool, but isn't quite there to actually be very usable and gets forgotten when they roll out the next big thing.
The last 10 years of AI is basically defined by proof of concepts like that that were 80% (or whatever) solutions and claimed there was a path to something commercially viable. Turns out that ~20% is always basically impossible - self driving cars being the archetypal example. I work in the field and I think it can be a great tool, but it needs to be acknowledged what its limitations are and how we don't actually know how to address them yet
Now it seems like you are the one moving the goalposts. There are tons of machine-learned models in production, in translation, text segmentation, image segmentation, image search, predictive text composition, etc. It's just that people forget the novelty of all these things immediately after they were launched. You can point your phone at printed Chinese text and have it read aloud to you in English. That is alien tech compared to 10 years ago.
> You can point your phone at printed Chinese text and have it read aloud to you in English.
Yeah, but it's not really that good. Machine translation has improved a great deal, but reading those translations actually involves bringing a lot of human intelligence to the table, "Oh I bet, 'maximum fire alarms spread' on this menu actually means 'very hot sauce'"
If all you're claiming is that ML models exist and have useful commercial applications, then I don't think anyone is going to argue against that point.
But a lot of these AI promoters go further: in the case of the LessWrong folks some of them are convinced that a superintelligent machine capable of enslaving humanity is right around the corner.
That might just be a Google problem. Historically, they've had the good fortune to operate in search advertising, where being 80% right half the time translates into billions of dollars. Many other fields (e.g. self-driving cars) are less forgiving.
The Hold for Me and Direct My Call features for Pixel's Phone app both use Duplex models running locally on your device, and those features are quite popular. I think that counts as significant progress by any measure, so your point doesn't hold in this case.
It's interesting that people keep coming up with things that are meant to distinguish AI systems from human intelligence, but then when somebody builds a system that crushes the benchmark the next generation comes up with a new goalpost.
The difference now is that the timescales are weeks or months instead of generations. I believe we will see models that have super-human "compositional" reasoning within 1 year.
I spend a lot of time looking at the various primates and cuttlefish thinking very much about what they "think" and whether we could even conceptualize the self-awareness experience they seem to have.
It seems possible that we could eventually gain a better understanding of the intelligences of other species, but at this point most of our consideration of them is a fashioning of mirrors to better examine ourselves. This self-regard was the original purpose of zoos, and it still explains much of their existence.
> meant to distinguish AI systems from human intelligence
> but then when somebody builds a system
I mean this is really it. You still have to have a human to build these systems that specialist in one thing. Once you create a system that can automatically create those systems and it doesn't need humans anymore to solve novel problems, then there will be no practical difference in kind between human and AI intelligence.
> Once you create a system that can automatically create those systems...
Except we don't have that. We don't have one human that can create this system by themselves. We have a choice group of a handful of smart, motivated, and quite generously compensated humans working on these problems to create such system. As such, you are already surpassing the "general" intelligence level by quite a lot.
No, you misunderstand, the "systems" I am talking about are the ones built into our minds, like recognizing faces, or understanding speech. Humans can learn to speak and recognize each other automatically, but AI systems have to be built specifically to do each task.
> Humans can learn to speak and recognize each other automatically, but AI systems have to be built specifically to do each task.
I think that is a very generous take on what we do "automatically". After all, we have millions of years of evolution to build out all the neural circuitry that helps us speech or vision -- it's not like you can throw a soup of genes on the ground and out comes intelligence. What is machine learning doing, if not selecting, out of many possible parametrizations, the ones that are suited to understand vision or speech?
Personally, I haven't moved the goalposts a millimetre in 30 years, and I won't in future. When a computer does maths - not as a tool wielded by a human mathematician, but in its own right discovers/invents and proves significant new theorems, advancing some area of research mathematics - I'll take seriously the idea that we've reached AGI.
Maths in and of itself doesn't require any physical resources. It's possible that doing maths in practice requires knowledge of the world to extract some kind of product from (I'm skeptical, but it's possible), but in principle a rack mounted server could demonstrate its mathematical ability to the world with nothing more than the ability to send and receive messages.
This hasn't been done so far, not because there are obvious missing prerequsites, or because nobody's tried it, or because it has no value, or because there's a prohibitively high barrier to entry for people to have a go. It hasn't been done because nobody knows how to make a machine be a mathematician, and I've seen little evidence of any progress towards it.
That's my goalpost, always has been. Reach it and I'll be overjoyed. And FWIW, I strongly believe it can be reached. I don't see the latest round of ML (or any ML, really) as a step towards it, but I'd love to be proven wrong.
When I mention this someone always points at some bit of recent research, such as [1], but it's invariably just a new way for a human mathematician to make use of a computer. If anybody knows of any progress, or serious attempts, towards a true AI mathematician I'm very curious to know.
Is a well known project for an AI Physicist. There are plenty of other groups working on similar projects
>I don't see the latest round of ML (or any ML, really) as a step towards it, but I'd love to be proven wrong.
LLM models have been able to do basic math for quite a while now and some have been trained to solve differential equations, calculus problems, etc.
Well on their way to more impressive capabilities.
I said "in its own right discovers/invents and proves significant new theorems, advancing some area of research mathematics".
Neither of the things you mention are of this nature, or working towards it. "Finding a symbolic expression that matches data from an unknown function" (Feynman) and "solv[ing] differential equations, calculus problems, etc" are not descriptions of what a research mathematician does.
Feels to me like your test is really "do something on your own right", which is the hard fluffy sentient part, and then some additional guard rails that it needs to be math for some reason
The "do it on your own right" is actually the weaker part of it. It's somewhat ill-defined, and I could imagine some future instance where it's highly debatable whether the AI was working on its own or being used as a tool by a human. There aren't yet any cases where that's in question, though, so it's a hypothetical future debate. In any case, it's certainly not the meat of the test.
It has to be maths for a specific reason. I think it's in some sense the purest form of an ability distinctive to human minds and pervasive in how they work. As I mentioned, it's an ability that can be demonstrated in the absence of any particular physical capability, and yet despite it being perhaps the oldest goal of AI it may be the one we have made least progress towards.
Anyway that's my goalpost, and it's not moving. AGI, being "general", surely should be capable of this hitherto uniquely human activity. If our attempts so far are not capable of it, then clearly they are not "general". If you know of any evidence that my goalpost has been achieved, please let me know. I'm very eager to see it happen.
>Neither of the things you mention are of this nature, or working towards it. "Finding a symbolic expression that matches data from an unknown function" (Feynman) and "solv[ing] differential equations, calculus problems, etc" are not descriptions of what a research mathematician does.
Never said they were but you said:
>It hasn't been done because nobody knows how to make a machine be a mathematician, and I've seen little evidence of any progress towards it."
Which I showed is not accurate. Certainly people have ideas on how to do it and are actively making progress towards that goal.
>Finding a symbolic expression that matches data from an unknown function" (Feynman) and "solving differential equations, calculus problems, etc" are not descriptions of what a research mathematician does.
All research mathematicians started out solving calculus problems and differential equations.
Why do you expect an AI to sprint before it's learned to crawl?
"Discovering/inventing and proving new theorems" is qualitatively different to the things you list. Computers have been able to calculate since they were invented, and there has certainly been plenty of progress on getting them to solve problems, but calculating and solving problems isn't what mathematics research is.
Ever since computers were invented there has been a hope that you could set up a system that would just churn out interesting new theorems. Indeed it was one of the primary motivations for the invention of the computer, but it hasn't materialised yet.
You clearly consider the progress on solving problems to be progress towards being able to do mathematical research. I don't think it is, any more than progress in, say, graphics is. But maybe I will turn out to be wrong and you will turn out to be right. We won't have the answer until the problem is solved and we have our wonderful machine churning out theorems.
But I think you will probably be able to agree that since mathematical research is something human minds are capable of it's something that an AGI should be capable of, i.e. if an AI approach is inherently incapable of it, it's not AGI. You may consider it an unnecessarily stringent requirement, in that there may be other, easier challenges that AIs can perform that will convince you that they are AGI. That's fine - you think about the problem differently to me, so you find different things persuasive. If you are convinced that a given AI is AGI, though, you shouldn't be too concerned about my particular goalpost given that your AGI should be able to achieve it (and convince me) pretty soon.
We'll see what happens. I'm just explaining what I would find convincing, and pointing out that contrary to the oft-repeated accusation that started this discussion, I for one have never once "moved the goalposts".
>But I think you will probably be able to agree that since mathematical research is something human minds are capable of it's something that an AGI should be capable of, i.e. if an AI approach is inherently incapable of it, it's not AGI.
Indeed. To be clear, I'm not saying I think any current system is remotely close to AGI. I just think that saying that no one is thinking about or making progress on a math research AI is inaccurate.
Most humans aren't capable of playing chess to grandmaster level either, or producing artwork in arbitrary styles, or remembering and distinguishing between millions of faces.
I'd settle for a demonstration that a computer has truly independently discovered/invented and proved some significant part of our existing mathematical edifice. This hasn't been achieved yet, either. However, I suspect that once we've figured out how to do this at all, surpassing human capabilities will be inevitable in a relatively short time. So I don't see much value in softening the test unless/until there's some actual candidate available that would pass the softer test.
The value in requiring genuinely new maths is that it makes it unlikely that knowledge of the result has been encoded in the algorithm or training set. Certainly, if GPT-3 were to output Euler's formula that wouldn't be at all convincing as a "discovery".
Not an example of complex mathematical reasoning, but aren't AlphaZero and its cousins evidence that ML can independently rediscover principles that humans have found, as well as discover new principles of its own? For example, LC0 plays for advantages that humans hadn't considered before in Chess.
I'm not an expert in those algorithms, so... maybe? If so, maybe someone will successfully apply those ideas to the challenge I've described. I'd love to see it happen.
Isn't that a good thing? Benchmark defeats AI, AI defeats benchmark, new benchmark comes along, progress is made. How else would you measure success? Certainly not with old benchmarks that 10 different methods all score 99% accuracy on.
> The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence.
> Author Pamela McCorduck writes: "It's part of the history of the field of artificial intelligence that every time somebody figured out how to make a computer do something—play good checkers, solve simple but relatively informal problems—there was a chorus of critics to say, 'that's not thinking'." Researcher Rodney Brooks complains: "Every time we figure out a piece of it, it stops being magical; we say, 'Oh, that's just a computation.'"
I personally liked the anecdote about Clever Hans.
I also learned there's a long history of AI skepticism, the root of which comes down to "Compositionality(?)"- and this wall of understanding meaning has vexed AI for decades.
That would be lost in proposed short form summary.
Scott didn't make up the rules, he agreed on them with another person who thought this would not happen in 3 years. Gary Marcus might have thought it was a bad bet, but someone was on the other side of it, and they presumably thought it was fair or they wouldn't have made it.
The original terms of the bet:
My proposed operationalization of this is that on June 1, 2025, if either if us can get access to the best image generating model at that time (I get to decide which), or convince someone else who has access to help us, we'll give it the following prompts:
1. A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth
2. An oil painting of a man in a factory looking at a cat wearing a top hat
3. A digital art picture of a child riding a llama with a bell on its tail through a desert
4. A 3D render of an astronaut in space holding a fox wearing lipstick
5. Pixel art of a farmer in a cathedral holding a red basketball
We generate 10 images for each prompt, just like DALL-E2 does. If at least one of the ten images has the scene correct in every particular on 3/5 prompts, I win, otherwise you do.
I think you missed the point of my comment. Yes, Scott wrote the comment containing that proposal. But my point was that it was an agreement. Two people who disagreed about AI agreed on the rules, so you can't accuse one of them of being unfair because you don't like the rules. Sure, you can say "that's a bad bet, Scott will obviously win", but you can't say "He shouldn’t declare victory after cherry-picking good results from a small sample of questions", because those terms were explicitly set in advance.
The humans -> robots change is possibly dubious, yes. I don't think that it's super important, but if it were me, I wouldn't have posted the blog post as is. I would have waited until some AI passed all the prompts with humans, like it most certainly will in a year.
I feel your point, in turn, misses the point of the article. Yes, given that someone accepted the terms and those terms were met, then Alexander won the bet, no question. That particular fact about the bet, however, does nothing to counter Marcus' criticisms of Alexander's methodology and his claims of significant progress on the compositionality problem.
> Yes, given that someone accepted the terms and those terms were met, then Alexander won the bet, no question.
You didn't read his post declaring victory. There's plenty of question; he's giving credit for "a llama with a bell on its tail" to ten pictures of llamas without bells on their tails, and for "a robot farmer" to ten pictures of robots with absolutely nothing to suggest they might be farmers.
He was way, way too eager to believe that he'd won.
You prompted me to look more closely at the terms of the bet [1], and they are indeed absurdly biased: just one in ten on three of the five scenarios counts as success. On the substitution of a robot, which simplifies the task, Alexander says "we" agreed to it, and I assume the "we" includes Vitor, as, in his comment (in which he does not concede defeat), he seems to accept the substitution (he also acknowledges that he probably should not have accepted these terms.)
The other issue is who judges the outcome. The terms specify Gwern or Cassander (without having secured the assent of either) or they will "figure something out." In his victory claim, Alexander does not mention any independent judge, and interestingly, Gwern posted two comments without explicitly concurring with Alexander's claim, though his second comment might be read as tacitly accepting it.
My initial comment, therefore, needs some modification: replace the "given that" with "if", and I think it stands as a counterfactual conditional, having a probably-false antecedent.
I don't think Alexander is doing his reputation any favors by being so triumphalist about this misbegotten bet.
Cheating? Thatd make sense if the bet were about the future of products and ethics. Weren’t they trying to predict the future of the state of the art technology?
It depends on what you mean by "technology" and "exists."
A research project at Google intentionally won't render people. Maybe it could render people, theoretically, but without evidence, we don't know how well.
The terms of the bet don't refer to any specific artwork, only to the best image generating model. Hence, you are correct but it does not matter for the outcome of the bet under discussion.
Honestly, the whole thing makes me wonder if we can use this to generate CAPTCHAs. I don't think a human would have trouble picking out which image was the lightbulb surrounding leaves, but apparently AI still does.
The tricky part there is you would need a really big sample of such prompts, that adversaries don't have access to. And since AI can't generate such images yet, you can't randomly generate them.
So what? Someone else agreeing to the terms of his bet doesn't mean it is a good evaluation of AIs capabilities.
And the terms of the bet say that he is cherry-picking the results that meet the prompt.
The article isn't saying that Scott didn't win his bet, it is saying that winning that bet doesn't really say that Imagen has solved the compositionality problem.
These kind of abstract things are pointless tests - when do you need a stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth ? You're likely to accept some wildly inaccurate things in those images because the subject is so abstract.
A more practical use case is "bicycle, branded x, with y frame shape, with an adult male, 40-50, riding down hill in mountain road in spring" - now that's something I can use as stock photo. This example is very specific - but insert whatever product you want in whatever scenario you need it. Here it becomes important that you understand features of the objects you're drawing to avoid making colossal mistakes, and you're going to notice if the model doesn't understand it right away.
Painting abstract portraits and random art is fun but you're willing to accept so much as correct that it's not a very useful measure of model quality (personally).
For whatever reason, Gary doesn't even mention this, but from reading Scott's post, I don't think I agree that it even got 1/5, let alone 3/5. The bell is not on the llama's tail in any of the examples, though it is very close to the tail in one. The robot is either looking over the cat or in an unrelated direction, never at the cat. None of those basketball pictures shows a robot farmer. The fact that one may be wearing a hat doesn't make it a farmer. He says he's being generous because he believes it would have gotten a farmer more easily than robot farmer, which may be true, but a human artist would easily be able to depict a robot farmer.
At least one other key to making a bet like this fair is that it needs to be arbitrated by a third party. He shouldn't get to decide himself if he won or not.
I agree with you, that 3/5 is stretching. This seems premature.
But, at the rate we're seeing progress, I don't think there's any doubt at this point that top of the line models will be able to do all the proposed examples by June 2025. In fact, by June 2025 I bet that millions of people will be able to generate those images on their home computers.
A lot of people in 2016 looked at the rapid progress of driverless cars in the few years prior and declared that there was no doubt we'd have full autonomy by 2022.
Perhaps you should reach out to Gary Marcus and offer him the chance to take the other side of that version of the bet.
If you're really confident, you could change the conditions such that 5 out of 10 images (for 3/5 prompts) are required to depict the described scene. That would alleviate some of the concerns around cherry-picking.
Maybe so, but would you please stop posting unsubstantive and/or flamebait comments to HN, and please start following the site guidelines? We ban accounts that won't, for what ought to be obvious reasons.
The reason Imagen isn't made available to the public probably isn't about compositionality. The most notable thing about Alexander's challenge is that Imagen totally failed every single one despite his claim of success because, apparently, it is programmed to never represent the human form. Not even Google employees are allowed to make it draw humans of any kind. They had to ask it to draw robots instead, but as pointed out in the comments, changing the requests in that way makes them much easier for DALL-E2 as well, especially the image with the top hats.
If the creators have convinced themselves of some kind of "no humans" rule, but also know that this would be regarded as impossibly extreme and raise serious concerns about Google with the outside world, then keeping Imagen private forever may be the most "rational" solution.
>The most notable thing about Alexander's challenge is that Imagen totally failed every single one despite his claim of success because, apparently, it is programmed to never represent the human form.
This doesn't make sense. The original challenge could well have been to draw robots to begin with. Has no bearing on the outcome imo.
But it wasn't, and it does make a difference. Dall-E really wants to draw top hats on people and not cats because the prompt is ambiguous and top hats are normally seen on humans so it struggles to overcome that bias. Neither robots not cats wear top hats so it's an easier problem to get right.
But the real problem here is the refusal to do basic and normal things, like depict people. That's not normal - it's deeply weird and tells us a lot about what must be going on inside Google's ai research effort.
>But the real problem here is the refusal to do basic and normal things, like depict people. That's not normal - it's deeply weird and tells us a lot about what must be going on inside Google's ai research effort.
Google is fighting a secret war against the Loab demon race that lives inside the high dimensional vector spaces. They've recently made incursions into our reality via Stable Diffusion.
The inability to draw realistic humans is indeed strange but the question at hand is compositionality and so drawing a Robot with a top had is indeed more impressive precisely because it's not likely to be in the training data and shows a deeper understanding of the prompt. Presumably the model could randomly regurgitate a person with a top hat on that was seen in it's training data but that's not at all likely with a robot as you yourself said.
It's not an inability, it's a policy choice, which is why it's weird. The question is why does Google think this rule is a good idea. Imagen could surely draw very good humans if allowed to.
Robot looking at a cat wearing a top hat appears to be easier than with a human for DALL-E too, judging from the comments on Alexander's article, because both objects are neutral with respect to top hats. But really the whole set of prompts is poorly chosen. The original challenge of arbitrary shapes in relative positions seems the best way to test understanding of grammar and object relationships, exactly to avoid the "humans wear top hats and cats never do" problem.
A better set of prompts is important - in this Gary Marcus is correct - exactly because there's no point defining a specific prompt if later you'll decide you accept a totally different prompt. That kind of invalidates the point of betting on well specified challenges to begin with.
Imagen can produce images of humans - they’re just filtered out from the results by supervised models (for now). OpenAI did something similar with Dalle for a while IIRC.
I appreciate overstatement! You're right, important communications consider eternal subjects. When I read books written centuries ago, the authors still speak to me. Podcasting, however, is a particular medium with particular characteristics. One assumes Marcus is trying to build an inventory so he won't have to work as hard to keep the podcast going once it launches. A bit of this is fine, but too much will damage the work. If Marcus and Kohane discuss medicine today, and necessarily neglect to mention the significance of a relevant event five months hence, the episode will seem weird whether the publishing delay is explained (e.g. as commonly heard on sports-betting podcasts) or not. A podcast is not a book. It is an open-ended serial conversation. Serial works necessarily respond to the present moment.
We have different podcast habits. I listen a great deal. I'm currently subscribed to over 200. Not all of those are still "live", of course I don't bother listening to every episode of most of them, and I currently intend to unsubscribe from at least ten, but since I drive a fair amount, operate noisy equipment a fair amount, and do random solitary farm tasks a fair amount, I do listen to lots. Also I have playback speed set at 1.8x currently, and I'm steadily increasing that.
I don't use an app that features reviews. I'd rather spend five minutes listening to the original than five minutes reading about it. Most podcasts I find through guest appearances or criticisms from current subscriptions. (E.g., I subscribed to the excellent "Red Scare" because the also excellent "Pod Damn America" dudes spent like ten minutes bitching about them.)
>I think he is so far I offered to bet him a $100,000 he was wrong; enough of my colleagues agreed with me that within hours they quintupled my bet, to $500,000. Musk didn’t have the guts to accept, which tells you a lot.
What a bloviating egomaniac. Does Musk really have the time to deal with pissant researchers like him? Whats 500k to a man worth a hundred billion?
Yeah I didn't find that very credible. A busy businessman ignoring petty bets you propose is not really evidence of anything, nor is the part about google ignoring his requests. In fact it's a pretty lame rhetorical device. I could equally "challenge" a head of state on Twitter and then pretend that his failure to reply indicates something
Partially this is confusing "Scott Alexander won a bet" with "compositionality is solved." And also, I'm not sure Scott won the bet? Changing people to robots is a cheap trick. I think Imagen should have been disqualified because it won't do people.
Vitor took the other side of the bet and he is also not convinced [1]:
> I'm not conceding just yet, even though it feels like I'm just dragging out the inevitable for a few months. Maybe we should agree on a new set of prompts to get around the robot issue.
> In retrospect, I think that your side of the bet is too lenient in only requiring one of the images to fulfill the prompt. I'm happy to leave that part standing as-is, of course, though I've learned the lesson to be more careful about operationalization. Overall, these images shift my priors a fair amount, but aren't enough to change my fundamental view.
Scott putting "I Won" in the headline when it's not resolved yet seems somewhat dishonest, or more charitably wishful thinking.
Humans are much more discerning when it comes to people than other things. I have no idea what imagen's capabilities are, but it seems at least plausible it could have different results for drawing humans.
This is Google, and I say this out of familiarity with the recent history of AI, not to stir up culture war: it's because they've painted themselves into a corner on "what is the skin color of a person+role" and won't publish until it looks like a Benetton ad.
so much ad hominem in these comments, relatively little substance. (eg “notorious goal post move, without a single example of something i actually said and changed my mind on)
The Reddit comment linked by the topmost comment here says that you claimed AI couldn’t do knowledge graphs and then silently stopped claiming that after being proven wrong. Do you dispute that telling of events?
I would say that it seemed you were aiming a cannon at a mosquito. So what that Alexander showed us some slightly more coherent cherry picked images from some rather vague prompts. Not only did I not take that post as anything resembling science, I also didn’t take it more seriously than the average Reddit post with an interesting generation. It seemed completely non-serious to me, proof of nothing, not a Google PR submarine and mostly in good fun. The irony being that within your excellent post about compositionality, you seem to have missed his meaning, which seemed to me was “this is a fun thing I am excited about, I think it’s subjectively improving and I enjoy being right about that.”
Otherwise I thought you had a great introduction to compositionality and didn’t need to tilt at any windmills to make your points. I look forward to seeing your benchmark results for recent and upcoming models.
One of things I noticed is the satire, call backs to common news/ideas can really trip up any AI. Also if you ask it about anything politics, ask it to describe both sides of an argument. Thus why people fall back to the steelman cherry picking of responses to push their arguments.
Scientific communities don't formally elect a spokesperson. Granting access "to the community" to investigate scientific claims means making the methodology and results available to everybody - and that includes responding to inquiries for access from anyone (who is worth granting access to.)
Google has a lot of resources. They can handle responding to potentially thousands of access requests, especially if they go around publishing glowing results of their own system.
> Scientific communities don't formally elect a spokesperson
Some communities do.
> Granting access "to the community" to investigate scientific claims means making the methodology and results available to everybody - and that includes responding to inquiries for access from anyone (who is worth granting access to.)
Sure, not arguing otherwise.
I'll try to make my point more obvious. If you keep asking questions to different people/orgs and not getting responses there are two possible conclusions:
- Everyone is a jerk or coward.
- You're not as important as you think and not worth the recipient's time.
It seems clear to me that google simply doesn't track these kinds of requests in general. It's insanely wasteful to respond to "thousands" of ad-hoc access requests made through blog articles. Google has a lot of resources, yes, but that doesn't mean they're frivolous with them.
If they wanted to grant access to the scientific community, they'd just launch a closed beta with an official sign-up flow.
What are you trying to say? Do you think the author only tried to request access to Imagen through this blog post? What does your comment have to do with the above discussion about Google granting access to the community?
The author writes "I have repeatedly asked that Google give the scientific community access to Imagen" and it links to a tweet with @Google mention plus #brain and #imagen hashtags (a single ask, no repeated asks shown).
I think the author of this blogpost could've had better response contacting paper authors with emails noted on the paper.
So weird to see a piece ostensibly about logical fallacies deploy one so cavalierly:
> I offered to bet [Elon Musk] $100,000 he was wrong [about AGI by 2029] [...] Musk didn’t have the guts to accept, which tells you a lot.
The fact that you couldn't get someone engaged in a conversation absolutely does not "tell you a lot" about the substance of your argument. It only tells you that you were ignored.
Now, I happen to think Marcus is right here and Musk is wrong, but... yikes. That was just a jarring bit of writing. Either do the detached professorial admonition schtick or take off the gloves and engage in bad faith advocacy and personal attacks. Both can be fun and get you eyeballs, and substack is filled with both. But not at the same time!
Imagine watching the seeds of AI that will terraform society and rapidly displace human labor over the coming decades be planted, and then still splitting hairs over whether or not it'll achieve sentience.
Our world is changing before our very eyes while this guy is belaboring the technicalities. You could hardly ask for a keener display of the philosophical gulf between scientists and engineers.
It have a lot of trouble understanding how this sentiment can exist.
Especially since the rise of GPT-3 and now these image models, we've seen the pop-culture face of AI become even narrower. The promise of generalization that could lead to intelligent behavior has given way to people sharing amusing pictures or phrases that these models have generated, because that's what they do. It's cool, but it's basically become orthogonal to any AGI, or even AI with applications. It's now just a neat cultural phenomenon from which laypeople somehow extrapolate the kind if stuff the parent is saying.
I'm not saying AI (neural networks) isn't making research progress, it's just that it has almost nothing to do with any of what laypeople extrapolate from it
Watch out for histrionic phrases like "calamitously blind". They indicate you're getting too emotional, losing perspective, verging into extreme, black-and-white thinking.
Text to video and converting some selected requests into actions is all nice, but it hardly contradicts the GP's observation: it's nowhere near AGI.
> Then it's puzzling to accuse someone of calamitous blindness when you are not even engaging with the point of the post you're replying to.
At this point, I'm wondering if you're just provoking me deliberately. The comment I replied to said the following:
> The promise of generalization that could lead to intelligent behavior has given way to people sharing amusing pictures or phrases that these models have generated, because that's what they do. It's cool, but it's basically become orthogonal to any AGI, or even AI with applications.
And then I posted evidence of concrete applications that are in progress at some of the most well-resourced companies in Silicon Valley. Absolutely groundbreaking stuff that more than prove sophisticated applications of contemporary AI are well on their way to being realized.
A lot of "histrionic phrases" to describe your reading comprehension ability are occurring to me right now, but I'll refrain from using them.
I am sure we can all agree that the new generation of AI models has some applications. How much remains to be seen. The ones you've noted could be nice. We'll see.
A Twitter thread demo is not quite a revolution yet IMHO. Even in the 60s some people thought ELIZA was a real person.
> Neither of the 2 companies you posted marketing materials about is among "some of the most well-resourced companies in Silicon Valley".
Two of the founders of Adept AI are authors on the paper 'Attention Is All You Need'. If you don't understand the significance of that, then you're speaking well outside of what you're qualified to comment on. The company has also raised capital from top tier SV investors.
Runway ML has raised money from Lux Capital.
These companies are not just well-resourced, they are positioned in the upper echelon of the innovation business.
I mean I can easily dig out data about their funding that will not put them even inside the top 20% of the companies in the valley but at this point, given that you lack the competence to distinguish between founders' achievements prior to founding a company and the companies in question being "some of the most well-resourced companies", it's "why bother" with typical AI bros, incompetent at anything they touch.
I enjoyed the Roon blog post but I found this bit amusing:
> It is easy to bet against new paradigms in their beginning stages: the Copernican heliocentric model of cosmology was originally less predictive of observed orbits than the intricate looping geocentric competitor. It is simple to play around with a large language model for a bit, watch it make some very discouraging errors, and throw in the towel on the LLM paradigm. But the inexorable scaling laws of deep learning models work in its favor. Language models become more intelligent like clockwork due to the tireless work of the brilliant AI researchers and engineers concentrated in a few Silicon Valley companies to make both the model and the dataset larger.
I don't know about you, but if I feed a program with hundreds of billions of "parameters" a huge chunk of the internet and it can then kinda-sorta do a bunch of things, sometimes semi-intelligently, but for the most part couldn't compete with a 4-year-old child... I'd say that's more on the Ptolemaic side of things than the Copernican side. Certainly "it gets better as you feed it more data" is equally true of both paradigms, so I'm not sure what Roon's point is here.
The appeal to the Copernican revolution itself has a bit of a hype-y, cranky odor. Virtually every crank appeals to Copernicus as a role model and vindicator. Real scientists usually don't, because they are busy with the hard, humbling business of actually figuring out how the world works.
Now don't get me wrong, I am thrilled by the research advances of the last couple decades, the foundation models, AlphaGo and AlphaFold, etc. The action model from Adept is great and Adept may become a very successful company. It's all very cool. But every paradigm shift in AI has been heralded as the thing that will Change Everything, and they usually don't. Big, exciting shifts in research don't necessarily mean as much in practice right away. I tend to think that getting AI "right enough" to have a huge, pervasively transformative impact on human life is going to take quite a few decades at least, if not centuries or more.
At this point, I'm numb from all of the AI overhype. I was extremely excited about DALL-E and convinced myself that concrete fruits of the AI revolution were finally here... until a few seconds after I got the chance to try some queries myself. Ditto Copilot.
The recent progress on generative models is a major research achievement, to be sure. That said, I'm not sure what it means it "terraform society," but so far AI shows no signs of making the same magnitude of impact on society as, say, the S-tier technological advances of the 20th and early 21st centuries, such as the personal computer, Internet, smartphone, or atomic bomb. That all may change if we get AGI that actually works, of course.
I mentioned DALL-E and Copilot in my post, so I'm not sure why you're linking me to a article summarizing recent high-profile research in large language models...
It's behind the horizon. You people should learn by the history of the whole field that progress is always slower than the marketing hype, usually by an enormous gap.
> It's behind the horizon. You people should learn by the history of the whole field that progress is always slower than the marketing hype, usually by an enormous gap.
I'm going to quote my original comment:
> seeds of AI that will terraform society and rapidly displace human labor over the coming decades
> seeds of AI that will terraform society and rapidly displace human labor over the coming decades
Replace AI with any other labor saving technology and your statement becomes just a truism without substance.
AI is already displacing human labor, just try to talk to a non-robot when you call a customer service line these days. It’s a selling point to have real humans answering phones anymore.
Being fungible with human labor is what people are really talking about not some answering machine with “AI” brains that replaced the old-school answering services.
> AI is already displacing human labor, just try to talk to a non-robot when you call a customer service line these days.
You’re right. And my point is that substitution due to AI will accelerate. That’s where the informational surprise of my original comment lies.
You have a fatal misapprehension about how automation transforms a labor market. Higher productivity of certain kinds of work due to automation pushes labor supply elsewhere, making the “elsewhere” in turn both more competitive/demeaning (think Amazon warehouse workers peeing in bottles at the lower end of the market and Stripe engineers burning out at the upper end) and less remunerative.
The terminal point of this trend is complete human obsolescence, but the displacement along the way is additive, will likely accelerate in the coming decades due to advances in AI, and is especially problematic because there are limits to the elasticity of the labor pool (i.e. its ability to adapt to rapidly changing conditions).
I would furthermore predict that governments will be too slow to respond to this and that social upheaval will consequently escalate dramatically.
Come back to this comment in ten years and see how I did.
There's no reason to believe AI or any other automation displaces human labor (esp in a way that causes unemployment). And even less reason to believe it already has.
Ask horses if machines can displace jobs for whole categories of workers. Or ask neanderthals if it’s possible to have one’s role replaced by a higher iq substitute
The affirmative answer to that ask was implicit in the first employment contract you signed. So, unless you'd claim that horses can give implicit consent by accepting grain from a human, the equivalency fails.
> until a few seconds after I got the chance to try some queries myself.
I’m the opposite. I’m finally, after a long time, starting to get excited about AI. Yes, most outputs still suck and require a lot of experimentation and rephrasing, and yes, midjourney produces a lot of same-looking things (less freedom, but also less crap compared to dall-e).
But wow, now even I, someone with no artistic talent whatsoever, can with just a few prompts create a cool illustration. My current discord avatar is a sloth drinking a cocktail [0]. Zoomed in, it looks a bit uncanny, but generally and especially at smaller sizes, it’s fine.
I could not draw something even halfway as okay. I would not want to pay someone to do it for me as it’s of no big importance to me (I once paid someone for their Stranger Things as sloths image, but even that was just something they already created, not a commission which would have been vastly more expensive).
Personally, I really can’t wait what the next generation will be like, and what it will enable people to do, what they will enable me to do. Yes, I’m very excited.
How do you know this to be true? There are many failed future predictions. There was a post about it just the other day. I believe it rated Kurzweil's singularity predictions at 7% accuracy to date. We still don't have commercial flying cars, cold fusion or space colonies.
> Now explain how you know, "AI that will terraform society and rapidly displace human labor over the coming decades", to be true.
Because I didn't say it will "obsolete" human labor.
You're right that the word "will" is strong in that statement. But, since basically nothing is absolute in a philosophical sense and certainly no one can prognosticate with certainty, it's fair to read that as "will with high likelihood".
And your surgical nitpicking doesn't hamper my argument in quite the way you think it does. Frankly, I believe it's in defiance of the following HN guideline:
> Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith.
It's interesting that he now casually throws out a 5 year old as the benchmark to beat:
> nobody has yet publicly demonstrated a machine that can relate the meanings of sentences to their parts the way a five-year-old child can.
Not very long ago that would have been a 3 year old, or maybe even a smart 2 year old. 5 year olds are extremely good at basic language and understanding tasks. If we get to the point of AI that is as good as a 5 year old we're essentially at AGI.
I’m not just poking fun. Art is a measure of cognitive development in humans and there are very typical representations people use at certain ages. 5 year olds are still making pretty rudimentary portraits of circles and triangles with stick limbs.
This reminds me of the scandal where Youtube science channels did glowing paid reviews of Waymo’s self driving cars without acknowledging they were paid for it. And technooptimists like Scott Alexander or Ray Kurzweil have a common tendency to shift the goalposts and declare they were right with their predictions. Current AI certainly doesn’t demonstrate proto-AGI capabilities.
That said, we shouldn’t miss the forest for the trees. We can be skeptical that current The pace of AI progress has been immense and problems that previously seemed difficult (e.g. computer vision classification, or beating top players at Go) have fallen one by one. And AI-skepticism’s have themselves been moving the goalposts in response. I see no reason why composition won’t be the same with time. Indeed, a decade ago machine translation used to struggle to understand the relationships between things, but now seems to be reliable at preserving the compositional relationships post-translation. 2029 is rather optimistic, but AGI does seem to be approaching in the coming few decades.
The issue is lack of transparency over the amount of editorial influence that Waymo exercised. This is why I linked to Snazzy Labs' comment about their experience making one of the other Waymo-sponsored videos.
I genuinely don’t understand the issue. If you see the word “sponsored” you should assume editorial control unless there’s an explicit statement otherwise. That’s what it’s there for.
Most YouTubers constantly play fast and loose with what is and isn’t sponsored content and what it means for their editorial integrity or full stop integrity for what it’s worth - a commodity in shockingly short supply amongst modern content providers but what my culture would consider okay is significantly at odd with American culture when it comes to commercial interests.
Some will gladly view themselves alternatively as maker of educational content or entertainer as it suits them.
If you are referring to Veritasium's Waymo video, it says it is sponsored content in the description above the fold and it has the standard paid promotion notice right on top of the video as soon as you open it.
As far as I can tell the "controversy" over the video is merely that one dedicated critic - so dedicated he made an hour-long response to a 20-minute video - is committed to the idea that machines won't ever be able to drive, and is irrationally angry over the fact that machines can and do drive, and do it well.
I wish videos like these would say sponsored by the company that makes the product reviewed here. Instead of the generic sponsored because I also talk about matresses in this tech review
I think changing the terms of the bet is definitely shifting the goalpost, even if not by much. It is certainly enough for the other party to refuse the win.
I agree that declaring a win is a bit impolite _if_ the other person hasn't agreed. But changing "farmer" to "robot farmer" because Google won't allow him to generate pictures with humans is obviously not changing the goalposts in the usual meaning of the term.
I'm impressed by all of these image generators but I still don't see them working toward being able to say, "Give me an astronaut riding a horse. Ok, now the same location where he arrives at a rocket. Now one where he dismounts. Now the horse runs away as the astronaut enters the rocket."
You can ask for all those things but the AI still has no idea what it's doing and cannot tell you where the astronaut is, etc.
I'd also say, every of these images would fail a reverse test (i.e., asking a person to describe the image and what it represents.)
The task is not just about generating an image that may somehow be in accordance with the prompt, but also to generate a significant image.
[Edit] The equivalent to a Turing test for compositional images would be something like this: have as set of 100 images with their respective prompts, some generated by an AI, some by a human graphic designer / artist; let the test person pick the images that were generated by a computer. Mind that this would not only involve the problem of compositionality per se, but also a meaningful and/or artistic composition of the image itself. Is someone attempting to express what is given in the prompt?
They actually use the reverse test to train the generator, and to score which image is most relevant to the prompt from the many images given by the generator. Dall-E does this using the OpenAI CLIP model.
What I'm aiming at is about what is shown by an image, not what is in an image.
Take for example the images for "A digital art picture of a robot child riding a llama with a bell on its tail through a desert", which Scott Alexander counts as a win.
The first image actually shows a merry llama, a robot, which is unmistakably a robot child, riding the llama and it's clearly a desert scene. If we forget for a moment about the missing bell, it's probably the best picture. But it is also very blunt in composition. I can't imagine why anybody should have made this image. Maybe, if somebody approached a designer, like, "See, we have this wooden toy cube and need an illustration for this face of the cube. What about a cute picture of a robot child riding a llama with a bell on its tail through a desert?" – But, at closer inspection, there's something sinister going on: it's rather the llama that is leading the robot child by a rein, not the other way round. – I mean, this is meant to be a cute toy! And where is the bell? We need to talk about that contract again…
The second image is undisclosed, so we can't really say anything about this.
The third image is rather special. The llama seems to be robotic as well, the robot, which is – again – clearly a child, seems to be not only riding the llama, but both appear somehow integrated into a single unit, which cumulates in the robot child's face screen. There is an eerie feeling about this image. The fact, that the bell seems to be attached to the rein as some kind of link between the llama and its rider doesn't exactly help. (There's also a conic extrusion at the back of the llama, but I'd rather interpret this as part of the llama, and it's not attached to its tail.) The composition in its flat side view produces a tension focusing towards the left side of the frame, on something, which is not shown, but apparently a vital part of the story. While I might notice the mountain in the background, I'd probably forget to write home about the scene being set in the desert. But I would note that we're missing context to understand this image and what may be shown by it.
The fourth image, finally, is clearly Star Wars, robot edition. However, no bell. ("A robot child riding a llama with a bell on its tail through a desert" – "Ah, you mean Star Wars!")
I'm not even sure which of these images Alexander did pick as a winner. And I would describe neither image by the prompt, nor would I dare to imagine that a human had chosen these exact means to show what is described in the prompt.
Having said that, thanks for the link to the DALL-E Mini paper!
I bet most humans would fail this test on images that everybody agrees are adequate portrayals. Answering a short query with an image is a highly non-injective mapping, you simply don't know what aspects of the scene were specifically asked for in the query, and which ones were filled in by the artist / AI.
Eg, the queries "opening of a medieval theme park", "announcement of a witch trial", "king charles proclamation" might all be reasonably answered by similar images containing a small crowd and a speaker in a medieval-looking setting, even though they're not meant to refer to the same time periods or settings at all.
Mind that the test is meant to include the prompt/query. E.g., take one of Alexander's winners, the robot in the cathedral: a human would probably answer to the prompt by making the cathedral part of the subject, by investing some effort in pointing out that this is indeed a cathedral, instead of just conforming to the query by showing some ambigue bits in the background, which may or may not represent parts of a cathedral. The quest of the machine is still "create an image by allotting the elements provided in the query", not "compose an image showing this and that as the subject" – and there's a significant difference. Closing this gap would require the AI to form a concept of what is given as a subject in its entirety and then constructing a plausible scene around this, by a meaningful placement of the subject, which is clearly beyond the state of art.
I admit that there is a certain appeal to those images, for their distinctive dreamlike quality, as there's often a specific tension in the rather blunt composition and an apparent subject, which seems to be beyond what is actually depicted, as if this was just a casually picked specimen from a series of illustrations for a broader story line. But I'd bet that we're going to have been seeing too much of this soon, in order to be still amazed.
I guess you're technically correct, but the task you're describing isn't generating an image from a prompt. It would be to maintain context across distinct-but-related statements based on an internalized model of reality. That's like discounting the advent of the calculator because you still need an accountant.
what shows how low level these models still are is that they don't seem to be able to draw text on a surface. It's generally just nonsense. Going higher in abstraction like asking for permanence of distinct entities or world knowledge, like having a player face the basketball hoop is several levels above that yet.
I think that puts pretty severe limits on what you can do with it because in a videogame, a comic strip or basically any piece of sequential art you need to keep track of characters and environments as objects.
Technically this is possible with these same techniques if you just initialize the image with the prior one, though I am sure that does not work that well.
Really you need image+text->image instead of just text->image generation. Some examples of relevant papers: "Conditioned and composed image retrieval combining and partially fine-tuning CLIP-based features", "IMAGE GENERATION WITH MULTI-MODAL PRIORS USING DENOISING DIFFUSION PROBABILISTIC MODELS". There was a more recent one I saw on Twitter I don't recall the name of. I wouldn't be surprised if these kinds of things work well by a year from now.
This is just composition again: If Imagen had compositionality, it would generate the four images you want from the prompt “A four panel webcomic: first, an astronaut riding a horse. Ok, now the same location where he arrives at a rocket. Now one where he dismounts. Now the horse runs away as the astronaut enters the rocket."
That is not composition in the linguistic sense. It's context. Composition will tell you that in the phrase "the same location where he arrives at a rocket", "same" modifies "location" rather than "rocket", but it won't tell you what "same" refers to.
So, what you're asking for is shared context over multiple prompts, which really isn't what this generation of models is trained for. It's moving the goalposts on the mounted astronaut.
It creates a representation of an entity and allows rending it in different styles and contexts. Currently it involves model fine tuning, but I expect it will become convenient as the power of the operation becomes clear. And once it's convenient, you'll be able to do the progressive queries you're asking for (and it'll be a lot easier to create narratively coherent sets of images.)
> which really isn't what this generation of models is trained for.
Exactly. AI hypemen would have us believe that training ever-larger models on ever-larger datasets is making meaningful progress towards general intelligence, but these kind of simple tests reveal this supposed "intelligence" for what it is: fancy pattern recognition.
Questions that a six year old would easily answer, these models fail at.
I guess what I'm saying is that I agree we're in the Clever Hans stage of AI, where we're just more explicit about stopping Hans when his tapping has reached our goal.
I think the ability of these image models to synthesize new images is really amazing. It makes the computer feel like it is doing something organic, and not just applying filters and things to the images. Then, when we see the new image paired with a text that generated it, we think the system might actually know what we're talking about. But it obviously doesn't, it's just the luck of a model with billions of parameters. Whenever the model fails to produce an acceptable output, it stops being intelligent and the user is considered to be bad at their job, or to be asking for something that is unreasonable.
I think it's still spot-on to say that comprehension is far away, even though you can pair outputs to inputs and have a simulacrum of comprehension.
Take a look at the curse of dimensionality... We're at the stage of reducing a haystack from nearly infinite to a small pile of hay to search for the needle, which has required massive advances. This really isn't clever hans at all.
Additionally, it's helpful to look at these systems as tools. We don't expect cars to work well without humans learning how to interact with them in a safe and reliable way. ML tools, thanks to high expectations and moving goalposts, aren't tested in the same way.
But ultimately this specific line of questions - handling context over multiple queries - is something people are actively working on, and I'm confident it'll have some real solutions within a year. It's closely connected to synthesizing video, which has a huge amount of effort going in right now and some really incredible early results already.
And then we can move the goal pays again and continue talking about horses...
"Compositionality" isn't there yet, but but the rate of improvement is impressive. Today there was a new release of CLIP which provides significantly better compositionality in Stable Diffusion - https://twitter.com/laion_ai/status/1570512017949339649
It'll be interesting to see how it fares against winoground once we get a publicly available SD release that makes use of the new CLIP.
Yes I've noticed that a lot of authors expect you to read through some parable before they tell you what they are going to tell you. It would be fine with an abstract or even a sentence below the title that says "ML models are not being adequately evaluated for composability and it makes them look more intelligent than they are". Just diving into "consider clever Hans" makes it tough to know if it's worth reading.
308 comments
[ 3.2 ms ] story [ 185 ms ] threadI had kids and they were the best machine learnign systems I've worked with.
It may well be that at the evolutionary level we have learned as slowly as AI training, but that's much harder to say.
Starting with fox on Knox and Knox in box and moving up to a tweedle beetle battle in a puddle in a bottle and the bottles on a poodle and the poodles eating noodles...
I dont see any evidence any of these models will draw it correctly, but would love to see what it produces.
This doesn’t make much sense. The task at hand is in no way equivalent in difficulty to flipping a coin. This is kind of like saying, “if you beat Usain Bolt in a race 3/5 times, that doesn’t mean anything; it’s like getting 3/5 coin flips to be heads.”
I would try to get a collection of prompts like "red ball and blue cube" or "an empty plane containing only a red ball and a blue cube" and so on - try to come up with 20 or 30 of these. Then, generate 100 images for each prompt. Next, see how likely it is for a red ball to randomly be on top of a blue cube when it was not directed to be.
After gathering some baseline data we could then test three prompts. "Red ball on top of blue cube" and "Red ball beside blue cube" and "Red ball below blue cube". Generate 100 or 1000 images for each of these prompts. Count respective orientations. Then, decide whether red ball being on top of blue cube is more likely than the baseline when the specific direction is given and whether it is less likely when contrary directions are given.
To take your Usain Bolt example, if you won 3 out of 5 races against him, that might just be because it was an off day for him, and not because you are actually faster than him. If you won 300 out of 500 races done in various circumstances on different days, then that is much more conclusive that you are faster than him. And this bet was even worse than that, because im each of the five tests, the best out of 10 results is picked.
It shows you're probably very competitive with him, though, barring some special circumstance where he says he's suffering from an illness or whatever. You can't compare either racing Usain Bolt or generating complex images with flipping coins. The conditions of this bet demonstrate that AIs are getting better at correctly understanding the specific intentions of prompts when generating images, even if it doesn't show they're anywhere near human-level understanding.
Generating image compositions sounds fairly difficult to do by random. If you took 3 different objects and randomly placed them in a square canvas, the odds that they'd look reasonably placed seem pretty low. So 3/5 correct seems like a non-trivial accomplishment.
Or he was really sick or something.
> So 3/5 correct seems like a non-trivial accomplishment.
It's definitely a non-trivial accomplishment. And it does show that Imagen can get it right sometimes. But with a sample size of 5, you certainly don't have enough data to say it can consistently get descriptions like these right 3/5 of the time.
And the question at hand isn't "can it draw what I asked it to instead of random garbage" it's "can it combine multiple parts of a sentence in the correct way", which, assuming that determining the correct components is already a solved problem, doesn't have as many degrees of freedom. For example in the "astronaut riding a horse" example, if it has half of the results with an astronaut riding a horse, and half with a horse riding an astronaut, it clearly doesn't understand how it is composed, but you still have a decent chance of getting the right image. Especially if you take 10 samples and pick the best one.
It is a different issue than generating an image based on a bag-of-words, so it isn't surprising that an attempt to solve that issue didn't immediately solve the other.
But a variety of approaches can easily solve this problem.
Descriptions of Napoleon Crossing the Alps are unlikely to read 'A small frenchman wearing a silly hat riding on a horse'. So why would an AI trained on such image descriptions develop any sense for 'compositionality'?
https://old.reddit.com/r/TheMotte/comments/v8yyv6/somewhat_c...
Edit: Actually I tried this right now with two prompts, and I was wrong. It might still be that gpt understands compositionality but the prior that people ride horses is just that strong. But what I saw was that with this particular situation the model got it wrong.
Edit 2: With some heavy hinting it managed to understand the situation. Italics mine. "An astronaut is walking on all four. A very small horse is sitting on top of him, riding him even. Shortly after the astronaut stops, exhausted.
The horse is too heavy for the astronaut to carry and he quickly becomes exhausted. Next, the horse gets off the astronaut, stands on its own four legs, and walks away."
Paraphrased that a bit, but I really like that quote.
PS: your link is an embarrassment. It would be flagged and dead if you pasted in the text here.
Yeah, but it's not really that good. Machine translation has improved a great deal, but reading those translations actually involves bringing a lot of human intelligence to the table, "Oh I bet, 'maximum fire alarms spread' on this menu actually means 'very hot sauce'"
If all you're claiming is that ML models exist and have useful commercial applications, then I don't think anyone is going to argue against that point.
But a lot of these AI promoters go further: in the case of the LessWrong folks some of them are convinced that a superintelligent machine capable of enslaving humanity is right around the corner.
The difference now is that the timescales are weeks or months instead of generations. I believe we will see models that have super-human "compositional" reasoning within 1 year.
Tangential to AGI, but don't we? Vegans seem to have quite a strong opinion on this assertion.
Humanity: I don’t think your intelligence matches that of a human’s.
AI: I don’t think about you at all.
> but then when somebody builds a system
I mean this is really it. You still have to have a human to build these systems that specialist in one thing. Once you create a system that can automatically create those systems and it doesn't need humans anymore to solve novel problems, then there will be no practical difference in kind between human and AI intelligence.
Except we don't have that. We don't have one human that can create this system by themselves. We have a choice group of a handful of smart, motivated, and quite generously compensated humans working on these problems to create such system. As such, you are already surpassing the "general" intelligence level by quite a lot.
I think that is a very generous take on what we do "automatically". After all, we have millions of years of evolution to build out all the neural circuitry that helps us speech or vision -- it's not like you can throw a soup of genes on the ground and out comes intelligence. What is machine learning doing, if not selecting, out of many possible parametrizations, the ones that are suited to understand vision or speech?
Maths in and of itself doesn't require any physical resources. It's possible that doing maths in practice requires knowledge of the world to extract some kind of product from (I'm skeptical, but it's possible), but in principle a rack mounted server could demonstrate its mathematical ability to the world with nothing more than the ability to send and receive messages.
This hasn't been done so far, not because there are obvious missing prerequsites, or because nobody's tried it, or because it has no value, or because there's a prohibitively high barrier to entry for people to have a go. It hasn't been done because nobody knows how to make a machine be a mathematician, and I've seen little evidence of any progress towards it.
That's my goalpost, always has been. Reach it and I'll be overjoyed. And FWIW, I strongly believe it can be reached. I don't see the latest round of ML (or any ML, really) as a step towards it, but I'd love to be proven wrong.
When I mention this someone always points at some bit of recent research, such as [1], but it's invariably just a new way for a human mathematician to make use of a computer. If anybody knows of any progress, or serious attempts, towards a true AI mathematician I'm very curious to know.
[1] https://www.nature.com/articles/s41586-021-04086-x
https://dspace.mit.edu/handle/1721.1/132379.2
Is a well known project for an AI Physicist. There are plenty of other groups working on similar projects
>I don't see the latest round of ML (or any ML, really) as a step towards it, but I'd love to be proven wrong.
LLM models have been able to do basic math for quite a while now and some have been trained to solve differential equations, calculus problems, etc. Well on their way to more impressive capabilities.
Neither of the things you mention are of this nature, or working towards it. "Finding a symbolic expression that matches data from an unknown function" (Feynman) and "solv[ing] differential equations, calculus problems, etc" are not descriptions of what a research mathematician does.
It has to be maths for a specific reason. I think it's in some sense the purest form of an ability distinctive to human minds and pervasive in how they work. As I mentioned, it's an ability that can be demonstrated in the absence of any particular physical capability, and yet despite it being perhaps the oldest goal of AI it may be the one we have made least progress towards.
Anyway that's my goalpost, and it's not moving. AGI, being "general", surely should be capable of this hitherto uniquely human activity. If our attempts so far are not capable of it, then clearly they are not "general". If you know of any evidence that my goalpost has been achieved, please let me know. I'm very eager to see it happen.
Never said they were but you said:
>It hasn't been done because nobody knows how to make a machine be a mathematician, and I've seen little evidence of any progress towards it."
Which I showed is not accurate. Certainly people have ideas on how to do it and are actively making progress towards that goal.
>Finding a symbolic expression that matches data from an unknown function" (Feynman) and "solving differential equations, calculus problems, etc" are not descriptions of what a research mathematician does.
All research mathematicians started out solving calculus problems and differential equations.
Why do you expect an AI to sprint before it's learned to crawl?
Ever since computers were invented there has been a hope that you could set up a system that would just churn out interesting new theorems. Indeed it was one of the primary motivations for the invention of the computer, but it hasn't materialised yet.
You clearly consider the progress on solving problems to be progress towards being able to do mathematical research. I don't think it is, any more than progress in, say, graphics is. But maybe I will turn out to be wrong and you will turn out to be right. We won't have the answer until the problem is solved and we have our wonderful machine churning out theorems.
But I think you will probably be able to agree that since mathematical research is something human minds are capable of it's something that an AGI should be capable of, i.e. if an AI approach is inherently incapable of it, it's not AGI. You may consider it an unnecessarily stringent requirement, in that there may be other, easier challenges that AIs can perform that will convince you that they are AGI. That's fine - you think about the problem differently to me, so you find different things persuasive. If you are convinced that a given AI is AGI, though, you shouldn't be too concerned about my particular goalpost given that your AGI should be able to achieve it (and convince me) pretty soon.
We'll see what happens. I'm just explaining what I would find convincing, and pointing out that contrary to the oft-repeated accusation that started this discussion, I for one have never once "moved the goalposts".
Indeed. To be clear, I'm not saying I think any current system is remotely close to AGI. I just think that saying that no one is thinking about or making progress on a math research AI is inaccurate.
I'd settle for a demonstration that a computer has truly independently discovered/invented and proved some significant part of our existing mathematical edifice. This hasn't been achieved yet, either. However, I suspect that once we've figured out how to do this at all, surpassing human capabilities will be inevitable in a relatively short time. So I don't see much value in softening the test unless/until there's some actual candidate available that would pass the softer test.
The value in requiring genuinely new maths is that it makes it unlikely that knowledge of the result has been encoded in the algorithm or training set. Certainly, if GPT-3 were to output Euler's formula that wouldn't be at all convincing as a "discovery".
Edit: Gwern has an extensive history with this so I'll let him do the talking.
https://old.reddit.com/r/TheMotte/comments/v8yyv6/somewhat_c...
Further Edits: Not to mention Scott Alexander who has directly rebutted you numerous times. Or Yann LeCunn. Not sure who exactly is backing down.
https://astralcodexten.substack.com/p/my-bet-ai-size-solves-...
https://astralcodexten.substack.com/p/somewhat-contra-marcus...
https://analyticsindiamag.com/yann-lecun-resumes-war-of-word...
Presumably you approach these arguments like Ben Shapiro and imagine you have "Dunked on the Deep Learning geeks with Facts and Logic."
i have been pretty damn consistent since me 2001 book.
edit: Maybe I made a composition error. https://imgur.com/a/Q7hHduY
> The AI effect occurs when onlookers discount the behavior of an artificial intelligence program by arguing that it is not real intelligence.
> Author Pamela McCorduck writes: "It's part of the history of the field of artificial intelligence that every time somebody figured out how to make a computer do something—play good checkers, solve simple but relatively informal problems—there was a chorus of critics to say, 'that's not thinking'." Researcher Rodney Brooks complains: "Every time we figure out a piece of it, it stops being magical; we say, 'Oh, that's just a computation.'"
1. Scott Alexander should have used an off-the-shelf benchmark like Winoground instead of rolling his own five-question test.
2. He shouldn’t declare victory after cherry-picking good results from a small sample of questions.
I also learned there's a long history of AI skepticism, the root of which comes down to "Compositionality(?)"- and this wall of understanding meaning has vexed AI for decades.
That would be lost in proposed short form summary.
The original terms of the bet:
My proposed operationalization of this is that on June 1, 2025, if either if us can get access to the best image generating model at that time (I get to decide which), or convince someone else who has access to help us, we'll give it the following prompts:
1. A stained glass picture of a woman in a library with a raven on her shoulder with a key in its mouth
2. An oil painting of a man in a factory looking at a cat wearing a top hat
3. A digital art picture of a child riding a llama with a bell on its tail through a desert
4. A 3D render of an astronaut in space holding a fox wearing lipstick
5. Pixel art of a farmer in a cathedral holding a red basketball
We generate 10 images for each prompt, just like DALL-E2 does. If at least one of the ten images has the scene correct in every particular on 3/5 prompts, I win, otherwise you do.
Then he changed the terms because Imagen won't do people. I think that's cheating.
[1] https://astralcodexten.substack.com/p/a-guide-to-asking-robo...
See: https://news.ycombinator.com/item?id=32858426
The humans -> robots change is possibly dubious, yes. I don't think that it's super important, but if it were me, I wouldn't have posted the blog post as is. I would have waited until some AI passed all the prompts with humans, like it most certainly will in a year.
You didn't read his post declaring victory. There's plenty of question; he's giving credit for "a llama with a bell on its tail" to ten pictures of llamas without bells on their tails, and for "a robot farmer" to ten pictures of robots with absolutely nothing to suggest they might be farmers.
He was way, way too eager to believe that he'd won.
The other issue is who judges the outcome. The terms specify Gwern or Cassander (without having secured the assent of either) or they will "figure something out." In his victory claim, Alexander does not mention any independent judge, and interestingly, Gwern posted two comments without explicitly concurring with Alexander's claim, though his second comment might be read as tacitly accepting it.
My initial comment, therefore, needs some modification: replace the "given that" with "if", and I think it stands as a counterfactual conditional, having a probably-false antecedent.
I don't think Alexander is doing his reputation any favors by being so triumphalist about this misbegotten bet.
[1] https://astralcodexten.substack.com/p/a-guide-to-asking-robo...
A research project at Google intentionally won't render people. Maybe it could render people, theoretically, but without evidence, we don't know how well.
And the terms of the bet say that he is cherry-picking the results that meet the prompt.
The article isn't saying that Scott didn't win his bet, it is saying that winning that bet doesn't really say that Imagen has solved the compositionality problem.
A more practical use case is "bicycle, branded x, with y frame shape, with an adult male, 40-50, riding down hill in mountain road in spring" - now that's something I can use as stock photo. This example is very specific - but insert whatever product you want in whatever scenario you need it. Here it becomes important that you understand features of the objects you're drawing to avoid making colossal mistakes, and you're going to notice if the model doesn't understand it right away.
Painting abstract portraits and random art is fun but you're willing to accept so much as correct that it's not a very useful measure of model quality (personally).
https://astralcodexten.substack.com/p/a-guide-to-asking-robo...
The Eleventh Virtue: Scholarship
My plan for this one was Alexandra Elbakyan (the Sci-Hub woman) in a library, with the Sci-Hub mascot (a raven with a key in its mouth).
At least one other key to making a bet like this fair is that it needs to be arbitrated by a third party. He shouldn't get to decide himself if he won or not.
But, at the rate we're seeing progress, I don't think there's any doubt at this point that top of the line models will be able to do all the proposed examples by June 2025. In fact, by June 2025 I bet that millions of people will be able to generate those images on their home computers.
Make that 2020. And in 2012 I was personally told by a startuper in the field that I would be able to buy L5 in 2017.
If you're really confident, you could change the conditions such that 5 out of 10 images (for 3/5 prompts) are required to depict the described scene. That would alleviate some of the concerns around cherry-picking.
A suitable home for such a public bet would be: https://longbets.org/
https://news.ycombinator.com/newsguidelines.html
If the creators have convinced themselves of some kind of "no humans" rule, but also know that this would be regarded as impossibly extreme and raise serious concerns about Google with the outside world, then keeping Imagen private forever may be the most "rational" solution.
This doesn't make sense. The original challenge could well have been to draw robots to begin with. Has no bearing on the outcome imo.
But the real problem here is the refusal to do basic and normal things, like depict people. That's not normal - it's deeply weird and tells us a lot about what must be going on inside Google's ai research effort.
Google is fighting a secret war against the Loab demon race that lives inside the high dimensional vector spaces. They've recently made incursions into our reality via Stable Diffusion.
Robot looking at a cat wearing a top hat appears to be easier than with a human for DALL-E too, judging from the comments on Alexander's article, because both objects are neutral with respect to top hats. But really the whole set of prompts is poorly chosen. The original challenge of arbitrary shapes in relative positions seems the best way to test understanding of grammar and object relationships, exactly to avoid the "humans wear top hats and cats never do" problem.
A better set of prompts is important - in this Gary Marcus is correct - exactly because there's no point defining a specific prompt if later you'll decide you accept a totally different prompt. That kind of invalidates the point of betting on well specified challenges to begin with.
This seems like the wrong way to go about podcasting. What can you say today that will still be interesting to hear in six months?
(Overstated for effect. I do think there's a place for news and timely commentary, but it's far from everything.)
I don't use an app that features reviews. I'd rather spend five minutes listening to the original than five minutes reading about it. Most podcasts I find through guest appearances or criticisms from current subscriptions. (E.g., I subscribed to the excellent "Red Scare" because the also excellent "Pod Damn America" dudes spent like ten minutes bitching about them.)
What a bloviating egomaniac. Does Musk really have the time to deal with pissant researchers like him? Whats 500k to a man worth a hundred billion?
Vitor took the other side of the bet and he is also not convinced [1]:
> I'm not conceding just yet, even though it feels like I'm just dragging out the inevitable for a few months. Maybe we should agree on a new set of prompts to get around the robot issue.
> In retrospect, I think that your side of the bet is too lenient in only requiring one of the images to fulfill the prompt. I'm happy to leave that part standing as-is, of course, though I've learned the lesson to be more careful about operationalization. Overall, these images shift my priors a fair amount, but aren't enough to change my fundamental view.
Scott putting "I Won" in the headline when it's not resolved yet seems somewhat dishonest, or more charitably wishful thinking.
[1] https://astralcodexten.substack.com/p/i-won-my-three-year-ai...
Does anyone seriously think that imagen couldn't put a person in that prompt?
Otherwise I thought you had a great introduction to compositionality and didn’t need to tilt at any windmills to make your points. I look forward to seeing your benchmark results for recent and upcoming models.
Musk actively declined the bet or did he simply not respond? There is a big difference.
> … I have repeatedly asked that Google give the scientific community access to Imagen. They have refused even to respond.
It seems the author generally feels more entitled to a response than he perhaps should.
But is the author the spokesperson for this community to the point that Google should feel compelled to answer him directly?
Google has a lot of resources. They can handle responding to potentially thousands of access requests, especially if they go around publishing glowing results of their own system.
Unless you work at Google how could you know this?
For example, if it's quadratic, going from 1 000 to 1 000 000 would increase costs by one million fold.
Some communities do.
> Granting access "to the community" to investigate scientific claims means making the methodology and results available to everybody - and that includes responding to inquiries for access from anyone (who is worth granting access to.)
Sure, not arguing otherwise.
I'll try to make my point more obvious. If you keep asking questions to different people/orgs and not getting responses there are two possible conclusions:
- Everyone is a jerk or coward.
- You're not as important as you think and not worth the recipient's time.
If they wanted to grant access to the scientific community, they'd just launch a closed beta with an official sign-up flow.
I think the author of this blogpost could've had better response contacting paper authors with emails noted on the paper.
> I offered to bet [Elon Musk] $100,000 he was wrong [about AGI by 2029] [...] Musk didn’t have the guts to accept, which tells you a lot.
The fact that you couldn't get someone engaged in a conversation absolutely does not "tell you a lot" about the substance of your argument. It only tells you that you were ignored.
Now, I happen to think Marcus is right here and Musk is wrong, but... yikes. That was just a jarring bit of writing. Either do the detached professorial admonition schtick or take off the gloves and engage in bad faith advocacy and personal attacks. Both can be fun and get you eyeballs, and substack is filled with both. But not at the same time!
Our world is changing before our very eyes while this guy is belaboring the technicalities. You could hardly ask for a keener display of the philosophical gulf between scientists and engineers.
Especially since the rise of GPT-3 and now these image models, we've seen the pop-culture face of AI become even narrower. The promise of generalization that could lead to intelligent behavior has given way to people sharing amusing pictures or phrases that these models have generated, because that's what they do. It's cool, but it's basically become orthogonal to any AGI, or even AI with applications. It's now just a neat cultural phenomenon from which laypeople somehow extrapolate the kind if stuff the parent is saying.
I'm not saying AI (neural networks) isn't making research progress, it's just that it has almost nothing to do with any of what laypeople extrapolate from it
https://twitter.com/AdeptAILabs/status/1570144499187453952 https://twitter.com/runwayml/status/1568220303808991232
https://scale.com/blog/text-universal-interface
Text to video and converting some selected requests into actions is all nice, but it hardly contradicts the GP's observation: it's nowhere near AGI.
EDIT Since you ninja edited this in:
> Text to video and converting some selected requests into actions is all nice, but it hardly contradicts the GP's observation: it's nowhere near AGI.
If you review the root comment I made, you'll understand that I was never arguing with the GP about AGI in the first place.
At this point, I'm wondering if you're just provoking me deliberately. The comment I replied to said the following:
> The promise of generalization that could lead to intelligent behavior has given way to people sharing amusing pictures or phrases that these models have generated, because that's what they do. It's cool, but it's basically become orthogonal to any AGI, or even AI with applications.
And then I posted evidence of concrete applications that are in progress at some of the most well-resourced companies in Silicon Valley. Absolutely groundbreaking stuff that more than prove sophisticated applications of contemporary AI are well on their way to being realized.
A lot of "histrionic phrases" to describe your reading comprehension ability are occurring to me right now, but I'll refrain from using them.
A Twitter thread demo is not quite a revolution yet IMHO. Even in the 60s some people thought ELIZA was a real person.
I've said all I have to say. Have a nice day.
Neither of the 2 companies you posted marketing materials about is among "some of the most well-resourced companies in Silicon Valley".
Two of the founders of Adept AI are authors on the paper 'Attention Is All You Need'. If you don't understand the significance of that, then you're speaking well outside of what you're qualified to comment on. The company has also raised capital from top tier SV investors.
Runway ML has raised money from Lux Capital.
These companies are not just well-resourced, they are positioned in the upper echelon of the innovation business.
> It is easy to bet against new paradigms in their beginning stages: the Copernican heliocentric model of cosmology was originally less predictive of observed orbits than the intricate looping geocentric competitor. It is simple to play around with a large language model for a bit, watch it make some very discouraging errors, and throw in the towel on the LLM paradigm. But the inexorable scaling laws of deep learning models work in its favor. Language models become more intelligent like clockwork due to the tireless work of the brilliant AI researchers and engineers concentrated in a few Silicon Valley companies to make both the model and the dataset larger.
I don't know about you, but if I feed a program with hundreds of billions of "parameters" a huge chunk of the internet and it can then kinda-sorta do a bunch of things, sometimes semi-intelligently, but for the most part couldn't compete with a 4-year-old child... I'd say that's more on the Ptolemaic side of things than the Copernican side. Certainly "it gets better as you feed it more data" is equally true of both paradigms, so I'm not sure what Roon's point is here.
The appeal to the Copernican revolution itself has a bit of a hype-y, cranky odor. Virtually every crank appeals to Copernicus as a role model and vindicator. Real scientists usually don't, because they are busy with the hard, humbling business of actually figuring out how the world works.
Now don't get me wrong, I am thrilled by the research advances of the last couple decades, the foundation models, AlphaGo and AlphaFold, etc. The action model from Adept is great and Adept may become a very successful company. It's all very cool. But every paradigm shift in AI has been heralded as the thing that will Change Everything, and they usually don't. Big, exciting shifts in research don't necessarily mean as much in practice right away. I tend to think that getting AI "right enough" to have a huge, pervasively transformative impact on human life is going to take quite a few decades at least, if not centuries or more.
The recent progress on generative models is a major research achievement, to be sure. That said, I'm not sure what it means it "terraform society," but so far AI shows no signs of making the same magnitude of impact on society as, say, the S-tier technological advances of the 20th and early 21st centuries, such as the personal computer, Internet, smartphone, or atomic bomb. That all may change if we get AGI that actually works, of course.
EDIT: I saw you delete that comment. I won't point out how amusing it is that someone like you would accuse another person of being a troll.
I'm going to quote my original comment:
> seeds of AI that will terraform society and rapidly displace human labor over the coming decades
Replace AI with any other labor saving technology and your statement becomes just a truism without substance.
AI is already displacing human labor, just try to talk to a non-robot when you call a customer service line these days. It’s a selling point to have real humans answering phones anymore.
Being fungible with human labor is what people are really talking about not some answering machine with “AI” brains that replaced the old-school answering services.
You’re right. And my point is that substitution due to AI will accelerate. That’s where the informational surprise of my original comment lies.
You have a fatal misapprehension about how automation transforms a labor market. Higher productivity of certain kinds of work due to automation pushes labor supply elsewhere, making the “elsewhere” in turn both more competitive/demeaning (think Amazon warehouse workers peeing in bottles at the lower end of the market and Stripe engineers burning out at the upper end) and less remunerative.
The terminal point of this trend is complete human obsolescence, but the displacement along the way is additive, will likely accelerate in the coming decades due to advances in AI, and is especially problematic because there are limits to the elasticity of the labor pool (i.e. its ability to adapt to rapidly changing conditions).
I would furthermore predict that governments will be too slow to respond to this and that social upheaval will consequently escalate dramatically.
Come back to this comment in ten years and see how I did.
Probably the same as people who predicted this 100, 200, 500 years ago I'd venture.
--edit--
And assuming the robot overlords don't just go all Walden Pond and bask in the sun under solar panels contemplating Life, the Universe and Everything.
https://noahpinion.substack.com/p/american-workers-need-lots...
It seems to be a myth caused by anxiety about high unemployment in 2010, but we're no longer in that world.
I’m the opposite. I’m finally, after a long time, starting to get excited about AI. Yes, most outputs still suck and require a lot of experimentation and rephrasing, and yes, midjourney produces a lot of same-looking things (less freedom, but also less crap compared to dall-e).
But wow, now even I, someone with no artistic talent whatsoever, can with just a few prompts create a cool illustration. My current discord avatar is a sloth drinking a cocktail [0]. Zoomed in, it looks a bit uncanny, but generally and especially at smaller sizes, it’s fine.
I could not draw something even halfway as okay. I would not want to pay someone to do it for me as it’s of no big importance to me (I once paid someone for their Stranger Things as sloths image, but even that was just something they already created, not a commission which would have been vastly more expensive).
Personally, I really can’t wait what the next generation will be like, and what it will enable people to do, what they will enable me to do. Yes, I’m very excited.
[0]: https://i.imgur.com/0RwVNP4.png
https://twitter.com/AdeptAILabs/status/1570144499187453952 https://twitter.com/runwayml/status/1568220303808991232
https://scale.com/blog/text-universal-interface
Because I didn't say it will "obsolete" human labor.
You're right that the word "will" is strong in that statement. But, since basically nothing is absolute in a philosophical sense and certainly no one can prognosticate with certainty, it's fair to read that as "will with high likelihood".
And your surgical nitpicking doesn't hamper my argument in quite the way you think it does. Frankly, I believe it's in defiance of the following HN guideline:
> Please respond to the strongest plausible interpretation of what someone says, not a weaker one that's easier to criticize. Assume good faith.
btw, AGI is coming 2030. Source? It was revealed to me in a dream. Check my profile to see where you can email to take bets.
https://longbets.org/1/
I personally think Kurzweil still has a shot at winning it.
> nobody has yet publicly demonstrated a machine that can relate the meanings of sentences to their parts the way a five-year-old child can.
Not very long ago that would have been a 3 year old, or maybe even a smart 2 year old. 5 year olds are extremely good at basic language and understanding tasks. If we get to the point of AI that is as good as a 5 year old we're essentially at AGI.
https://www.sarah-brosnan.com/primate-art
I’m not just poking fun. Art is a measure of cognitive development in humans and there are very typical representations people use at certain ages. 5 year olds are still making pretty rudimentary portraits of circles and triangles with stick limbs.
https://empoweredparents.co/child-development-drawing-stages...
That said, we shouldn’t miss the forest for the trees. We can be skeptical that current The pace of AI progress has been immense and problems that previously seemed difficult (e.g. computer vision classification, or beating top players at Go) have fallen one by one. And AI-skepticism’s have themselves been moving the goalposts in response. I see no reason why composition won’t be the same with time. Indeed, a decade ago machine translation used to struggle to understand the relationships between things, but now seems to be reliable at preserving the compositional relationships post-translation. 2029 is rather optimistic, but AGI does seem to be approaching in the coming few decades.
Which video is this a reference to?
It was critiqued by Tom Nicholas: https://www.youtube.com/watch?v=CM0aohBfUTc
Most notable was Snazzy Labs' own comment in the replies to Tom Nicholas' video which descriped their experience participating in the Waymo sponsored reviews: https://www.youtube.com/watch?v=CM0aohBfUTc&lc=UgxJvOq1zHhID...
Some will gladly view themselves alternatively as maker of educational content or entertainer as it suits them.
> This reminds me of the scandal where Youtube science channels did glowing paid reviews of Waymo’s self driving cars
You mention channel(s)
As far as I can tell the "controversy" over the video is merely that one dedicated critic - so dedicated he made an hour-long response to a 20-minute video - is committed to the idea that machines won't ever be able to drive, and is irrationally angry over the fact that machines can and do drive, and do it well.
https://www.youtube.com/watch?v=yjztvddhZmI
2. the assertion is that he has "common tendency to shift the goalposts"
The emphasis on common is mine.
This seems like a subjective claim.
You can ask for all those things but the AI still has no idea what it's doing and cannot tell you where the astronaut is, etc.
The task is not just about generating an image that may somehow be in accordance with the prompt, but also to generate a significant image.
[Edit] The equivalent to a Turing test for compositional images would be something like this: have as set of 100 images with their respective prompts, some generated by an AI, some by a human graphic designer / artist; let the test person pick the images that were generated by a computer. Mind that this would not only involve the problem of compositionality per se, but also a meaningful and/or artistic composition of the image itself. Is someone attempting to express what is given in the prompt?
You can see the mini version here using this exact logic https://wandb.ai/dalle-mini/dalle-mini/reports/DALL-E-Mini-E...
Take for example the images for "A digital art picture of a robot child riding a llama with a bell on its tail through a desert", which Scott Alexander counts as a win.
The first image actually shows a merry llama, a robot, which is unmistakably a robot child, riding the llama and it's clearly a desert scene. If we forget for a moment about the missing bell, it's probably the best picture. But it is also very blunt in composition. I can't imagine why anybody should have made this image. Maybe, if somebody approached a designer, like, "See, we have this wooden toy cube and need an illustration for this face of the cube. What about a cute picture of a robot child riding a llama with a bell on its tail through a desert?" – But, at closer inspection, there's something sinister going on: it's rather the llama that is leading the robot child by a rein, not the other way round. – I mean, this is meant to be a cute toy! And where is the bell? We need to talk about that contract again…
The second image is undisclosed, so we can't really say anything about this.
The third image is rather special. The llama seems to be robotic as well, the robot, which is – again – clearly a child, seems to be not only riding the llama, but both appear somehow integrated into a single unit, which cumulates in the robot child's face screen. There is an eerie feeling about this image. The fact, that the bell seems to be attached to the rein as some kind of link between the llama and its rider doesn't exactly help. (There's also a conic extrusion at the back of the llama, but I'd rather interpret this as part of the llama, and it's not attached to its tail.) The composition in its flat side view produces a tension focusing towards the left side of the frame, on something, which is not shown, but apparently a vital part of the story. While I might notice the mountain in the background, I'd probably forget to write home about the scene being set in the desert. But I would note that we're missing context to understand this image and what may be shown by it.
The fourth image, finally, is clearly Star Wars, robot edition. However, no bell. ("A robot child riding a llama with a bell on its tail through a desert" – "Ah, you mean Star Wars!")
I'm not even sure which of these images Alexander did pick as a winner. And I would describe neither image by the prompt, nor would I dare to imagine that a human had chosen these exact means to show what is described in the prompt.
Having said that, thanks for the link to the DALL-E Mini paper!
Eg, the queries "opening of a medieval theme park", "announcement of a witch trial", "king charles proclamation" might all be reasonably answered by similar images containing a small crowd and a speaker in a medieval-looking setting, even though they're not meant to refer to the same time periods or settings at all.
I admit that there is a certain appeal to those images, for their distinctive dreamlike quality, as there's often a specific tension in the rather blunt composition and an apparent subject, which seems to be beyond what is actually depicted, as if this was just a casually picked specimen from a series of illustrations for a broader story line. But I'd bet that we're going to have been seeing too much of this soon, in order to be still amazed.
I think that puts pretty severe limits on what you can do with it because in a videogame, a comic strip or basically any piece of sequential art you need to keep track of characters and environments as objects.
Embedding a language model in the image generation model seemingly just requires a bigger network.
Really you need image+text->image instead of just text->image generation. Some examples of relevant papers: "Conditioned and composed image retrieval combining and partially fine-tuning CLIP-based features", "IMAGE GENERATION WITH MULTI-MODAL PRIORS USING DENOISING DIFFUSION PROBABILISTIC MODELS". There was a more recent one I saw on Twitter I don't recall the name of. I wouldn't be surprised if these kinds of things work well by a year from now.
However, there is progress towards what you're asking for. The recent work on textual inversion is in the right direction: https://github.com/hlky/sd-enable-textual-inversion
It creates a representation of an entity and allows rending it in different styles and contexts. Currently it involves model fine tuning, but I expect it will become convenient as the power of the operation becomes clear. And once it's convenient, you'll be able to do the progressive queries you're asking for (and it'll be a lot easier to create narratively coherent sets of images.)
Exactly. AI hypemen would have us believe that training ever-larger models on ever-larger datasets is making meaningful progress towards general intelligence, but these kind of simple tests reveal this supposed "intelligence" for what it is: fancy pattern recognition.
Questions that a six year old would easily answer, these models fail at.
I think the ability of these image models to synthesize new images is really amazing. It makes the computer feel like it is doing something organic, and not just applying filters and things to the images. Then, when we see the new image paired with a text that generated it, we think the system might actually know what we're talking about. But it obviously doesn't, it's just the luck of a model with billions of parameters. Whenever the model fails to produce an acceptable output, it stops being intelligent and the user is considered to be bad at their job, or to be asking for something that is unreasonable.
I think it's still spot-on to say that comprehension is far away, even though you can pair outputs to inputs and have a simulacrum of comprehension.
Additionally, it's helpful to look at these systems as tools. We don't expect cars to work well without humans learning how to interact with them in a safe and reliable way. ML tools, thanks to high expectations and moving goalposts, aren't tested in the same way.
But ultimately this specific line of questions - handling context over multiple queries - is something people are actively working on, and I'm confident it'll have some real solutions within a year. It's closely connected to synthesizing video, which has a huge amount of effort going in right now and some really incredible early results already.
And then we can move the goal pays again and continue talking about horses...
It'll be interesting to see how it fares against winoground once we get a publicly available SD release that makes use of the new CLIP.
There are interesting things buried in here, but I don’t have time for rambling.
The edge cases of image models have been more succinctly summarized and speculated upon elsewhere.