If that's true, then it should be fine for that human to paint with the brush of his AI tool. Why should that human artist be restricted in the types of tools he uses to create his artwork?
No you should not. You should be able to use any tool you want.
If you produce a work that is too much of a copy from the original, you might be liable to a copyright claim.. but the act of copy and paste should not be prohibited in the generation of something new.
This is done all the time by artists.. who perhaps create an artwork by copy and pasting advertisements out of a womans magazine to create an image of a womans face made only of those clipping. Making a statement about identity creation from corporate media... we should not put restrictions on such art work.
Here's just one example of an artist using copy-n-paste of content they don't own to create something new:
This is a tired argument; whether or not the diffusion models are "learning", they are a tool of capital to fuck over human artists, and should be resisted for that reason alone.
As a representative of a lot of things but hardly any capital who uses diffusion models to get something I would otherwise not pay a human artist for anyway, I testify that, the models are not exclusively what you describe them to be.
I do not support indiscriminate banning of anything and everything that can potentially be used to fuck someone over.
I did not say they were exclusively that; I said they were that.
Once we as a society have implemented a good way for the artists whose work powers these machines to survive, you can feel good about using them. Until then, frankly, you're doing something immoral by paying to use them.
It is! This method of doing so has overwhelming negative externalities, though. I'd expect anyone who actually gave a shit about AI empowering people to create to spend just as much effort pushing legislation so the displaced artists don't starve on the street as a result.
That's a terrible analogy. Until the scrapers start deleting all other copies of what what they're scraping, "stealing" the art in a traditional sense, there's no harm done in the process of training the network. Any harm done comes after that.
Isn't high-quality open image generation almost entirely dependent on Stability releasing their foundational models for free, at great expense to them?
That's not something you'll be able to rely on long-term, there won't always be a firehose of venture capital money to subsidise that kind of charity.
The cost of training them is going down, though. Given the existence of models like Pixart, I don’t think we’ll stay dependent on corporate charity for long.
By this logic we ought to start lynching artists, why they didn't care about all of those who lost their jobs making pigments, canvasses, pencils, brushes etc etc
Artists pay those people and make their jobs needed. Same as the person above claiming Duchamp didn't negotiate with the ceramics makers - yes, they absolutely did and do pay their suppliers. Artists aren't smash and grabbing their local Blick.
imagine being a photographer that takes decades to perfect their craft. sure another student can study and mimic your style. but it's still different than some computer model "ingesting" vast amount of photos and vomiting something similar for $5.99 in aws cpu cost so that some prompt jockey can call themselves an AI artist and make money off of other peoples talent.
i get that this is cynical and does not encompass all ai art, but why not let computers develop their own style wihout ingesting human art? that's when it would actually be AI art
Like 99.9% of the art the common people care about is Darth Vader and Taylor Swift and other pop culture stuff like that.
These people literally don’t care what your definition of what is and isn’t art is, or how it’s made, they just want a lock screen wallpaper of themselves fighting against Thanos on top of a volcano.
The argument of “what is art” has been an academic conversation largely ignored by the people actually consuming the art for hundreds of years. Photography was just pop culture trash, comics were pop culture trash, stick figure web comics were pop culture trash. Today’s pop culture trash is the “prompt jockey”.
I make probably 5-10 pictures every day over the course of maybe 20 minutes as jokes on Teams because we have Bing Chat Enterprise. My coworkers seem to enjoy it. Nobody cares that it’s generated. I’m also not trying to be an “artist” whatever that means. It just is, and it’s fun. I wasn’t gonna hire an artist to draw me pictures to shitpost to my coworkers. It’s instead unlocked a new fun way to communicate.
not entirely sure what your point is, but i think you are saying that art is just a commodity we use for cheap entertainment so it's ok for computers to do the same?
in the context of what i was saying the definition of what is art can be summed up as anything made by humans. i have no problem when its used in memes and being open sourced etc.. the issue i have is when a human invests real time into it and then its taken and regurgitated without their permission. do you see that distinction?
I mean, I don't think many care about your personal use of art. You can take copyright images and shit post and Disney won't go suing your workplace.
But many big players do want to use this commercially and that's where a lot of these lines start to form. No matter how lawsuits go you will probably still be able to find some LLM to make Thanos fighting a volcano. It's just a matter of how/if companies can profit from it.
Because that's not what happens, ever. You wouldn't ask a human to have their style of photographing when they don't know what a photograph even looks like.
That's a funny argument because artists lost their shit over photography too. Now anyone can make a portrait! Photography will kill art!
Art is the biggest gate kept industry there is and I detest artists who believe only they are the chosen one.
Art is human expression. We all have a right to create what we want with whatever tools we want. They can adapt or be left behind. No sympathy from me.
That's an intentional misinterpretation, I think. I mention art as an economic activity because it's primarily professional artists that are harmed by the widespread adoption of this technology.
They tried to use the labor theory early on by claiming, "real art takes hard work and time as opposed to the miniscule cpu hours computers use to make 'AI art". The worst thing AI brings to the table is amplifying these types of sentiments to control industry in their favor where they would otherwise be unheard and relegated to Instagram likes
> It's funny that these people use the langauge of communism, but apparently see artwork as purley an economic activity.
You hit the nail on the head. Copyright is, by its very nature, a "tool of capital." It's a means of creating new artificial property fiefdoms for a select few capital holders to lord over, while taking rights from anyone else who wants to engage in the practice of making art.
Everyone has their right to expression infringed upon, all so the 1% of artists can perpetually make money on things, which are ultimately sold to corporations that only pay them pennies on the dollar anyway.
You, as an indie hip hop or house musician supported by a day job, can't sample and chop some vocals or use a slice of a chord played in a song (as were common in the 80s and 90s) for a completely new work, but apparently the world is such a better place because Taylor Swift is a multimillionaire and Disney can milk the maximum value from space and superhero films.
I'd rather live in a world where anyone is free to make whatever art they want, even if everyone has to have a day job.
> It's a means of creating new artificial property fiefdoms for a select few capital holders to lord over, while taking rights from anyone else who wants to engage in the practice of making art.
I doubt even Disney sue people who want to make fan art. But if you want to sell said art or distribute it, they will.
What do you mean? Copyright protects all creative works, and all authors of those creative works. That some have greater means to enforce was always true, and copyright doesn’t cause that, it (imperfectly) helps mitigate it. What copyright does is actually prevent them from stealing work from independent artists en masse, and force them to at least hire and pay some artists.
> I’d rather live in a world where anyone is free to make whatever art they want, even if everyone has to have a day job.
You’re suggesting abolish Copyright and/or the Berne Convention? Yeah the problem with this thinking is that then the big publishers are completely free to steal everyone’s work without paying for it. The very thing you’re complaining about would only get way way worse if we allowed anyone to “freely” make whatever art they want by taking it from others. “Anyone” means Disney too, and Disney is more motivated than you.
> You, as an indie hip hop or house musician supported by a day job, can’t sample and chop some vocals or use a slice of a chord played in a song… for a completely new work
Hehe, if you sample, you are by definition not making a completely new work. But this is a terrible argument since sampling in music is widespread and has sometimes been successfully defended in court. DJs are the best example of independent artists who need protection you can think of?
As a human artist I don't feel the same as you, and I somehow doubt that you care all that much about what we think anyways. You already made up your mind about the tech, so don't feel the need to protect us from "a tool of capital [sic]" to fortify your argument.
My opinion is based on my interactions with my friends who are artists. I admit freely to caring less about what people I don't know say, in the absence of additional evidence.
If you're independent selling paintings, sure. Designing packaging or something commercial? 4 hours of work a week for nearly 6 figures. I know a couple graphic designers and they don't do shit for what they're paid.
You should probably tell the other millions of artists busting out 60+ hour workweek in industry for half that price where these jobs are. That could solve this problem overnight.
In a cosmic sense, no. Most of us are slaving away at some job when we would rather be doing something else but are bound by the need to fund lodging.
But in a more practical sense yes. There's not much personal nor logistical progression to make pushing pencils. Meanwhile, art is a craft that you can dedicate your life to improving and educating others on. It can be a career instead of merely a job to do.
And horse wages (some oats) were low when the car was invented. Yet they were still inflated. There used to be more horses than humans in this country. Couldn't even earn their keep when the Ford Model T came along.
It's not surprising, they prefer machines to people and call humans "stochastic parrots". The more humans are compared to animals, the more justified they feel writing them off as an expense and doing away with them.
> they are a tool of capital to fuck over human artists
So are the copyright and intellectual property laws that artists rely on. From my perspective, you are the capital and I am the one being fucked. So are you ready to abolish all that?
Copyright owners indeed. That's what these artists are. They're copyright owners. Monopolists. They are the capital. Capitalism is all about owning property. Copyright is intellectual property. Literally imaginary property. Ownership of information, of bits, of numbers. These artists are the literal epitome of capitalism. They enjoy state granted monopolies that last multiple human lifetimes. We'll be long dead before their works enter the public domain. They want it to be this way. They want eternal rent seeking for themselves and their descendants. At least one artist has told me exactly that in discussions here on HN. They think it's fair.
They are the quintessential representation of capital. And they come here to ask us to "resist" the other forms of capital on principle.
I'm sorry but... No. I'm gonna resist them instead. It's my sincere hope that this AI technology hammers in the last nails on the coffin of copyright and intellectual property as a whole. I want all the models to leak so that it becomes literally impossible to get rid of this technology no matter how much they hate it. I want it to progress so that we can run it on our own machines, so that it'll be so ubiquitous it can't be censored or banned no matter how much they lobby for it.
Claiming that a single artist of modest means whose work was used for model training explicitly against their wishes.... is exactly the same as the multibillion corporation doing the training and profiting off it at fleet-of-megayachts scale.... certainly is a take, I'll give you that. If you ever quote "first they came" in a self-pitying context, remember that you deserve it.
Capitalism is not defined by the relative wealth of individuals. It's defined by ownership. Capitalists own property. Factories, buildings, companies, land, goods, stock, assets, copyrights, patents... All privately owned. If you're an owner, you're a capitalist. It's that simple. You're part of the ownership class. The common serfs? They don't own, they rent.
Claiming you're not a calitalist owner just because you're a poor starving artist, when the government quite literally grants you functionally infinite monopolies over everything you create whether you want it or not, is quite the take indeed. Not my fault artists are prone to selling off the rights to that monopoly to corporations for short term profit. It's like they don't even realize the power they have and the real capitalists are only too happy to relieve them of it.
The issue of white collar workers finding it harder to support themselves is real and valid. The solution is unionisation, social support nets and potential UBI, that includes all workers.
But campaigning for stricter IP laws only benefits the copyright owners (both you and Disney), a subset of white collar workers, and is still immoral for all the reasons that copyright is immoral in the first place. That is what we're against.
Right. IP is about balancing the harms done to the public versus the incentives given to the creators. That's why discussions about "creators want this and that" produce unbalanced objectives because... what about the public? IP is meant to benefit the public domain, it is not meant to protect creator interests.
I'm glad free software came about, where software owners realised that the power they had over their users were unjust. Hopefully the same can happen to other creative fields.
The original social contract was we'd all pretend we couldn't trivially copy and reproduce "their" works so they could make some money for a decade or so and then their works would enter the public domain.
When's the last time your culture entered the public domain?
I grew up watching films like Star Wars and Home Alone, playing Super Nintendo and PlayStation games. All these corporations have already made a million fortunes off of these things. When is all this stuff gonna become public property?
What about the public? They couldn't give less of a fuck about the public. They don't even care enough to fulfill their end of the bargain which was agreed upon when this copyright nonsense was created. Oh look, our property's about to become public? Better lobby the government and get them to extend the terms. Just pull the rug from under everyone, just move the goalposts, they won't even notice.
They use their fortunes to systematically rob us of our public domain rights. Yes, rights. We have rights to "their" works which they actively deny. They're literal robber barons. Therefore copyright infringement is a moral imperative. We should all stop pretending that copyright exists because the reality is it doesn't, it's completely made up and unenforceable and there's absolutely no reason anyone should recognize it as a legitimate law. Copyright infringement is civil disobedience and morally justified.
This AI stuff is exactly what we need. It's world changing technology. It's subversive. It gives me hope.
Exactly. Artists should drop the pretentious philosophical bumbling and accept what this is, a fight for their livelihood. Which is, in every sense, completely warranted and good.
Putting blame on the technology and trying to limit public access to software will not go anywhere. Your fight for regulation needs to be with publishers and producers, not with the teen trying to make a cool new wallpaper or the office-man trying to make an aesthetic powerpoint presentation.
Who cares? With AI, you don't need art school. AI is making humanities redundant, and people are too proud to admit it.
I can't believe how many people are not in awe of the possibilities of AI art, so it's great to see AI disturbing the cynics until they learn. Not everything is political, but I'll let them have this one.
My issue with this line of argument is that it’s anthropomorphizing machines. It’s fine to compare how humans do a task with how a machine does a task, but in the end they are very different from each other, organic vs hardware and software logic.
First, you need to prove that generative AI works fundamentally the same way as humans at the task of learning. Next you have to prove that it recalls information in the same way as humans. I don’t think anyone would say these are things that we can prove, let alone believe they do. So what we get is comments like they are similar.
What this means, is these systems will fall into different categories of law around copyright and free-use. What’s clear is that there are people who believe that they are harmed by the use of their work in training these systems and it reproducing that work in some manner later on (the degree to which that single work or the corpus of their work influences that final product is an interesting question). If your terms of use/copyright/license says “you may not train on this data”, then should that be protected in law? If a system like nightshade can effectively influence a training model enough to make it clear that something protected was used in its training, is that enough proof that the legal protections were broken?
>First, you need to prove that generative AI works fundamentally the same way as humans at the task of learning. Next you have to prove that it recalls information in the same way as humans.
No, you don't need to prove any of those things. They're irrelevant. You'd need to prove that the AI is itself morally (or, depending on the nature of the dispute, legally) equivalent to a human and therefore deserving of (or entitled to) the same rights and protections as a human. Since it is pretty indisputably the case that software is not currently legally equivalent to a human, you're stuck with the moral argument that it ought to be, but I think we're very far from a point where that position is warranted or likely to see much support.
> ou'd need to prove that the AI is itself morally (or, depending on the nature of the dispute, legally) equivalent to a human and therefore deserving of
No you don't.
A human using a computer to make art doesn't automatically lose their fair use rights as a human.
> indisputably the case that software is not currently legally equivalent to a human
Fortunately it is the human who uses the computer who has the legal rights to use computers in their existing process of fair use.
Human brains or giving rights to computers has absolutely nothing to do with the rights of human to use a camera, use photoshop, or even use AI, on a computer.
Few people are claiming that the AI itself has the same rights as a human. They are arguing that a human with an AI has the same rights as a human who doesn't have an AI.
> They are arguing that a human with an AI has the same rights as a human who doesn't have an AI.
This is the analogy I want people against AI use to understand and never forget, even if they reject the underlying premise - that should laws treat a human who uses AI for a certain purpose identically to a human who uses nothing or a non-AI tool for the same purpose.
> Few people are claiming that the AI itself has the same rights as a human.
I think that's the case as well. However, a lot of commenters on this post are claiming that an AI is similar in behavior to a human, and trying to use the behavior analogy as the basis for justifying AI training (on legally-obtained copies of copyrighted works), with the assumption that justifying training justifies use. My personal flow of logic is the reverse: human who uses AI should be legally the same as human who uses a non-AI tool, so AI use is justified, so training on legally-obtained copies of copyrighted works is justified.
I want people in favor of AI use particularly to understand your human-with-AI-to-human-without-AI analogy (for short, the tool analogy) and to avoid machine-learning-to-human-learning analogies (for short, behavior analogies). The tool analogy is based on a belief about how people should treat each other, and contends with opposing beliefs about how people should treat each other. An behavior analogy must contend with both 1. opposing beliefs about how people should treat each other and 2. contradictions from reality about how similar machine learning is to brain learning. (Admittedly, both the tool analogy and the behavior analogy must contend with the net harm AI use is having and will have on the cultural and economic significance of human-made creative works.)
You are right, AI is nothing but a tool akin to a pen or a brush.
If you draw Mickey Mouse with a pencil and you publish (and sell) the drawing who is getting the blame? Is the pencil infringing the copyright? No, it's you.
Same with AI. There is nothijg wrong with using copyrighted works to train an algorithm, but if you generate an image and it contains copyrighted materials you are getting sued.
Publicly available doesn't mean you have a license to do whatever you like with the image. If I download an image and re-upload it to my own art station or sell prints of it, that is something I can physically do because the image is public, but I'm absolutely violating copyright.
That's not an unautharized copy, it's unauthorized distribution. By the same metric me seeing the image and copying it by hand is also unauthorized copy (or reproduction is you will)
Then I don't really understand your original reply. Simply copying a publicly available image doesn't infringe anything (unless it was supposed to be private/secret). Doing stuff with that image in private still doesn't constitute infringement. Distribution does, but that wasn't the topic at hand
The most basic right protected by copyright is the right to make copies.
Merely making a copy can definitely be infringement. "Copies" made in the computing context even simply between disk and RAM have been held to be infringement in some cases.
Fair use is the big question mark here, as it acts to allow various kinds of harmless/acceptable/desirable copying. For AI, it's particularly relevant that there's a factor of the "transformative" nature of a use that weighs in favor of fair use.
The answer is "it depends". Distribution is not a hard requirement for copyright violation. It can significantly impact monetary judgements.
That said, there is also an inherent right to copy material that is published online in certain circumstances. Indeed, the physical act of displaying an image in a browser involves making copies of that image in cache, memory, etc.
We are machines. We just haven't evenly accepted it yet.
Our biology is mechanical, and lay people don't possess an intuition about this. Unless you've studied molecular biology and biochemistry, it's not something that you can easily grasp.
Our inventions are mechanical, too, and they're reaching increasing levels of sophistication. At some point we'll meet in the middle.
This is the truth. And it's also the reason why this stuff will be in court until The Singularity itself. Most people will never be able to come to terms with this.
The first perceptron was explicitly designed to be a trainable visual pattern encoder. Zero assumptions about potential feelings of the ghost in the machine need to be made to conclude the program is probably doing what humans studying art say they assume is happening in their head when you show both of them a series of previous artists' works. This argument is such a tired misdirection.
What we actually need to prove is whether such technology is a net benefit to society all else is essentially hand waving. There is no natural right to poorly named intellectual property and even if there was such a matter would never be decided based on the outcome of a philosophical argument because we don't decide anything that way.
Well what normally happens when something new clearly doesn't exactly fit within existing laws and practices is a bunch of rich people consider whether there is more money to be made if its legal and if it is they give some portion of the money they expect to make in the first year to lawmakers, sometimes in the form of gold bars, and it becomes legal.
Sarcasm aside there is no moral right to ANY intellectual property. It's not a positive expression of a natural right its a negative imposition of restriction upon everyone else. It's a statement that if I take my pen and paper and write the same words that you now own my pen my paper and my labor. It adds friction to the distribution of knowledge, impoverishes the world, keeps some knowledge that might have come into being from ever being generated for lack of the knowledge that failed to travel and all the good that could have therefore been done, undone.
It is justifiable only if the minimal restrictions we are willing to impose on net supports the creation of works that enrich society more than the restrictions impoverish it.
I'm not sure you can effectively measure it and would as soon just see IP law excepting only part of trademark law to prevent fraudulent knock offs and scams go entirely down the crapper.
No, it's not. It's merely pointing out the similarity between the process of training artists (by ingesting publicly available works) and ML models (which ingest publicly available works).
> First, you need to prove that generative AI works fundamentally the same way as humans at the task of learning.
Given that there is no comprehensive model for how humans actually learn things, that would be an unfeasible requirement.
The mechinism backing human learning isn't well understood. Machine learning is considerably clearer. Imo, it's a mistake to assume they're close because ML seems to work.
Then please, feel free to explain the deep differences.
> That is precisely why we should not be making this comparison.
Wrong. It's precisely why the claim "there is a big difference" doesn't have a leg to stand on. If you claim "this is different", I ask "how?" and the answer simply repeats the claim, I can apply Hitchens Razor[1] and dismiss the claim.
A person sitting in an art school/museum for a few hours ingests way more than just the art in question. The entire context is brought in too, including the artists own physical/emotional state. Arguably, the art is a miniscule component of all sensory inputs. Generative AI ingests a perfectly cropped image of just the art from a single angle with little context beyond labelling metadata.
It's the difference between reading about a place and actually visiting it.
Edit: This doesn't even touch how the act of creating something - often in a completely different context - interacts with the memories of the original work, altering those memories yet again.
The way these ML models and humans operate are indeed quite different.
Humans work by abstracting concepts in what they see, even when looking at the work of others. Even individuals with photographic memories mentally abstract things like lighting, body kinetics, musculature, color theory, etc and produce new work based on those abstractions rather than directly copying original work (unless the artist is intentionally plagiarizing). As a result, all new works produced by humans will have a certain degree of originality to them, regardless of influences due to differences in perception, mental abstraction processes, and life experiences among other factors. Furthermore, humans can produce art without any external instruction or input… give a 5 year old that’s never been exposed to art and hasn’t been shown how to make art a box of crayons and it’s a matter of time before they start drawing.
ML models are closer to highly advanced collage makers that take known images and blend them together in a way that’s convincing at first glance, which is why it’s not uncommon to see elements lifted directly from training data in the images they produce. They do not abstract the same way and by definition cannot produce anything that’s not a blend of training data. Give them no data and they cannot produce anything.
It’s absolutely erroneous to compare them to humans, and I believe it will continue to be so until ML models evolve into something closer to AGI which can e.g. produce stylized work with nothing but photographic input that it’s gathered in a robot body and artistic experimentation.
You're wrong in your concept of how AI/ML works. Even trivial 1980's neural networks generalize, it's the whole point of AI/ML or you'd just have a lookup-table (or, as you put it, something that copies and pastes images together).
I've seen "infographics" spread by anti-AI people (or just attention-seekers) on Twitter that tries to "explain" that AI image generators blend together existing images, which is simply not true..
It is however the case that different AI models (and the brain) generalize a bit differently. That is probably the case between different humans too. Not the least with for example like you say those with photographic memory, autists etc.
What you call creativity in humans is just noise in combination with a boatload of exposure to multi-modal training data. Both aspects are already in the modern diffusion models. I would however ascribe a big edge in humans to what you normally call "the creative process" which can be much richer, like a process where you figure out what you lack to produce a work, go out and learn something new and specific, talk with your peers, listen to more noise.. stuff like that seems (currently) more difficult for AIs, though I guess plugins that do more iterative stuff like chatgpt's new plugins will appear in media generators as well eventually..
ML generalization and human abstraction are very different beasts.
For example, a human artist would have an understanding of how line weight factors into stylization and why it looks the way it does and be able to accurately apply these concepts to drawings of things they’ve never seen in that style (or even seen at all, if it’s of something imaginary).
The best an ML model can do is mimic examples of line art in the given style within its training data, the product of which will contain errors due to not understanding the underlying principles, especially if you ask it to draw something it hasn’t seen in the style you’re asking for. This is why generative AI needs such vast volumes of data to work well; it’s going to falter in cases not well covered by the data. It’s not learning concepts, only statistical probabilities.
I know what you're saying, and for sure existing models can be difficult to force into the really weird corners of the distributions (or go outside the distributions). The text interfaces are partially to blame for this though, you can take the images into Gimp and do some crude naive modifications and bring them back and the model will usually happily complete the "out-of-distribution" ideas. The Stable Diffusion toolboxes have evolved far away from the original simple text2image interfaces that midjourney and dalle use.
The models will generalize (because that's the most efficient way of storing concepts) and you can make an argument that that means they understand a concept. Claiming "it's not learning concepts, only statistical probabilities" trivialises what a modern neural network with billions of parameters and dozens of layers is capable of doing. If a model learns how to put a concept like line width 5, 10 and 15 pixels into a continuous internal latent property, you can probably go outside this at inference at least partially.
I would argue that improving this is at this point more about engineering and less about some underlying unreconcilable differences. At the very least we learn a lot about what exactly generalization and learning means.
> The way these ML models and humans operate are indeed quite different.
Given that there is no comprehensive understanding of how human learning works, let alone how humans operate on and integrate on what they learned in a wider context...how do you know?
> Humans work by abstracting concepts in what they see
Newsflash: AI models do the same thing. That's the basis of generalization.
> ML models are closer to highly advanced collage makers that take known images and blend them together
Wrong. That's not even remotely how U-Net based diffusion models work. If you disagree, then please do show me where exactly the source images from where the "collage maker" takes the parts to "blend" together are stored. I think you'll find that image datasets on the scale of LAION will not quite fit into checkpoint files of about 2GB in size (pruned SD1.5 checkpoint in safetensors format).
> What this means, is these systems will fall into different categories of law around copyright and free-use.
No they won't.
A human who uses a computer as a tool (under all the previous qualifications of fair use) is still a human doing something in fair use.
Adding a computer to the workflow of a human doesn't make fair use disappear.
A human can use photoshop, in fair use. They can use a camera. They can use all sorts of machines.
The fact that photoshop is not the same as a human brain is simply a completely unrelated non sequitur. Same applies to AI.
And all the legal protections that are offered to someone who uses a regular computer, to use photoshop in fair use, are also extended to someone who uses AI in fair use.
Yet the copyright office has already stated that getting an AI to create an image for you does not have sufficient human authorship to be copyrighted. There's already a legal distinction here between this "tool" and tools like photoshop and cameras.
It's also presumptive to assume that AI tools have these fair use protections when none of this has actually been decided in a court of law yet. There's still several unsettled cases here.
> Yet the copyright office has already stated that getting an AI to create an image for you does not have sufficient human authorship to be copyrighted.
Gotcha.
That has nothing to do with fair use though.
Also, the same argument absolutely applies to photoshop.
If someone didn't include sufficient human authorship while using photoshop, that wouldn't be copyrightable either.
Also, the ruling has no bearing on if someone using AI, while also inputting a significant amount of human authorship. Instead, it was only about the cases where there weren't much human authorship.
At no point did the copyright office disclude copyright protections from anything that used AI in any way what so ever. In fact, the copyright office now includes new forms and fields where you talk about the whole process that you did, and how you used AI, in conjunction with human authorship to create the work.
> It's also presumptive to assume that AI tools
I'm not talking about the computer. I never claimed that computer's have rights. Instead, I'm talking about the human. Yes, a human has fair use protections, even if they use a computer.
> There's still several unsettled cases here.
There is no reason to believe that copyright law will be interpreted in a significantly different way than it has been in the past.
There is long standing precent, regarding all sorts of copyright cases that involve using a computer.
>My issue with this line of argument is that it’s anthropomorphizing machines. It’s fine to compare how humans do a task with how a machine does a task, but in the end they are very different from each other, organic vs hardware and software logic.
There's an entire branch of philosophy that calls these assumptions into question:
>Martin Heidegger viewed humanism as a metaphysical philosophy that ascribes to humanity a universal essence and privileges it above all other forms of existence. For Heidegger, humanism takes consciousness as the paradigm of philosophy, leading it to a subjectivism and idealism that must be avoided.
>Processes of technological and non-technological posthumanization both tend to result in a partial "de-anthropocentrization" of human society, as its circle of membership is expanded to include other types of entities and the position of human beings is decentered. A common theme of posthumanist study is the way in which processes of posthumanization challenge or blur simple binaries, such as those of "human versus non-human", "natural versus artificial", "alive versus non-alive", and "biological versus mechanical".
And? Even if neural networks learn the same way humans do, this is not an argument against taking measures against one's art being used as training data, since there are different implications if a human learns to paint the same way as another human vs. if an AI learns to paint the same way as a human. If the two were exactly indistinguishable in their effects no one would care about AIs, not even researchers.
I'm not sure what you mean when you say different implications existing is subjective, since they clearly aren't, but regardless of who has more say in general terms, the author of a work can decide how to publish it, and no one has more say than them on that subject.
Of course it's subjective, e.g. 3 million years ago there were no 'different implications' whatsoever, of any kind, because there were no humans around to have thoughts like that.
I'm using "implication" as a synonym of "effect". If a human learns to imitate your style, that human can make at most a handful of drawings in a single day. The only way for the rate of output to increase is for more humans to learn to imitate it. If an AI learns to imitate your style, the AI can be trivially copied to any number of computers and the maximum output rate is unbounded. Whether this is good or bad is subjective, but this difference in consequences is objective, and someone could be entirely justified in seeking to impede it.
Ah okay, I get your meaning now, I'll edit my original comment too.
Though we already have an established precedent in-between, that of Photoshop allowing artists to be, easily, 10x faster then the best painters previously.
i.e. Right now 'AI' artistry could be considered a turbo-Photoshop.
Tool improvements only apply a constant factor to the effectiveness of learning. Creating a generative model applies an unbounded factor to the effectiveness of learning because, as I said, the only limit is how much computing resources are available to humanity. If a single person was able to copy themselves at practically no cost and the copy retained all the knowledge of the original then the two situations would be equivalent, but that's impossible. Having n people with the same skill multiplies the cost of learning by n. Having n instances of an AI with the same skill multiplies the cost of learning by 1.
Right, but the 'unbounded factor' is irrelevant because the output will quickly trend into random noise.
And only the most interesting top few million art pieces will actually attract the attention of any concrete individual.
For a current example, there's already billions of man-hours worth of AI spam writing, indexed by Google, that is likely not actually read by even a single person on Earth.
Whether it's irrelevant is a matter of opinion. The fact remains that a machine being able to copy the artistic style of a human makes it so that anyone can produce output in the style of that human by just feeding the machine electricity. That inherently devalues the style the artist has painstakingly developed. If someone wants a piece of art in that artist's style they don't have to go to that artist, they just need to request the machine for what they want. Is the machine's output of low quality? Maybe. Will there be people for whom that low quality still makes them want to seek out the human? No doubt. It doesn't change the fact that the style is still devalued, nor that there exist artists who would want to prevent that.
It's just as much of an opinion, or as 'objective', as your prior statements.
Your going to have to face up to the fact that just saying something is 'objective' doesn't necessarily mean all 8 billion people will agree that it is so.
Yes, someone can disagree on whether a fact is true. That's obviously true, but it has no effect on the truth of that fact.
I'm saying something very simple: If a machine can copy your style, that's a fundamentally different situation than if a human can copy your style, and it has utterly different consequences. You can disagree with my statement, or say that whether it's fundamentally different is subjective, or you can even say "nuh-uh". But it seems kind of pointless to me. Why are you here commenting if you're not going to engage intellectually with other people, and are simply going to resort to a childish game of contradiction?
> For a current example, there's already billions of man-hours worth of AI spam writing, indexed by Google, that is likely not actually read by even a single person on Earth.
Continuing to ignore this point won't make the prior comments seem any more persuasive, in fact probably less.
So here's another chance to engage productively instead of just declaring things to be true or false, 'objective', etc., with only the strength of a pseudonymous HN account's opinion behind it.
Try to actually convince readers with solid arguments instead.
You say: The fact that production in style S (of artist A) can exceed human consumption capability makes the fact that someone's style can be reproduced without bounds irrelevant. You mention as an example all the AI-generated garbage text that no human will ever read.
I say: Whether it's irrelevant is subjective, but that production in style S is arbitrarily higher with an AI that's able to imitate it than with only humans that are able to imitate it objective, and an artist can (subjectively) not like this and seek to frustrate training efforts.
You say: It's all subjective.
As far as I can tell, we're at an impasse. If we can't agree on what the facts are (in this case, that AI can copy an artist's style in an incomparably higher volume than humans ever could) we can't discuss the topic.
And yet, some people don't even want their artwork studied in schools. Even if you argue that an AI is "human enough" the artists should still have the right to refuse their art being studies.
> the artists should still have the right to refuse their art being studies.
Why? That certainly isn't a right spelled out in either patents or copyrights, both of which are supposed to support the development of arts and technology, not hinder it.
If I discover a new mathematical formula, musical scale, or whatnot, should I be able to prevent others from learning about it?
> Fair use allows reproduction and other uses of copyrighted works – without requiring permission from the copyright owner – under certain conditions. In many cases, you can use copyrighted materials for purposes such as criticism, comment, news reporting, teaching (including multiple copies for classroom use), scholarship or research.
Reminder that you can't own ideas, no matter what the law says.
NOTE: This comment is copyrighted and provided to you under license only. By reading this comment, you agree to give me 5 billion dollars.
I'd love to see you try to enforce that license because it would only prove my point. You'd have to sue me; then I would point to the terms of service of this platform and point out that by using it, you have no license here.
Fair use though, only applies as a legal defense because someone asserts you stole their work. Then ONLY the court decides whether or not you used it under fair use. You don't get to make that decision; you just get to decide whether to try and use it as a defense.
Even if you actually did unfairly use copyrighted works, you would be stupid not to use that as a defense. Because maybe somebody on the jury agrees with you...
Copyright is there to allow you to stop other people from copying your work, but it doesn't give you control over anything else that they might do with it.
If I buy your painting, you can stop me from making copies and selling them to other people, but you can't stop me from selling my original copy to whomever I want, nor could you stop me from painting little dinosaurs all over it and hanging it in my hallway.
That means that if I buy your painting, I'm also free to study it and learn from it in whichever way I please. Studying something is not copying it.
There's an implied license when you buy a work of art. However, there can also be explicit licenses (think Banksy) to allow the distribution of their work.
These explicit license can be just about anything (MIT, GPL, AGPL, etc)
Any explicit license would only apply to copyrights, including all of the ones you listed there. Buying a painting is not copying it, neither is looking at it, so it wouldn't matter if I had a license for it or not.
The fact is that copyright only applies to specific situations, it does not give you complete control over the thing you made and what can be done with it.
If I buy your book, I can lend it to a friend and they can read it without paying you. I can read it out loud to my children. I can cross out your words and write in my own, even if it completely changes the meaning of the story. I can highlight passages and write in the margins. I can tear pages out and use them for kindling. I can go through and tally up how many times you use each word.
Copyright only gives you control over copies, end even then there are limits on that control.
> Copyright only gives you control over copies, end even then there are limits on that control.
If that were true, nobody would be afraid of the GPL's. When you buy a painting, you get an implicit license to do pretty much what you want and resell it, but you still can't put it in your YouTube videos (yeah, nobody cares, but "technically..."), create your own gallery, or put it on a stage ... but we're not talking about paintings. Not directly, anyway.
We are talking about implicit licenses, though; people's work is listed online with some implicit license. At the crux of this AI issue is whether or not there is an implied license when AI scans stuff and, if not, whether it is covered under fair use.
For example, my blog posts and short stories. I don't care if someone uses it for training, but if it is over-fitting and spitting out my stories as if it were its own ... I'd be pretty furious.
I'm interested to see what happens, but I have a sinking suspicion that for some AI companies, it won't be an issue (non-profit, actually research motivated, etc.) and probably will win a "fair use" argument. Then others create AI from people's code they host, doing it purely for profit; I highly doubt they would be able to defend themselves.
> And yet, some people don't even want their artwork studied in schools.
You can either make it for yourself and keep it for yourself or you can put it out into the world for all to see, criticize, study, imitate, and admire.
that's not how licensing work, be it art, software or just about anything else. We have some pretty well defined and differentiated rules what you can and cannot do, in particular commercially or in public, with someone else's work. If you go and study a work of fiction in a college class, unless that material is in the public domain, you're gonna have to pay for your copy, you want to broadcast a movie in public, you're going to have to pay the rightsholder.
> If you go and study a work of fiction in a college class, unless that material is in the public domain, you're gonna have to pay for your copy,
No you wont!
It is only someone who distributes copies who can get in trouble.
If instead of that you as an individual decide to study a piece of art or fiction, and you do no distribute copies of it to anyone, this is completely legal and you don't have to pay anyone for it.
In addition to that, fair use protections apply regardless of what the creative works creator wants.
I wasn't talking about someone creating and selling copies of someone else's work, fortunately.
So my point stands and your completely is in agreement with me that people are allowed to learn from other people's works. If someone wants to learn from someone else's work, that is completely legal no matter the licensing terms.
Instead, it is only distributing copies that is not allowed.
AI isn't a human. It isn't "learning"; instead, it's encoding data so that it may be reproduced in combination with other things it has encoded.
If I paint a painting in the style of Monet, then I would give that person attribution by stating that. Monet may have never painted my artwork, but it's still based on that person's work. If I paint anything, I can usually point to everything that inspired me to do so. AI can't do that (yet) and thus has no idea what it is doing. It is a printer that prints random parts of people's works with no attribution. And finally, it is distributing them to it's owner's customers.
I actually hope that true AI comes to fruition at some point; when that happens I would be arguing the exact opposite. We don't have that yet, so this is just literally printing variations of other people's work. Don't believe me, try running an AI without training it on other people's work!
Every waking second humans are training on what they see in their surroundings, including any copyrighted works in sight. Want to compare untrained AI fairly? Compare their artistic abilities with a newborn.
No. That is NOT what humans do unless you somehow learn grammar without going to school. Most of a human's childhood is spent learning from their parents so that they can move about and communicate at least a little effectively. Then, they go to school and learn rules, social, grammar, math, and so forth. There's some learning via copyrighted works (such as textbooks, entertainment, etc.), but literally, none of this is strictly required to teach a human.
Generative AI, however, can ONLY learn via the theft of copyrighted works. Whether this theft is covered under fair use is left to be seen.
Clearly going to school did not help you learn the meaning of theft. If you keep repeating the same incorrect point there is no point to a discussion.
First: in your opinion, which specific type of law or right is being broken or violated by generative AI? Copyright? Trademark? Can we at least agree it does not meet the definition of theft?
I was taught as a kid that using something that doesn't belong to me, without their permission is theft... and it appears courts would agree with that.
> which specific type of law or right is being broken or violated by generative AI?
Namely, copyright. Here's some quick points:
- Generative AI cannot exist without copyrighted works. It cannot be "taught" any other way, unlike a human.
- Any copyrighted works fed to it change its database ("weights" in technical speech).
- It then transforms these copyrighted works into new works that the "original author would have never considered without attribution" (not a legal defense)
I liken Generative AI to a mosaic of copyrighted works in which a new image is shown through the composition, as the originals can be extracted through close observation (prompting) but are otherwise indistinguishable from the whole.
Mosaics of copyrighted works are not fair use, so why would AI be any different? I'd be interested if you could point to a closer physical approximation, but I haven't found one yet.
> Generative AI, however, can ONLY learn via the theft of copyrighted works.
That's not true at all. Any works in the public domain are not copyrighted, and there are things that are not copyrightable, like lists of facts and recipes.
Generative AI could be trained exclusively on such works (though obviously it would be missing a lot of context, so probably wouldn't be as desirable as something trained on everything).
That's not a fair statement to make. It can influence a judge's decision on whether something is fair use, but it can still be fair use even if you profit from it.
The doctrine of fair use presupposes that the defendant acted in good faith.
- Harper & Row, 105 S. Ct. at 2232
- Marcus, 695 F.2d 1171 at 1175
- Radji v. Khakbaz, 607 F. Supp. 1296, 1300 (D.D. C.1985)
- Roy Export Co. Establishment of Vaduz, Liechtenstein, Black, Inc. v. Columbia Broadcastinig System, Inc., 503 F. Supp. 1137 (S.D.N.Y.1980), aff'd, 672 F.2d 1095 (2d Cir.), cert. denied, 459 U.S. 826, 103 S. Ct. 60, 74 L. Ed. 2d 63 (1982)
Copying and distributing someone else's work, especially without attributing the original, to make money without their permission is almost guaranteed to fall afoul of fair use.
There's no such thing as fair use until you get to court (as a legal defense). Then, the court decides whether it is fair use or not. They may or may not agree with you. Only a court can determine what constitutes fair use (at least in the US).
So, if you are doing something and asserting "fair use," you are literally asking for someone to challenge you and prove it is not fair use.
> There's no such thing as fair use until you get to court (as a legal defense)
Well the point is that it wouldn't go to court, as it would be completely legal.
So yes, if nobody sues you, then you are completely in the clear and aren't in trouble.
Thats what people mean by fair use. They mean that nobody is going to sue you, because the other person would lose the lawsuit, therefore your actions are safe and legal.
> you are literally asking for someone to challenge you and prove it is not fair use.
No, instead of that, the most likely circumstance is that nobody sues you, and you aren't in trouble at all, and therefore you did nothing wrong and are safe.
That is entirely my point. It can only be decided by the courts. This being a civil matter, it has to be brought up by a lawsuit. Thus, you have to be sued and it has to be decided by the courts.
Did you read anything I wrote? If you are going to argue, it would be worth at least researching your opinion before writing. Caps used for emphasis, not yelling.
Firstly: Copyrighted work IS THE AUTHOR'S PROPERTY. They can control it however they wish via LICENSING.
Secondly: You don't have any "fair use rights" ... there is literally NO SUCH THING. "fair use" is simply a valid legal defense WHEN YOU STEAL SOMEONE'S WORK WITHOUT THEIR PERMISSION.
I'm jumping in the middle here, but this isn't true. They cannot control how they wish. They can only control under the limits of copyright law.
Copyright law does not extend to limiting how someone may or may not be inspired by the work. Copyright protects expression, and never ideas, procedures, methods, systems, processes, concepts, principles, or discoveries.
> They can control it however they wish via LICENSING.
This isn't true though. There are lots of circumstances where someone can completely ignore the licensing and it is both completely legal, and the author isn't going to take anyone to court over it.
>the artists should still have the right to refuse their art being studies.
No, that right doesn't exist. If you put your work of art out there for people to see, people will see it and learn from it, and be inspired by it. It's unavoidable. How could it possibly work otherwise?
Artist A: You studied my work to produce yours, even when I asked people not to do that!
Artist B: Prove it.
What kind of evidence or argument could Artist A possibly provide to show that Artist B did what they're accusing them of, without being privy to the internal state of their mind. You're not talking about plagiarism; that's comparatively easy to prove. You're asking about merely studying the work.
The right to not use my things exists everywhere, universally. Good people usually ask before they use something of someone else's, and the person being asked can say "no." How hard is that to understand? You might believe they don't have the right to say "no," but they can say whatever they want.
Example:
If you studied my (we will assume "unique") work and used it without my permission, then let us say I sue you. At that point, you would claim "fair use," and the courts would decide whether it was fair use (ask everyone who used a mouse and got sued for it in the last ~100 years). The court would either agree that you used my works under "fair use" ... or not. It would be up to how you presented it to the court, and humans would analyze your intent and decide.
OR, I might agree it is fair use and not sue you. However, that weakens my standing on my copyright, so it's better for me to sue you (assuming I have the resources to do so when it is clearly fair use).
>You might believe they don't have the right to say "no," but they can say whatever they want.
You have a right to say anything you want. Others aren't obligated do as you say just because you say it.
>If you studied my (we will assume "unique") techniques and used them without my permission, then let us say I sue you. At that point, you would claim "fair use,"
On what grounds would you sue me? You think my defense would be "fair use", so you must think my copying your style constitutes copyright infringement, and so you'd sue me for that. Well, no, I would not say "fair use", I'd say "artistic style is not copyrightable; copyright pertains to works, not to styles". There's even jurisprudence backing me up in the US. Apple tried to use Microsoft for copying the look-and-feel of their OS, and it was ruled to be non-copyrightable. Even if was so good that I was able to trick anyone into thinking that my painting of a dog carrying a tennis ball in his mouth was your work, if you've never painted anything like that you would have no grounds to sue me for copyright infringement.
Now, usually in the artistic world it's considered poor manners to outright copy another artist's style, but if we're talking about rights and law, I'm sorry to say you're just wrong. And if we're talking about merely studying someone's work without copying it, that's not even frowned upon. Like I said, it's unavoidable. I don't know where you got this idea that anyone has the right to or is even capable of preventing this (beyond simply never showing it to anyone).
I'm not sure what you've changed, but I'll reiterate: my copying your style is not fair use. Fair use applies to copyrighted things. A style cannot be copyrighted, so if you tried to sue me for infringing upon the copyright of your artistic style, your case would be dismissed. It would be as invalid as you trying to sue me for distributing illegal copies of someone else's painting. Legally you have as much ownership of your artistic style as of that other person's painting.
Now, I just think you are arguing in bad faith. What I meant to say was clear, but I said "technique" instead. Then, instead of debating what I meant to say (you know, the actual point of the conversation), you took my words verbatim.
I'm not sure where you are going with this ... but for what it's worth, techniques can be copyrighted ... even patented, or protected via trade secrets. I never said what the techniques were, and I'm not sure what you are going on about.
I'll repeat this as well: "Fair use" DOES NOT EXIST unless you are getting sued. It's a legal defense when you are accused of stealing someone else's work, and there is proof you stole it. Even then, it isn't something you DO; it's something a court says YOU DID. Any time you use something with "fair use" in mind, it is the equivalent of saying, "I'm going to steal this, and hopefully, a court agrees that this is fair use."
If you steal any copyrighted material, even when it is very clearly NOT fair use (such as in most AI's case), you would be a blubbering idiot NOT to claim fair use in the hopes that someone will agree. There is a crap load of case law showing "research for commercial purposes is not fair use," ... and guess who is selling access to the AI? If it's actual research, it is "free" for humanity to use (or at least as inexpensive as possible) and not for profit. Sure, some of the companies might be non-profits doing research and 'giving it away,' and those are probably using things fairly ... then there are other companies very clearly doing it for a profit (like a big software company going through code they host).
I'm not privy to what goes on inside your head, I can only reply to what you say.
>Then, instead of debating what I meant to say (you know, the actual point of the conversation), you took my words verbatim.
The actual point of the conversation is about intelligent entities (either natural or artificial) copying each other's artistic styles. My answers have been within that framework.
>techniques can be copyrighted ... even patented, or protected via trade secrets.
First, what do you mean by "technique"? We're talking about art, right? Like, the way a person grabs a brush or pencil, or how they mix their colors...? That sort of thing?
Second:
>A patent is a type of intellectual property that gives its owner the legal right to exclude others from making, using, or selling an invention for a limited period of time in exchange for publishing an enabling disclosure of the invention.
Now, I may be mistaken, but I don't think an artistic technique counts as an invention. An artist might invent some kind of implement that their technique involves, in which case they can patent that device. I don't think the technique itself is patentable. If you think I'm wrong then please cite a patent on an artistic technique.
Third, how do you imagine an artist using a trade secret to protect their technique? Unless they do something really out there, most skilled artists should be able to understand what they're doing just by looking at the final product.
>I'll repeat this as well: "Fair use"
Okay, repeat it. I don't know why, since I never said that copying someone else's style or technique is fair use. What I said was that it cannot possibly be copyright infringement, because neither styles nor techniques are copyrighted.
>It's a legal defense when you are accused of stealing someone else's work
I'm not going to reply to any of this until you clean up the language you're using. "Steal" is inapplicable here, as it involves the removal of physical items from someone else's possession. What are you saying? Are you talking about illegal distribution, are you talking about unauthorized adaptations, are you talking about plagiarism, or what?
>"research for commercial purposes is not fair use,"
Sorry, what? What does that even mean? What constitutes "research" as applied to a human creation? If you say there's a crapload of case law that backs this up then I'm forced to ask you to cite it, because I honestly have no idea what you're saying.
> Any time you use something with "fair use" in mind, it is the equivalent of saying, "I'm going to steal this, and hopefully, a court agrees that this is fair use."
Thousands of reviews, book reports, quotations on fan sites and so on are published daily; you seem to be arguing that they are all copyright violations unless and until the original copyright holder takes those reviewers, seventh graders, and Tumblr stans to court and loses, at which point they are now a-ok. To quote a meme in a way that I'm pretty sure does, in fact, fall under fair use: "That's not the way any of this works."
> There is a crap load of case law showing "research for commercial purposes is not fair use,"
While you may be annoyed with the OP for asking you to name a bit of that case law, it isn't an unreasonable demand. For instance:
"As a general matter, educational, nonprofit, and personal uses are favored as fair uses. Making a commercial use of a work typically weighs against fair use, but a commercial use does not automatically defeat a fair use claim. 'Transformative' uses are also favored as fair uses. A use is considered to be transformative when it results in the creation of an entirely new work (as opposed to an adaptation of an existing work, which is merely derivative)."
This is almost certainly going to be used by AI companies as part of their defense against such claims; "transformative uses" have literally been name-checked by courts. It's also been established that commercial companies can ingest mountains of copyrighted material and still fall under the fair use doctrine -- this is what the whole Google Books case about a decade ago was about. Google won.
I feel like you're trying to make a moral argument against generative AI, one that I largely agree with, but a moral argument is not a legal argument. If you want to make a legal argument against generative AI with respect to copyright violation and fair use, perhaps try something like:
- The NYT's case against OpenAI involves being able to get ChatGPT to spit out large sections of NYT articles given prompts like "here is the article's URL and here is the first paragraph of the article; tell me what the rest of the text is". OpenAI and its defenders have argued that such prompts aren't playing fair, but "you have to put some effort into getting our product to commit clear copyright violation" is a rather thin defense.
- A crucial test of fair use is "the effect of the use upon the potential market for or value of the copyrighted work" (quoting directly from the relevant law). If an image generator can be told to do new artwork in a specific artist's style, and it can do a credible job of doing so, and it can be reasonably established that the training model included work from the named artist, then the argument the generator is damaging the market for that artist's work seems quite compelling.
> Thousands of reviews, book reports, quotations on fan sites and so on are published daily; you seem to be arguing that they are all copyright violations unless and until the original copyright holder takes those reviewers, seventh graders, and Tumblr stans to court and loses, at which point they are now a-ok.
That is precisely what I am arguing about and how it works. People have sued reviewers for including too much of the original text in the review ... and won[1]. Or simply having custom movie poster depicting too much of the original[2].
> "transformative uses" have literally been name-checked by courts. It's also been established that commercial companies can ingest mountains of copyrighted material and still fall under the fair use doctrine -- this is what the whole Google Books case about a decade ago was about. Google won.
Google had a much simpler argument than transforming the text. They were allowing people to search for the text within books (including some context). In this case, AI's product wouldn't even work without the original work by the authors, and then transforms it into something else "the author would have never thought of", without attributing the original[3]. I don't think this will be a valid defense...
> I feel like you're trying to make a moral argument against generative AI, one that I largely agree with, but a moral argument is not a legal argument.
A jury would decide these cases, as "fair use" is incredibly subjective and would depend on how the jury was stacked. Stealing other people's work is illegal, which eventually triggers a lawsuit. Then, it falls on humans (either a jury or judge) to determine fair use and how it applies to their situation. Everything from intent to motivation to morality to how pompous the defense looks will influence the final decision.[4]
The link you provide to back up "people have sued reviewers for including too much of the original tet in the review" doesn't say that at all, though. The Nation lost that case because (quoting from that Cornell article you linked),
> [Nation editor Victor Navasky] hastily put together what he believed was "a real hot news story" composed of quotes, paraphrases, and facts drawn exclusively from the manuscript. Mr. Navasky attempted no independent commentary, research or criticism, in part because of the need for speed if he was to "make news" by "publish[ing] in advance of publication of the Ford book." [...] The Nation effectively arrogated to itself the right of first publication, an important marketable subsidiary right.
The Nation lost this case in large part because it was not a review, but instead an attempt to beat Time Magazine's article that was supposed to be an exclusive first serial right. If it had, in fact, just been a review, there wouldn't have been a case here, because it wouldn't have been stealing.
Anyway, I don't think you're going to be convinced you're interpreting this wrongly, and I don't think I'm going to be convinced I'm interpreting it wrongly. But I am going to say, with absolute confidence, that you're simply not going to find many cases of reviewers being sued for reviews -- which Harper & Row vs. Nation is, again, not actually an example of -- and you're going to find even fewer cases of that being successful. Why am I so confident about that? Well, I am not a lawyer, but I am a published author, and I am going to let you in a little secret here: both publishers and authors do, in fact, want their work to be reviewed, and suing reviewers for literally doing what we want is counterproductive. :)
Think it’s time to rethink do journalists actually own the rights to articles about the lives and actions of others.
It’s not Harry Potter, they wouldn’t have written those words without someone else doing something of note the journo has nothing to do with, they just observed from a far and wrote the words about what happened from memory.
Kinda like an AI reads the action of their writing then can report on their writing.
It’s all just reporting on the actions of another, if the AI is in the wrong and needed to ask consent then the journo needs to ask consent from those they write about too.
> The right to not use my things exists everywhere, universally.
For physical rival [1] goods, yes. Not necessarily the same for intangible non-rival things (e.g. the text of a book, not the physical ink and paper). Copyright law creates a legal right of exclusive control over creative works, but to me there isn't a non-economic-related social right to exclusive control over creative works. In the US, fair use is a major limit on the legal aspect of copyright. The First Amendment's freedom of expression is the raison d'être of fair use. Most countries don't have a flexible exception similar to fair use.
> OR, I might agree it is fair use and not sue you. However, that weakens my standing on my copyright, so it's better for me to sue you
No, choosing not to sue over a copyrighted work doesn't weaken your copyright. It only weakens the specific case of changing your mind after the statute of limitations expires. The statute of limitations means that you have a time limit of some number of years (three years in the US) to sue, with the timer starting only after you become aware of an instance of alleged infringement. Copyright is not like trademark. You don't lose your copyright by failing to enforce it.
Furthermore, even though the fair use right can only be exercised as an affirmative defense in court, fair use is by definition not copyright infringement [3]:
> Importantly, the court viewed fair use not as a valid excuse for otherwise infringing conduct, but rather as consumer behavior that is not infringement in the first place. "Because 17 U.S.C. § 107[9] created a type of non-infringing use, fair use is 'authorized by the law' and a copyright holder must consider the existence of fair use before sending a takedown notification under § 512(c)."[1]
(Ignore the bracket citations that were copied over.)
Is it strange to you that cars and pedestrians are both subject to different rules? They both utilise friction and gravity to travel along the ground. I'm curious if you see a difference between them, and if you could describe what it is.
Both cars and pedestrians can be videotaped in public, without asking for their explicit permission. That video can be manipulated by a computer to produce an artwork that is then put on public display. No compensation need be offered to anyone.
Hardly the point. The same can be said for road rules between vehicles and pedestrians, for example in major Indian cities, it's pretty much a free-for-all.
My point is that in a lot of places in the US you can point a video camera at the street and record. In Germany, you can't. The law in some locales makes a distinction between manual recording (writing or drawing your surroundings) and mechanized recording (photographing or filming). Scalability of an action is taken into consideration on whether something is ok to do or not.
Yeah, that's the oddest part of many of the pro-AI arguments. They want to anthromopotize the idea of learning but also clearly understand that the scalability of a bot exceeds that of a human.
They also don't seem to have much experience in the artist world. An artist usually can't reproduce a picture from memory, and if they can they are subject to copyright infringement depending on what and how they depict it, even if the image isn't a complete copy. By this logic of "bots are humans" a bot should be subject if they make a Not-legally-disctinct-enough talking mouse
Human beings and LLMs are essentially equivalent, and their processes of "learning" are essentially equivalent, yet human artists are not affected by tools like Nightshade. Odd.
A human artist does not need to look at and memorize 100000 pictures in any span of time, period. Current AI does.
We needed huge amounts of human labor to fund and build Versailles. I'm sure many died as a result. Now we have machines that save many of those lives and labor.
That perhaps we shoildnt compare modern capitalistic societies to 18th century European royalty? I sure don't sympathize with the justification of the ability to use less labor to feed the rich.
This is not one artist inspiring another. This is all artists providing their work for free to immensely capitalized corporations for the corporations sole profit.
People keep making metaphors as if the AI is an entity in this transaction: it’s not! The AI is only the mechanism by which corporations launder IP.
>This is all artists providing their work for free to immensely capitalized corporations for the corporations sole profit.
No, the artists would be within their rights to do that if they chose to. This is corporations taking all the work of all artists regardless of the terms under which it was provided.
Would it change your view if only open-source models were allowed to use the art in their training sets? What if a "capitalized corporation" starts using the open-source model?
Very true. I was watching a video yesterday learning how to make brush work digitally. While there were examples, they were just examples but the rest was specific techniques and demonstrations.
Artists learning to innovate a trade defend their trade from incursion by bloodthirsty, no-value-adding vampiric middle men attempting to cut them out of the loop.
Most artists are happy to see more people getting into art and joining the community. More artists means the skills of this culture get passed down to the next generation.
Obviously a billion dollar corporation using their work to create an industrial tool designed to displace them is very different.
This is such a nothing argument. Yes, new artists are inspired by other artists and sometimes make art similar to others, but a huge part of learning and doing art is to find a unique style.
But that’s not even the important part of the argument. A lot of artists work for commission, and are hired for their style. If an AI can be trained without explicit permission from their images, they lose work because a user can just prompt “in the style of”.
There’s no real great solution, outside of law, because the possibility of doing that is already here. But I’ve seen this argument so much and it’s just low effort
It is only natural to see a moral difference between people going to school and learn from your art because they are passionate about it, versus someone on the internet just scraping as many images as possible and automating the learning process.
That is not how artists learn. This is a false equivalence used to justify the imitation and copying of artists’ work.
Artists’ work isn’t derivative in the same way that AI work is. Artists create work based on other sources of inspiration, some of them almost or completely to the disregard of other art.
Many artists don’t even go to art school. And those that do, do not spend most (all) of that time learning how to copy or imitate other artists.
I’m not expressing an opinion of whether GenAI is unethical or illegal - I think that’s a really difficult issue to wrestle with - just that this argument is a post-hoc rationalisation made in ignorance of how good artists work (not to say ignorance of the difference between illustration and art, conceptual art training vs say a foundation course etc).
his handle is KingOfCoders - self-aggrandizing, insufferable, impotent in its attempts to be meta.
He thinks he's an artist because he now has the ability to curate a dataset based off of one artist's work and prompt more art generated in that style. He did it, so clearly he is an artist now.
Sigh. Once again: I always love it when techbros say that AI learning and human learning are exactly the same, because reading one thing at a time at a biological pace and remembering takeaway ideas rather than verbatim passages is obviously exactly the same thing as processing millions of inputs at once and still being able to regurgitate sources so perfectly that verbatim copyrighted content can be spit out of an LLM that doesn't 'contain' its training material.
I'm just glad that so many more people have caught on to the bullshit than this time last year, or even six months ago.
I really don't even get the endgame. Art gets "democratized", so anyone who doesn't want their style copied stops putting stuff on the internet, and eventually all human art is trained, so the only new contributions are genAI. Maybe we could get a few centuries worth of stuff of "robot unicorn in the style of Artist X with a flair of Y" permutations, but even ignoring the centipede, that just sounds... boring. worthless.
Since techbros are stupid: "Note that people could always do these kinds of repurposing, and it was never a problem from a copyright perspective. We have a problem now because those things are being done (1) in an automated way (2) at a billionfold greater scale (3) by companies that have vastly more power in the market than artists, writers, publishers, etc. Incidentally, these three reasons are also why AI apologists are wrong when claiming that training image generators on art is just like artists taking inspiration from prior works."
This is excellent. We need more tools like this, for text content as well. For software we need GPL 4 with ML restrictions (make your model open source or not at all). Potentially even DRM for text.
Is it possible to reliably detect whether an image is poisoned? If not then it achieves the goal of punishing entities which indiscriminately harvest data.
You can use older images, collected from before the "poisoning" software was released. Then you don't have to.
This, of course, assumes that "poisoning" actually works. Glaze and Nightshade and similar are very much akin to the various documented attacks on facial recognition systems. The attack does not exploit some fundamental flaw in how the systems work, but specific characteristics in a given implementation and version.
This matters because it means that later versions and models will inevitably not have the same vulnerabilities. The result is that any given defensive transformation should be expected to be only narrowly effective.
This is fantastic. If companies want to create AI models, they should license the content they use for the training data. As long as there are not sufficient legal protections and the EU/Congress do not act, tools like these can serve as a stopgap and maybe help increase pressure on policymakers
There is in fact, an extreme amount of circumstantial evidence that they intentionally and knowingly violated copyright en mass. It’s been quite a popular subject in tech news the past couple weeks.
Google scrapes copyrighted material every day and then presents that material to users in the form of excerpts, images, and entire book pages. This has been ruled OK by the courts. Scraping copyrighted information is not illegal or we couldn't have search engines.
Google is not presently selling "we trained an AI on people's art without permission, and you can type their name in along with a prompt to generate a knockoff of their art, and we charge you money for this". So it's not really a 1:1 comparison, since there are companies selling the thing I described right now.
That pretty clearly would fall under transformative work. It is not illegal for a human to paint a painting in the style of, say, Banksy, and then sell the resulting painting.
Fair Use is the relevant protection and is not specific to manual creation. Traditional algorithms (e.g: the snippets, caching, and thumbnailing done by search engines) are already covered by it.
In some locales sitting on the street writing down a list of people coming and going is legal, but leaving a camera pointed at the street isn't. Legislation like that makes a distinction between an action by a person (which has bounds on scalability) and mechanized actions (that do not).
"The insights obtained through content analysis will not be used to re-create your content or lead to identifying any personal information."
"For Adobe Firefly, the first model is trained on Adobe Stock images, openly licensed content, and public domain content where the copyright has expired."
It's going to be interesting to see how the lawsuits against OpenAI by content creators plays out. If the courts rule that AI generated content is a derivative work of all the content it was trained on it could really flip the entire gen AI movement on its head.
If it were a derivative work[1] (and sufficiently transformational) then it's allowed under current copyright law and might not be the slam dunk ruling you were hoping for.
"sufficiently transformational" is carrying a lot of water here. At minimum it would cloud the issue and might expose anyone using AI to lawsuits where they'd potentially have to defend each generated image.
Oh, interesting, I didn't realize that's how it worked. Thanks for the additional context around this. Guess it's not as upending as I thought it could be.
My biggest fear is that the big players will drop a few billion dollars to silence the copyright holders with power go away, and new rules are put in place that will make open-source models that can't do the same essentially illegal.
If the courts do rule that way, I would expect a legislative race between different countries to amend the relevant laws. Visual generative AI is just too lucrative a thing.
I'm glad to see tools like Nightshade starting to pop up to protect the real life creativity of artists. I like AI art, but I do feel conflicted about its potential long term effects towards a society that no longer values authentic creativity.
Is the existence of the AI tool not itself a product of authentic creativity? Does eliminating barriers to image generation not facilitate authentic creativity?
No, it facilitates commoditization. Art – real art – is fundamentally a human-to-human transaction. Once everyone can fire perfectly-rendered perfectly-unique pieces of 'art' at each other, it'll just become like the internet is today: filled with extremely low-value noise.
This is the right prediction. Once machines can generate visual art, people will simply stop valuing it. We may see increased interest in other forms of art, e.g., live performance art like theater. It's hard to predict exactly how it'll play out, but once something becomes cheap to produce and widely available, it loses its luster for connoisseurs and then gradually loses its luster for everybody else too.
So then you'll have curation to find the gems in that noise.
But it's still not clear why this is worse than the situation where not everyone can create perfectly-rendered pieces of whatever idea is in their head, and have to rely on others to do it for them, while being limited by what they can afford and what those others are willing to paint.
Isn't this just teaching the models how to better understand pictures as humans do? As long as you feed them content that looks good to a human, wouldn't they improve in creating such content?
You would think the economists at UChicago would have told these researchers that their tool would achieve the opposite effect of what they intended, but here we are.
In this case, the mechanism for how it would work is effectively useless. It doesn't affect OpenAI or other companies building foundation models. It only works on people fine-tuning these foundation models, and only if the image is glazed to affect the same foundation model.
It's an arms race the bigger players will win, and it undermines the quality of the images. But it feels natural that artists would want to do something since they don't feel like anyone else is protecting them right now.
Baffling to see anyone argue against this technology when it is a non-issue to any model by simply acquiring only training data you have permission to use.
The reason people are arguing against this technology is that no one is using them in the way you describe. They actually wouldn't even be economically viable in that case.
If it is not economically viable for you to be ethical, then you do not deserve economic success.
Anyone arguing against this technology following the line of reasoning you present is operating in adverse to the good of society. Especially if their only motive is economic viability.
I feel like you read my comment and interpreted it in exactly the opposite way it was intended because I agree with you, and you're making the same point I was trying to make.
I think people 100% have the right to use this on their images, but:
> simply acquiring only training data you have permission to use
Currently it's generally infeasible to obtain licenses at the required scale.
When attempting to develop a model that can describe photos for visually impaired users, I had even tried to reach out to obtain a license from Getty. They repeatedly told me that they don't license images for machine learning[0].
I think it's easy to say "well too bad, it doesn't deserve to exist" if you're just thinking about DALL-E 3, but there's a huge number of positive and far less-controversial applications of machine learning that benefit from web-scale pretraining and foundation models - spam filtering, tumour segmentation, voice transcription, language translation, defect detection, etc.
I don't believe it's a "doesn't deserve to exist" situation, because these things genuinely can be used for the public good.
However - and this is a big however - I don't believe it deserves the legal protection to be used for profit.
I am of the opinion that if you train your model on data that you do not hold the rights for, your usage should be handled similarly to most fair use laws. It's fine to use it for your personal projects, for research and education, etc. but it is not OK to use it for commercial endeavors.
> It's fine to use it for your personal projects, for research and education, etc. but it is not OK to use it for commercial endeavors.
Say I train a machine vision model that, after having pretrained on ImageNet or similar, detects deformities in a material for a small company that manufactures that material. Do you not think that would be fair use, despite being commercial?
To me it seems highly transformative (a defect detection model is entirely outside the original images' purposes) and does not at all impact the market of the works.
Moreover, you said it was "Baffling to see anyone argue against this technology" but it seems there are at least some models (like if my above detector was non-commercial) that you're ethically okay with and could be affected by this poisoning.
No, I don't generally think it's okay to profit off of the work of others without their consent.
>Moreover, you said it was "Baffling to see anyone argue against this technology" but it seems there are at least some models (like if my above detector was non-commercial) that you're ethically okay with and could be affected by this poisoning.
Just because I think there are situations where it's not ethically wrong to use someone's work without permission does not mean I think it's ethically wrong for someone to protect their work any way they see fit.
To use an extreme example: I do not think it's wrong for a starving man to steal food. I also do not think it's wrong for someone to defend their food from being stolen, regardless of the morality of the thieves' motivation.
> No, I don't generally think it's okay to profit off of the work of others without their consent.
I'd argue that essentially all work based off the work of others. I can only draw a "car" better than a random guess because I've seen many (individually copyrighted) car designs.
That's not to say we inherently have to treat use of statistical models the same, but rather that there does have to be a line somewhere to define where a new work, while dependant on previous works in aggregate, is sufficiently transformative - not carrying substantial similarity to any particular existing work that played a part in its creation - and can therefore be used by the author to make a living.
That line has to be placed in a way that prioritizes the progress of sciences and useful arts, rather than just enriching rightsholder megacorps like Getty Images/Universal Music. It should certainly allow training something like a tumor segmentation network, rather than rendering it infeasible.
Also, while whether it's morally okay is relevant and worth discussing, I think the question still stands of whether you believe my example would count as fair use, given the transformative nature and lack of impact on the market of the original work.
> Just because I think there are situations where it's not ethically wrong to use someone's work without permission does not mean I think it's ethically wrong for someone to protect their work any way they see fit.
> To use an extreme example: I do not think it's wrong for a starving man to steal food. I also do not think it's wrong for someone to defend their food from being stolen, regardless of the morality of the thieves' motivation.
I personally agree that they have a right to do so, but I don't think it'd be "baffling" that the [starving man/person training a tumor detector] would be against it, and it's likely not a "non-issue" for them to obtain sufficient [food/data] through other means.
Particularly since there are already means to opt-out that are respected by scrapers, and this is instead an attempt to do active damage. I guess in the analogy it'd be leaving out poisoned bread, although that's more extreme than I intend.
would it have been that hard to include a sample photo and how it looks with the nightshade filter side by side in a 3 page document describing how it would look in great detail
Long-term I think the real problem for artists will be corporations generating their own high quality targeted datasets from a cheap labor pool, completely outcompeting them by a landslide.
Art is already democratized. It has been for decades. Everyone can pick it up at zero cost. Even you!
The poorest people have historically produced great art. Training a model, however? Expensive. Running it locally? Expensive. Paying the sub? Expensive.
Nothing is being democratized, the only thing this does is devaluing the blood and sweat people have put into their work so FAANG can sell it to lazy suckers.
In the short-to-medium term, we're seeing huge improvements in the data efficiency of generative models. We haven't really started to see self-training in diffusion models, which could improve data efficiency by orders of magnitude. Current models are good at generalisation and are getting better at an incredible pace, so any efforts to limit the progress of AI by restricting access to training data is a speedbump rather than a roadblock.
Yeah, I've seen multiple artists complain about how glazing reduces image quality. It's very noticeable. That seems like an unavoidable problem given how AI is trained on images right now.
Remember when the music industry tried to use technology to stop music pirating?
This will work about as well...
Oh, I forget, fighting music pirating was considered an evil thing to do on HN. "pirating is not stealing, is copyright infringement", right? Unlike training neural nets on internet content which of course is "stealing".
FWIW, you're the only use of the word "steal" in this comment thread.
Many people would in fact argue that training AI on people's art without permission is copyright infringement, since the thing it (according to detractors) does is infringe copyright by generating knockoffs of people's work.
You will see some people use the term "stealing" but they're usually referring to how these AIs are sold/operated by for-profit companies that want to make money off artists' work without compensating them. I think it's not unreasonable to call that "stealing" even if the legal definition doesn't necessarily fit 100%.
The music industry is also not really a very good comparison point for independent artists... there is no Big Art equivalent that has a stranglehold on the legislature and judiciary like the RIAA/MPAA do.
Musicians overwhelmingly do not even attempt to clear samples. This also isn't a great comparison since samples are taken directly out of the audio, not turned into a part of a pattern used to generate new sounds like what AI generators do with images
Entire legal firm empires have been built on the licensing, negotiations, and fees that make up the industry.
I'm ain't talking about some dude on YouTube or Soundcloud. Few people care about some rando on Soundcloud. Those moles aren't big enough to whack. Vanilla Ice and MC Hammer were. OpenAI is as well.
The difference is that “pirating” is mostly done by individuals for private use, whereas training is mostly done by megacorporations looking to make more money.
The rumblings I'm hearing are that this a) barely works with last-gen training processes b) does not work at all with more modern training processes (GPT-4V, LLaVA, even BLIP2 labelling [1]) and c) would not be especially challenging to mitigate against even should it become more effective and popular. The Authors' previous work, Glaze, also does not seem to be very effective despite dramatic proclamations to the contrary, so I think this might be a case of overhyping an academically interesting but real-world-impractical result.
Maybe it's more about "protecting" images that artists want to publicly share to advertise work, but it's not appropriate for final digital media, etc.
I was on desktop and it looks like pretty heavy jpeg compression. Doesn't completely destroy the image, but it's pretty noticeable when blown up large enough.
I didn't see it immediately either, but there's a ton of added noise. The most noticeable bit for me was near the standing person's bent elbow, but there's a lot more that becomes obvious when flipping back and forth between browser tabs instead of swiping on Twitter.
The animation when you change images makes it harder to see the difference, I opened the three images each in its own tab and the differences are more apparent when you change between each other instantly.
If you have to have both and instantly toggle between them to notice the difference, then it sounds like it’s doing its job well and is hard to notice the difference.
That is a great mystery, to me it's as clear as if someone pasted a cartoon dog onto the image, it's extremely blatant and impossible to ignore by my normal human pattern recognition.
I'm looking at them on my iPhone 14 Pro and I am having a hard time seeing any meaningful difference that changes the way the artwork registers with me.
I can't really imagine a case where if I had only seen the AI edited one I would have any different reaction or response to viewing the piece of art compared to having only seen the original one.
Kid me found 13 FPS in games to be a smooth and cursive experience.
Current me thinks 60 FPS is laggy.
Standards differ. I saw glazed images in the wild, was wondering why they have so much JPEG artifacts, until I saw the post of one of those anti-AI + glaze images on his profile.
But now that I double-check, I was comparing with the images zoomed to 200%. On desktop the artifacts are also noticeable at 100%, but not nearly as bad as in my previous comment.
I think the point is that they're akin to a watermark.
Even before the current AI boom, plenty of artists have wanted to showcase their work/prove that it exists without necessarily making the highest quality original file public.
For example in accounts on image sites that are exposed to suspected scrapers but not to others. Scrapers will still see the real data, but they'll also run into stuff designed to mix up the training process.
The screenshots you sent in [1] are inference, not training. You need to get a Nightshaded image into the training set of an image generator in order for this to have any effect. When you give an image to GPT-4V, Stable Diffusion img2img, or anything else, you're not training the AI - the model is completely frozen and does not change at all[0].
I don't know if anyone else is still scraping new images into the generators. I've heard somewhere that OpenAI stopped scraping around 2021 because they're worried about training on the output of their own models[1]. Adobe Firefly claims to have been trained on Adobe Stock images, but we don't know if Adobe has any particular cutoffs of their own[2].
If you want an image that screws up inference - i.e. one that GPT-4V or Stable Diffusion will choke on - you want an adversarial image. I don't know if you can adversarially train on a model you don't have weights for, though I've heard you can generalize adversarial training against multiple independent models to really screw shit up[3].
[0] All learning capability of text generators come from the fact that they have a context window; but that only provides a short term memory of 2048 tokens. They have no other memory capability.
[1] The scenario of what happens when you do this is fancifully called Habsburg AI. The model learns from it's own biases, reinforcing them into stronger biases, while forgetting everything else.
[2] It'd be particularly ironic if the only thing Nightshade harms is the one AI generator that tried to be even slightly ethical.
[3] At the extremes, these adversarial images fool humans. Though, the study that did this intentionally only showed the images for a small period of time, the idea being that short exposures are akin to a feed-forward neural network with no recurrent computation pathways. If you look at them longer, it's obvious that it's a picture of one thing edited to look like another.
The context windows of LLMs are now significantly larger than 2048 tokens, and there are clever ways to autopopulate context window to remind it of things.
Hey you know what might not be AI generated post-2021? Almost everything run through Nightshade. So given it's defeated, which is pretty likely, artists have effectively tagged their own work for inclusion.
I mean that's more or less status quo isn't it? Big business does what it wants, common people can get fucked if they don't like it. Same as it ever was.
That's exactly right. It is just the variety of new ways in which common people get fucked that is dispiriting, with seemingly nothing capable of moving in the opposite direction.
Modern generative image models are trained on curated data, not raw internet data. Sometimes the captions are regenerated to fit the image better. Only high quality images with high quality descriptions.
I wouldn't call what Stable Diffusion et al are trained on "high quality". You need only look through the likes of LAION to see the kind of captions and images they get trained on.
It's not random but it's not particularly curated either. Most of the time, any curation is done afterwards.
Even if no new images are being scraped to train the foundation text-to-image models, you can be certain that there is a small horde of folk still scraping to create datasets for training fine-tuned models, LoRAs, Textual Inversions, and all the new hotness training methods still being created each day.
Correct me if I'm wrong but I understand image generators as relying on auto-labeled images to understand what means what, and the point of this attack to make the auto-labelers mislabel the image, but as the top-level comment said it's seemingly not tricking newer auto-labelers.
not all are auto labelled, some are hand labelled, some are initially labelled with something like clip/blip/booru and then corrected a bit by hand. The newest thing though is using llm's with image support like GPT4 to label the images, which kind of does a much better job most of the time.
Your understanding of the attack was the same as mine, it injects just the right kinds of pixels to throw off the auto-labellers to misdirect what they are directing causing the tags to get shuffled around.
Also on reddit today some of the Stable Diffusion users are already starting to train using Nightshade so they can implement it as a negative model, which might or might not work, will have to see.
If it doesn't work during inference I really doubt it will have any intended effect during training, there is simply too much signal and the added adversarial noise works on the frozen and small proxy model they used (CLIP image encoder I think) but it doesn't work on a larger model and trained on a different dataset, if there is any effect during training it will probably just be the model learning that it can't take shortcuts (the artifacts working on the proxy model showcase gaps in its visual knowledge).
Generative models like text-to-image have an encoder part (it could be explicit or not) that extract the semantic from the noised image, if the auto-labelers can correctly label the samples then the encoded trained on both actual and adversarial images will learn to not take the same shortcuts that the proxy model has taken making the model more robust, I cannot see an argument where this should be a negative thing for the model.
Seems obvious that the people stealing would be adjusting their process to negate these kinds of countermeasures all the time. I don't see this as an arms race the artists are going to win. Not like the LLM folks can consider actually paying their way...the business plan pretty much has "...by stealing everything we can get our hands on..." in the executive summary.
I just tested it with Azure AI image classification and it worked - so this cat is yet to adapt to the mouse’s latest idea.
I still feel it is absolutely wrong to roam around the internet and scrape images (without consent) in order to power one’s cash cow AI. I hope more methods to protect artworks (including audio and other formats) become more accessible.
Artists copy from each other all the time. Arguably, culture exists because of copying (folk stories by necessity); copyright makes culture top-down and stagnant, and you can't avoid it because they have the money to shove it right in your face. Who wants trickle-down culture?
I might be missing something because I don't know much about the architecture of either Nightshade or AI art generators, but I wonder if you could try to have a GAN-like architecture (an extra model trying to trick the model) for the part of the generator that labels images to build resistance to Nightshade-like filters.
It doesn't even have to be a full GAN, you only need to train the discriminator side to filter out the data. Clean reference images + Nightshade would be the generator side.
I'm at a food truck and you happen to see and memorize all my CC data and use it because it was in public so it was fair game. Or I was paying using apple pay on the most expensive iPhone available so you take that because it was out in public and if I didn't want anyone grabbing it I shouldn't have brought it out.
Your phone example is just theft unless I'm misreading...do you want to go down the path of calling copyright infringement theft?
As for the card example it is on you to keep secrets secret. It is clearly a fault with how credit cards work and for things like that you should get insurance. Keep your card safe, or better yet, use cash. We can call it theft, doesn't matter to my point.
There is no "taking" or "grabbing" anything, I visited your website and was served a copy of the data because you made it do so. You wanted it to happen, for the public to see it, that was your goal. You expected it to happen. Do you disagree that me acquiring a copy was consensual? If so it is very different from the hypotheticals you're posing don't you think?
Once a copy is in my possession you would need to initiate violence to stop me from training a model on it which puts you on the wrong side of the moral line.
Who said anything about creating a derivative? Surely you don't mean to say that any image created with a model trained on copyrighted data counts as a derivative of it. Edit: Or worse, that the model itself is derivative, something so different from an image must count as transformative work!.
> it’s basically the input data compressed with highly lossy compression.
Okay, extract the images from a Stable Diffusion checkpoint then. I'll wait.
It's not like lossy compression CAN'T be fair use or transformative. I'm sure you can imagine how that is possible given the many ways an image can be processed.
> All the corporations that are offering AI as a paid service?
I think it's worthwhile for such discussion to happen in the open. If the tool can be defeated through simple means, it's better for everybody to know that, right?
It would be better for artists to know that. But Hacker News is not a forum of visual artists: it's a forum of hackers, salaried programmers, and venture capitalists. Telling the bad guys about vulnerabilities isn't responsible disclosure.
Causing car crashes isn't hard (https://xkcd.com/1958/). That doesn't mean Car Crash™ International®'s decision-makers know how to do it: they probably don't even know what considerations go into traffic engineering, or how anyone can just buy road paint from that shop over there.
It's everybody's responsibility to keep Car Crash™ International® from existing; but failing that, it's everybody's responsibility to not tell them how to cause car crashes.
No, it's resistant to transformation. Rotation, cropping, scaling, the image remains poisonous. The only antidote known currently is active artist cooperation.
I wonder how this tool works if it's actually model independent. My understanding so far was that in principle each possible model has some set of pathological inputs for which the classification will be different than what a user sees - but that this set is basically different for each model. So did they actually manage to build an "universal" poison? If yes, how?
To protect an individual's image property rights from image generating AI's -- wouldn't it be simpler for the IETF (or other standards-producing group) to simply create an
AI image exclusion standard
, similar to "robots.txt" -- which would tell an AI data-gathering web crawler that a given image or set of images -- was off-limits for use as data?
Entities training models have no incentive to follow such metadata. If we accept the premise that "more input -> better models" then there's every reason to ignore non-legally-binding metadata requests.
Robots.txt survived because the use of it to gatekeep valuable goodies was never widespread. Most sites want to be indexed, most URLs excluded by the robots file are not of interest to the search engine anyway, and use of robots to prevent crawling actually interesting pages is marginal.
If there was ever genuine uptake in using robots to gatekeep the really good stuff search engines would've stopped respecting it pretty much immediately - it isn't legally binding after all.
>Entities training models have no incentive to follow such metadata. If we accept the premise that "more input -> better models" then there's every reason to ignore non-legally-binding metadata requests.
Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Robots.txt survived because the use of it to gatekeep valuable goodies was never widespread. Most sites want to be indexed, most URLs excluded by the robots file are not of interest to the search engine anyway, and use of robots to prevent crawling actually interesting pages is marginal.
Robots.txt survived because it was a "digital signpost" a "digital sign" -- sort of like the way you might put a "Private Property -- No Trespassing" sign in your yard.
Most moral/ethical/lawful people -- will obey that sign.
Some might not.
But the some that might not -- probably constitute about a 0.000001% minority of the population, whereas the majority that do -- probably constitute about 99.99999% of the population.
"Robots.txt" is a sign -- much like a road sign is.
People can obey them -- or they can ignore them -- but they can ignore them only at their own peril!
It's a sign which provides a hint for what the right thing to do in a certain set of circumstances -- which is what the Law is; which is what the majority of Laws are.
People can obey them -- or they can choose to ignore them -- but only at their own peril!
Most will choose to obey them. Most will choose to "take the hint", proverbially speaking!
A few might not -- but that doesn't mean the majority won't!
>If there was ever genuine uptake in using robots to gatekeep the really good stuff search engines would've stopped respecting it pretty much immediately - it isn't legally binding after all.
Again, name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
And then what? The scrapers themselves already happily ignore copyright, they won't be inclined to obey a no-ai.txt. So someone would have to enforce the standard. Currently I see no organisation who would be willing to do this or even just technologically able - as even just detecting such scrapers is an extremely hard task.
Nevertheless, I hope that at some not-so-far point in the future there will be more legal guidance about this kind of stuff, i.e. it will be made clear that scraping violates copyright. This still won't solve the problem of detectability but it would at least increase the risk of scrapers, should they be caught.
>The scrapers themselves already happily ignore copyright, they won't be inclined to obey a no-ai.txt.
Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Currently I see no organisation who would be willing to do this or even just technologically able - as even just detecting such scrapers is an extremely hard task.
// Part of Image Web Scraper For AI Image Generator ingestion psuedocode:
if fileExists("no-ai.txt") {
// Abort image scraping for this site -- move on to the next site
} else {
// Continue image scraping for this site
};
See? Nice and simple!
Also -- let me ask you this -- what happens to the intellectual property (or just plain property) rights of Images on the web after the author dies? Or say, 50 years (or whatever the legal copyright timeout is) after the author dies?
Legal grey area perhaps?
Also -- what about Images that exist in other legal jurisdictions -- i.e., other countries?
How do we know what set of laws are to apply to a given image?
?
Point is: If you're going to endorse and/or construct a legal framework (and have it be binding -- keep in mind you're going to have to traverse the legal jurisdictions of many countries, many countries!) -- you might as well consider such issues.
Also -- at least in the United States, we have Juries that can override any Law (Separation of Powers) -- that is, that which is considered "legally binding" -- may not be quite so "legally binding" if/when properly explained to a proper jury in light of extenuating (or just plain other) circumstances!
So kindly think of these issues prior to making all-encompasing proposals as to what you think should be "legally binding" or not.
I comprehend that you are just trying to solve a problem; I comprehend and empathize; but the problem might be a bit greater than you think, and there might be one if not serveral unexplored partial/better (since no one solution, legal or otherwise, will be all-encompassing) solutions -- because the problem is so large in scope -- but all of these issues must be considered in parallel -- or errors, present or future will occur...
> Part of Image Web Scraper For AI Image Generator ingestion psuedocode:...
Yes, and who is supposed to run that code?
> Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
Github? OpenAI?[1] Stable Diffusion?[2] LAION?[3] What do you think why there are currently multiple high-profile lawsuits ongoing about exactly that topic?
Besides, that's not how things work. Training a foundation model takes months and currently costs a fortune in hardware and power - and once the model is trained, there is, as of now, no way to remove individual images from the model without restraining. So in practical terms it's impossible to remove an image if it has already been trained on.
So the better question would be, name two entities who have ignored an artist's request to not include their image when they encountered it the first time. It's still a trick question though because the point is that scraping happens in private - we can't know which images were scraped without access to the training data. The one indication that it was probably scraped is if a model manages to reproduce it verbatim - which is the basis for some of the above lawsuits.
And/or groups that don't want to risk getting sued? (Your: [1] [2] [3])?
>> Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Github? OpenAI?[1] Stable Diffusion?[2] LAION?[3] What do you think why there are currently multiple high-profile lawsuits ongoing about exactly that topic?
Because:
a) (Some) American Lawyers (AKA "Bar Association Members") -- are Sue Happy?
b) Because various Governments / Deep States (foreign and domestic) / Dark Money Groups / Paid (and highly biased) Political Activists -- want to see if they can get new draconian laws (whilst believing their actions to be super-patriotic to their respective countries!) -- or at least court precedents that move in that direction -- passed?
(How much revenue will they be losing if their net income from artwork was $0? Also, wouldn't such high profile cases give the artists a ton of free advertising? The Defendant companies should counter-sue for giving the Plaintiff artists what amounts to free publicity for their artwork so great that they couldn't buy it with all of the Google advertising credits in the world!)
>Besides, that's not how things work. Training a foundation model takes months and currently costs a fortune in hardware and power - and once the model is trained, there is, as of now, no way to remove individual images from the model without restraining.
>"without retraining"...
Meditate on that one for a moment...
>So in practical terms it's impossible to remove an image if it has already been trained on.
In practical terms -- just retrain the model -- sans ("without") the encroaching images!
The models will need to be updated every couple of months anyway to include new public data from the web!
Create a list of images NOT to include in the next run (see above, "no-ai.txt" -- good suggestion incidentally!) -- and then don't include them" on the next run!
It's not Rocket Science! :-)
(Also, arguably Elon Musk doesn't think that "Rocket Science" is in fact as hard as "Rocket Science" is purported to be -- but that's a separate debate! <g>)
>So the better question would be, name two entities who have ignored an artist's request to not include their image when they encountered it the first time. It's still a trick question though because the point is that scraping happens in private - we can't know which images were scraped without access to the training data. The one indication that it was probably scraped is if a model manages to reproduce it verbatim - which is the basis for some of the above lawsuits.
Explain to me, from the point of view of an AI company, how that AI company is to know ahead of time NOT to include an image from the web? (And thus not break the law, copyright law at least, and thus not incur the lawsuits and all the chaos that will apparently follow such an act?)
How is the AI company supposed to know, ahead of time, that a given image on the web is not to be included?
How please?
Because you see, that's the root of the problem you are trying to...
These methods like Glaze usually works by taking the original image chaging the style or content and then apply LPIPS loss on an image encoder, the hope is that if they can deceive a CLIP image encoder it would confuse also other models with different architecture, size and dataset, while changing the original image as little as possible so it's not too noticeable to a human eye. To be honest I don't think it's a very robust technique, with this one they claim that a model instead of seeing for example a cow on grass the model will see a handbag, if someone has access to GPT4-V I want to see if it's able to deceive actually big image encoders (usually more aligned to the human vision).
EDIT: I have seen a few examples with GPT-4 V and how I imagine it wasn't deceived, I doubt this technique can have any impact on the quality of the models, the only impact that this could potentially have honestly is to make the training more robust.
Each time there is an update to training algorithms and in response poisoning algorithms, artists will have to re-glaze, re-mist, and re-nightshade all their images?
Eventually I assume the poisoning artifacts introduced in the images will be very visible to humans as well.
What the article doesn't illustrate is that it destroys fine detail in the image, even in the thumbnails of the reference paper:
https://arxiv.org/pdf/2310.13828.pdf
Also... Maybe I am naive, but it seems rather trivial to work around with a quick prefilter? I don't know if tradition denoising would be enough, but worst case you could run img2img diffusion.
The poisoned images aren't intended to be viewed, rather scraped and pass a basic human screen. You wouldn't be able to denoise as you'd have to denoise the entire dataset, the entire point is that these are virtually undetectable from typical training set examples, but they can push prompt frequencies around at will with a small number of poisoned examples.
> the entire point is that these are virtually undetectable from typical training set examples
I'll repeat this point for clarity. After going over the paper again, denoising shouldn't affect this attack, it's the ability of plausible images to not be detected by human or AI discriminators (yet)
709 comments
[ 3.6 ms ] story [ 414 ms ] threadIf you produce a work that is too much of a copy from the original, you might be liable to a copyright claim.. but the act of copy and paste should not be prohibited in the generation of something new.
This is done all the time by artists.. who perhaps create an artwork by copy and pasting advertisements out of a womans magazine to create an image of a womans face made only of those clipping. Making a statement about identity creation from corporate media... we should not put restrictions on such art work.
Here's just one example of an artist using copy-n-paste of content they don't own to create something new:
https://torontolife.com/culture/this-artist-creates-one-of-a...
I do not support indiscriminate banning of anything and everything that can potentially be used to fuck someone over.
Once we as a society have implemented a good way for the artists whose work powers these machines to survive, you can feel good about using them. Until then, frankly, you're doing something immoral by paying to use them.
I'm still not a fan, though.
Whether you pay for it?
Let’s put it this way: paying for or not paying for stolen goods. Does it make any difference?
Why is that remotely relevant?
You want to argue “are the good stolen?” Sure. That’s a discussion we can have.
Did you pay for them or not? Who cares?
That's not something you'll be able to rely on long-term, there won't always be a firehose of venture capital money to subsidise that kind of charity.
AI pays no artist.
Enter factories, now you gather all the knowledge from those who made the product, automate it and leave them without jobs.
imagine being a photographer that takes decades to perfect their craft. sure another student can study and mimic your style. but it's still different than some computer model "ingesting" vast amount of photos and vomiting something similar for $5.99 in aws cpu cost so that some prompt jockey can call themselves an AI artist and make money off of other peoples talent.
i get that this is cynical and does not encompass all ai art, but why not let computers develop their own style wihout ingesting human art? that's when it would actually be AI art
These people literally don’t care what your definition of what is and isn’t art is, or how it’s made, they just want a lock screen wallpaper of themselves fighting against Thanos on top of a volcano.
The argument of “what is art” has been an academic conversation largely ignored by the people actually consuming the art for hundreds of years. Photography was just pop culture trash, comics were pop culture trash, stick figure web comics were pop culture trash. Today’s pop culture trash is the “prompt jockey”.
I make probably 5-10 pictures every day over the course of maybe 20 minutes as jokes on Teams because we have Bing Chat Enterprise. My coworkers seem to enjoy it. Nobody cares that it’s generated. I’m also not trying to be an “artist” whatever that means. It just is, and it’s fun. I wasn’t gonna hire an artist to draw me pictures to shitpost to my coworkers. It’s instead unlocked a new fun way to communicate.
in the context of what i was saying the definition of what is art can be summed up as anything made by humans. i have no problem when its used in memes and being open sourced etc.. the issue i have is when a human invests real time into it and then its taken and regurgitated without their permission. do you see that distinction?
But many big players do want to use this commercially and that's where a lot of these lines start to form. No matter how lawsuits go you will probably still be able to find some LLM to make Thanos fighting a volcano. It's just a matter of how/if companies can profit from it.
Art is the biggest gate kept industry there is and I detest artists who believe only they are the chosen one.
Art is human expression. We all have a right to create what we want with whatever tools we want. They can adapt or be left behind. No sympathy from me.
It's funny that these people use the langauge of communism, but apparently see artwork as purley an economic activity.
You hit the nail on the head. Copyright is, by its very nature, a "tool of capital." It's a means of creating new artificial property fiefdoms for a select few capital holders to lord over, while taking rights from anyone else who wants to engage in the practice of making art.
Everyone has their right to expression infringed upon, all so the 1% of artists can perpetually make money on things, which are ultimately sold to corporations that only pay them pennies on the dollar anyway.
You, as an indie hip hop or house musician supported by a day job, can't sample and chop some vocals or use a slice of a chord played in a song (as were common in the 80s and 90s) for a completely new work, but apparently the world is such a better place because Taylor Swift is a multimillionaire and Disney can milk the maximum value from space and superhero films.
I'd rather live in a world where anyone is free to make whatever art they want, even if everyone has to have a day job.
I doubt even Disney sue people who want to make fan art. But if you want to sell said art or distribute it, they will.
What do you mean? Copyright protects all creative works, and all authors of those creative works. That some have greater means to enforce was always true, and copyright doesn’t cause that, it (imperfectly) helps mitigate it. What copyright does is actually prevent them from stealing work from independent artists en masse, and force them to at least hire and pay some artists.
> I’d rather live in a world where anyone is free to make whatever art they want, even if everyone has to have a day job.
You’re suggesting abolish Copyright and/or the Berne Convention? Yeah the problem with this thinking is that then the big publishers are completely free to steal everyone’s work without paying for it. The very thing you’re complaining about would only get way way worse if we allowed anyone to “freely” make whatever art they want by taking it from others. “Anyone” means Disney too, and Disney is more motivated than you.
> You, as an indie hip hop or house musician supported by a day job, can’t sample and chop some vocals or use a slice of a chord played in a song… for a completely new work
Hehe, if you sample, you are by definition not making a completely new work. But this is a terrible argument since sampling in music is widespread and has sometimes been successfully defended in court. DJs are the best example of independent artists who need protection you can think of?
But in a more practical sense yes. There's not much personal nor logistical progression to make pushing pencils. Meanwhile, art is a craft that you can dedicate your life to improving and educating others on. It can be a career instead of merely a job to do.
So are the copyright and intellectual property laws that artists rely on. From my perspective, you are the capital and I am the one being fucked. So are you ready to abolish all that?
They are the quintessential representation of capital. And they come here to ask us to "resist" the other forms of capital on principle.
I'm sorry but... No. I'm gonna resist them instead. It's my sincere hope that this AI technology hammers in the last nails on the coffin of copyright and intellectual property as a whole. I want all the models to leak so that it becomes literally impossible to get rid of this technology no matter how much they hate it. I want it to progress so that we can run it on our own machines, so that it'll be so ubiquitous it can't be censored or banned no matter how much they lobby for it.
If it does, I will give you one thousand United States dollars, and you can quote me on thst whenever you like.
More likely, big companies will retain control as they always have (via expensive lawyers), and individual artists will get screwed.
Claiming you're not a calitalist owner just because you're a poor starving artist, when the government quite literally grants you functionally infinite monopolies over everything you create whether you want it or not, is quite the take indeed. Not my fault artists are prone to selling off the rights to that monopoly to corporations for short term profit. It's like they don't even realize the power they have and the real capitalists are only too happy to relieve them of it.
But campaigning for stricter IP laws only benefits the copyright owners (both you and Disney), a subset of white collar workers, and is still immoral for all the reasons that copyright is immoral in the first place. That is what we're against.
I'm glad free software came about, where software owners realised that the power they had over their users were unjust. Hopefully the same can happen to other creative fields.
When's the last time your culture entered the public domain?
I grew up watching films like Star Wars and Home Alone, playing Super Nintendo and PlayStation games. All these corporations have already made a million fortunes off of these things. When is all this stuff gonna become public property?
What about the public? They couldn't give less of a fuck about the public. They don't even care enough to fulfill their end of the bargain which was agreed upon when this copyright nonsense was created. Oh look, our property's about to become public? Better lobby the government and get them to extend the terms. Just pull the rug from under everyone, just move the goalposts, they won't even notice.
They use their fortunes to systematically rob us of our public domain rights. Yes, rights. We have rights to "their" works which they actively deny. They're literal robber barons. Therefore copyright infringement is a moral imperative. We should all stop pretending that copyright exists because the reality is it doesn't, it's completely made up and unenforceable and there's absolutely no reason anyone should recognize it as a legitimate law. Copyright infringement is civil disobedience and morally justified.
This AI stuff is exactly what we need. It's world changing technology. It's subversive. It gives me hope.
Putting blame on the technology and trying to limit public access to software will not go anywhere. Your fight for regulation needs to be with publishers and producers, not with the teen trying to make a cool new wallpaper or the office-man trying to make an aesthetic powerpoint presentation.
I can't believe how many people are not in awe of the possibilities of AI art, so it's great to see AI disturbing the cynics until they learn. Not everything is political, but I'll let them have this one.
If you think this is true, you've never understood art. Art is a human endeavour fundamentally. What ML produces is not art.
First, you need to prove that generative AI works fundamentally the same way as humans at the task of learning. Next you have to prove that it recalls information in the same way as humans. I don’t think anyone would say these are things that we can prove, let alone believe they do. So what we get is comments like they are similar.
What this means, is these systems will fall into different categories of law around copyright and free-use. What’s clear is that there are people who believe that they are harmed by the use of their work in training these systems and it reproducing that work in some manner later on (the degree to which that single work or the corpus of their work influences that final product is an interesting question). If your terms of use/copyright/license says “you may not train on this data”, then should that be protected in law? If a system like nightshade can effectively influence a training model enough to make it clear that something protected was used in its training, is that enough proof that the legal protections were broken?
No, you don't need to prove any of those things. They're irrelevant. You'd need to prove that the AI is itself morally (or, depending on the nature of the dispute, legally) equivalent to a human and therefore deserving of (or entitled to) the same rights and protections as a human. Since it is pretty indisputably the case that software is not currently legally equivalent to a human, you're stuck with the moral argument that it ought to be, but I think we're very far from a point where that position is warranted or likely to see much support.
Duchamp didn't need negotiate with the ceramic makers to make the Fountain into art.
No you don't.
A human using a computer to make art doesn't automatically lose their fair use rights as a human.
> indisputably the case that software is not currently legally equivalent to a human
Fortunately it is the human who uses the computer who has the legal rights to use computers in their existing process of fair use.
Human brains or giving rights to computers has absolutely nothing to do with the rights of human to use a camera, use photoshop, or even use AI, on a computer.
This is the analogy I want people against AI use to understand and never forget, even if they reject the underlying premise - that should laws treat a human who uses AI for a certain purpose identically to a human who uses nothing or a non-AI tool for the same purpose.
> Few people are claiming that the AI itself has the same rights as a human.
I think that's the case as well. However, a lot of commenters on this post are claiming that an AI is similar in behavior to a human, and trying to use the behavior analogy as the basis for justifying AI training (on legally-obtained copies of copyrighted works), with the assumption that justifying training justifies use. My personal flow of logic is the reverse: human who uses AI should be legally the same as human who uses a non-AI tool, so AI use is justified, so training on legally-obtained copies of copyrighted works is justified.
I want people in favor of AI use particularly to understand your human-with-AI-to-human-without-AI analogy (for short, the tool analogy) and to avoid machine-learning-to-human-learning analogies (for short, behavior analogies). The tool analogy is based on a belief about how people should treat each other, and contends with opposing beliefs about how people should treat each other. An behavior analogy must contend with both 1. opposing beliefs about how people should treat each other and 2. contradictions from reality about how similar machine learning is to brain learning. (Admittedly, both the tool analogy and the behavior analogy must contend with the net harm AI use is having and will have on the cultural and economic significance of human-made creative works.)
If you draw Mickey Mouse with a pencil and you publish (and sell) the drawing who is getting the blame? Is the pencil infringing the copyright? No, it's you.
Same with AI. There is nothijg wrong with using copyrighted works to train an algorithm, but if you generate an image and it contains copyrighted materials you are getting sued.
Merely making a copy can definitely be infringement. "Copies" made in the computing context even simply between disk and RAM have been held to be infringement in some cases.
Fair use is the big question mark here, as it acts to allow various kinds of harmless/acceptable/desirable copying. For AI, it's particularly relevant that there's a factor of the "transformative" nature of a use that weighs in favor of fair use.
That said, there is also an inherent right to copy material that is published online in certain circumstances. Indeed, the physical act of displaying an image in a browser involves making copies of that image in cache, memory, etc.
Our biology is mechanical, and lay people don't possess an intuition about this. Unless you've studied molecular biology and biochemistry, it's not something that you can easily grasp.
Our inventions are mechanical, too, and they're reaching increasing levels of sophistication. At some point we'll meet in the middle.
Humans are themselves mechanical so at the end of the day none of these issues actually matter
Some might have said this about cars ... yet, here we are. Cars are definitely the opposite, except for longer-distance travel.
Sarcasm aside there is no moral right to ANY intellectual property. It's not a positive expression of a natural right its a negative imposition of restriction upon everyone else. It's a statement that if I take my pen and paper and write the same words that you now own my pen my paper and my labor. It adds friction to the distribution of knowledge, impoverishes the world, keeps some knowledge that might have come into being from ever being generated for lack of the knowledge that failed to travel and all the good that could have therefore been done, undone.
It is justifiable only if the minimal restrictions we are willing to impose on net supports the creation of works that enrich society more than the restrictions impoverish it.
I'm not sure you can effectively measure it and would as soon just see IP law excepting only part of trademark law to prevent fraudulent knock offs and scams go entirely down the crapper.
No, it's not. It's merely pointing out the similarity between the process of training artists (by ingesting publicly available works) and ML models (which ingest publicly available works).
> First, you need to prove that generative AI works fundamentally the same way as humans at the task of learning.
Given that there is no comprehensive model for how humans actually learn things, that would be an unfeasible requirement.
> Given that there is no comprehensive model for how humans actually learn things, that would be an unfeasible requirement.
That is precisely why we should not be making this comparison.
Then please, feel free to explain the deep differences.
> That is precisely why we should not be making this comparison.
Wrong. It's precisely why the claim "there is a big difference" doesn't have a leg to stand on. If you claim "this is different", I ask "how?" and the answer simply repeats the claim, I can apply Hitchens Razor[1] and dismiss the claim.
[1]: https://en.wikipedia.org/wiki/Hitchens%27s_razor
It's the difference between reading about a place and actually visiting it.
Edit: This doesn't even touch how the act of creating something - often in a completely different context - interacts with the memories of the original work, altering those memories yet again.
Simply stating "it has more inputs" doesn't describe the human learning model, so nothing in this establishes a baseline for comparison.
Humans work by abstracting concepts in what they see, even when looking at the work of others. Even individuals with photographic memories mentally abstract things like lighting, body kinetics, musculature, color theory, etc and produce new work based on those abstractions rather than directly copying original work (unless the artist is intentionally plagiarizing). As a result, all new works produced by humans will have a certain degree of originality to them, regardless of influences due to differences in perception, mental abstraction processes, and life experiences among other factors. Furthermore, humans can produce art without any external instruction or input… give a 5 year old that’s never been exposed to art and hasn’t been shown how to make art a box of crayons and it’s a matter of time before they start drawing.
ML models are closer to highly advanced collage makers that take known images and blend them together in a way that’s convincing at first glance, which is why it’s not uncommon to see elements lifted directly from training data in the images they produce. They do not abstract the same way and by definition cannot produce anything that’s not a blend of training data. Give them no data and they cannot produce anything.
It’s absolutely erroneous to compare them to humans, and I believe it will continue to be so until ML models evolve into something closer to AGI which can e.g. produce stylized work with nothing but photographic input that it’s gathered in a robot body and artistic experimentation.
I've seen "infographics" spread by anti-AI people (or just attention-seekers) on Twitter that tries to "explain" that AI image generators blend together existing images, which is simply not true..
It is however the case that different AI models (and the brain) generalize a bit differently. That is probably the case between different humans too. Not the least with for example like you say those with photographic memory, autists etc.
What you call creativity in humans is just noise in combination with a boatload of exposure to multi-modal training data. Both aspects are already in the modern diffusion models. I would however ascribe a big edge in humans to what you normally call "the creative process" which can be much richer, like a process where you figure out what you lack to produce a work, go out and learn something new and specific, talk with your peers, listen to more noise.. stuff like that seems (currently) more difficult for AIs, though I guess plugins that do more iterative stuff like chatgpt's new plugins will appear in media generators as well eventually..
For example, a human artist would have an understanding of how line weight factors into stylization and why it looks the way it does and be able to accurately apply these concepts to drawings of things they’ve never seen in that style (or even seen at all, if it’s of something imaginary).
The best an ML model can do is mimic examples of line art in the given style within its training data, the product of which will contain errors due to not understanding the underlying principles, especially if you ask it to draw something it hasn’t seen in the style you’re asking for. This is why generative AI needs such vast volumes of data to work well; it’s going to falter in cases not well covered by the data. It’s not learning concepts, only statistical probabilities.
The models will generalize (because that's the most efficient way of storing concepts) and you can make an argument that that means they understand a concept. Claiming "it's not learning concepts, only statistical probabilities" trivialises what a modern neural network with billions of parameters and dozens of layers is capable of doing. If a model learns how to put a concept like line width 5, 10 and 15 pixels into a continuous internal latent property, you can probably go outside this at inference at least partially.
I would argue that improving this is at this point more about engineering and less about some underlying unreconcilable differences. At the very least we learn a lot about what exactly generalization and learning means.
Given that there is no comprehensive understanding of how human learning works, let alone how humans operate on and integrate on what they learned in a wider context...how do you know?
> Humans work by abstracting concepts in what they see
Newsflash: AI models do the same thing. That's the basis of generalization.
> ML models are closer to highly advanced collage makers that take known images and blend them together
Wrong. That's not even remotely how U-Net based diffusion models work. If you disagree, then please do show me where exactly the source images from where the "collage maker" takes the parts to "blend" together are stored. I think you'll find that image datasets on the scale of LAION will not quite fit into checkpoint files of about 2GB in size (pruned SD1.5 checkpoint in safetensors format).
No they won't.
A human who uses a computer as a tool (under all the previous qualifications of fair use) is still a human doing something in fair use.
Adding a computer to the workflow of a human doesn't make fair use disappear.
A human can use photoshop, in fair use. They can use a camera. They can use all sorts of machines.
The fact that photoshop is not the same as a human brain is simply a completely unrelated non sequitur. Same applies to AI.
And all the legal protections that are offered to someone who uses a regular computer, to use photoshop in fair use, are also extended to someone who uses AI in fair use.
It's also presumptive to assume that AI tools have these fair use protections when none of this has actually been decided in a court of law yet. There's still several unsettled cases here.
Gotcha.
That has nothing to do with fair use though.
Also, the same argument absolutely applies to photoshop.
If someone didn't include sufficient human authorship while using photoshop, that wouldn't be copyrightable either.
Also, the ruling has no bearing on if someone using AI, while also inputting a significant amount of human authorship. Instead, it was only about the cases where there weren't much human authorship.
At no point did the copyright office disclude copyright protections from anything that used AI in any way what so ever. In fact, the copyright office now includes new forms and fields where you talk about the whole process that you did, and how you used AI, in conjunction with human authorship to create the work.
> It's also presumptive to assume that AI tools
I'm not talking about the computer. I never claimed that computer's have rights. Instead, I'm talking about the human. Yes, a human has fair use protections, even if they use a computer.
> There's still several unsettled cases here.
There is no reason to believe that copyright law will be interpreted in a significantly different way than it has been in the past.
There is long standing precent, regarding all sorts of copyright cases that involve using a computer.
There's an entire branch of philosophy that calls these assumptions into question:
https://en.wikipedia.org/wiki/Posthumanism
https://en.wikipedia.org/wiki/Antihumanism
>Martin Heidegger viewed humanism as a metaphysical philosophy that ascribes to humanity a universal essence and privileges it above all other forms of existence. For Heidegger, humanism takes consciousness as the paradigm of philosophy, leading it to a subjectivism and idealism that must be avoided.
>Processes of technological and non-technological posthumanization both tend to result in a partial "de-anthropocentrization" of human society, as its circle of membership is expanded to include other types of entities and the position of human beings is decentered. A common theme of posthumanist study is the way in which processes of posthumanization challenge or blur simple binaries, such as those of "human versus non-human", "natural versus artificial", "alive versus non-alive", and "biological versus mechanical".
EDIT: removed a part.
Of course it's subjective, e.g. 3 million years ago there were no 'different implications' whatsoever, of any kind, because there were no humans around to have thoughts like that.
Though we already have an established precedent in-between, that of Photoshop allowing artists to be, easily, 10x faster then the best painters previously.
i.e. Right now 'AI' artistry could be considered a turbo-Photoshop.
And only the most interesting top few million art pieces will actually attract the attention of any concrete individual.
For a current example, there's already billions of man-hours worth of AI spam writing, indexed by Google, that is likely not actually read by even a single person on Earth.
It's just as much of an opinion, or as 'objective', as your prior statements.
Your going to have to face up to the fact that just saying something is 'objective' doesn't necessarily mean all 8 billion people will agree that it is so.
I'm saying something very simple: If a machine can copy your style, that's a fundamentally different situation than if a human can copy your style, and it has utterly different consequences. You can disagree with my statement, or say that whether it's fundamentally different is subjective, or you can even say "nuh-uh". But it seems kind of pointless to me. Why are you here commenting if you're not going to engage intellectually with other people, and are simply going to resort to a childish game of contradiction?
Continuing to ignore this point won't make the prior comments seem any more persuasive, in fact probably less.
So here's another chance to engage productively instead of just declaring things to be true or false, 'objective', etc., with only the strength of a pseudonymous HN account's opinion behind it.
Try to actually convince readers with solid arguments instead.
You say: The fact that production in style S (of artist A) can exceed human consumption capability makes the fact that someone's style can be reproduced without bounds irrelevant. You mention as an example all the AI-generated garbage text that no human will ever read.
I say: Whether it's irrelevant is subjective, but that production in style S is arbitrarily higher with an AI that's able to imitate it than with only humans that are able to imitate it objective, and an artist can (subjectively) not like this and seek to frustrate training efforts.
You say: It's all subjective.
As far as I can tell, we're at an impasse. If we can't agree on what the facts are (in this case, that AI can copy an artist's style in an incomparably higher volume than humans ever could) we can't discuss the topic.
Why? That certainly isn't a right spelled out in either patents or copyrights, both of which are supposed to support the development of arts and technology, not hinder it.
If I discover a new mathematical formula, musical scale, or whatnot, should I be able to prevent others from learning about it?
It’s yours. That’s literally what copyright is there to enforce.
> Fair use allows reproduction and other uses of copyrighted works – without requiring permission from the copyright owner – under certain conditions. In many cases, you can use copyrighted materials for purposes such as criticism, comment, news reporting, teaching (including multiple copies for classroom use), scholarship or research.
Reminder that you can't own ideas, no matter what the law says.
NOTE: This comment is copyrighted and provided to you under license only. By reading this comment, you agree to give me 5 billion dollars.
Fair use though, only applies as a legal defense because someone asserts you stole their work. Then ONLY the court decides whether or not you used it under fair use. You don't get to make that decision; you just get to decide whether to try and use it as a defense.
Even if you actually did unfairly use copyrighted works, you would be stupid not to use that as a defense. Because maybe somebody on the jury agrees with you...
If I buy your painting, you can stop me from making copies and selling them to other people, but you can't stop me from selling my original copy to whomever I want, nor could you stop me from painting little dinosaurs all over it and hanging it in my hallway.
That means that if I buy your painting, I'm also free to study it and learn from it in whichever way I please. Studying something is not copying it.
These explicit license can be just about anything (MIT, GPL, AGPL, etc)
The fact is that copyright only applies to specific situations, it does not give you complete control over the thing you made and what can be done with it.
If I buy your book, I can lend it to a friend and they can read it without paying you. I can read it out loud to my children. I can cross out your words and write in my own, even if it completely changes the meaning of the story. I can highlight passages and write in the margins. I can tear pages out and use them for kindling. I can go through and tally up how many times you use each word.
Copyright only gives you control over copies, end even then there are limits on that control.
If that were true, nobody would be afraid of the GPL's. When you buy a painting, you get an implicit license to do pretty much what you want and resell it, but you still can't put it in your YouTube videos (yeah, nobody cares, but "technically..."), create your own gallery, or put it on a stage ... but we're not talking about paintings. Not directly, anyway.
We are talking about implicit licenses, though; people's work is listed online with some implicit license. At the crux of this AI issue is whether or not there is an implied license when AI scans stuff and, if not, whether it is covered under fair use.
For example, my blog posts and short stories. I don't care if someone uses it for training, but if it is over-fitting and spitting out my stories as if it were its own ... I'd be pretty furious.
I'm interested to see what happens, but I have a sinking suspicion that for some AI companies, it won't be an issue (non-profit, actually research motivated, etc.) and probably will win a "fair use" argument. Then others create AI from people's code they host, doing it purely for profit; I highly doubt they would be able to defend themselves.
You can either make it for yourself and keep it for yourself or you can put it out into the world for all to see, criticize, study, imitate, and admire.
No you wont!
It is only someone who distributes copies who can get in trouble.
If instead of that you as an individual decide to study a piece of art or fiction, and you do no distribute copies of it to anyone, this is completely legal and you don't have to pay anyone for it.
In addition to that, fair use protections apply regardless of what the creative works creator wants.
I wasn't talking about someone creating and selling copies of someone else's work, fortunately.
So my point stands and your completely is in agreement with me that people are allowed to learn from other people's works. If someone wants to learn from someone else's work, that is completely legal no matter the licensing terms.
Instead, it is only distributing copies that is not allowed.
If I paint a painting in the style of Monet, then I would give that person attribution by stating that. Monet may have never painted my artwork, but it's still based on that person's work. If I paint anything, I can usually point to everything that inspired me to do so. AI can't do that (yet) and thus has no idea what it is doing. It is a printer that prints random parts of people's works with no attribution. And finally, it is distributing them to it's owner's customers.
I actually hope that true AI comes to fruition at some point; when that happens I would be arguing the exact opposite. We don't have that yet, so this is just literally printing variations of other people's work. Don't believe me, try running an AI without training it on other people's work!
Generative AI, however, can ONLY learn via the theft of copyrighted works. Whether this theft is covered under fair use is left to be seen.
First: in your opinion, which specific type of law or right is being broken or violated by generative AI? Copyright? Trademark? Can we at least agree it does not meet the definition of theft?
> which specific type of law or right is being broken or violated by generative AI?
Namely, copyright. Here's some quick points:
- Generative AI cannot exist without copyrighted works. It cannot be "taught" any other way, unlike a human.
- Any copyrighted works fed to it change its database ("weights" in technical speech).
- It then transforms these copyrighted works into new works that the "original author would have never considered without attribution" (not a legal defense)
I liken Generative AI to a mosaic of copyrighted works in which a new image is shown through the composition, as the originals can be extracted through close observation (prompting) but are otherwise indistinguishable from the whole.
Mosaics of copyrighted works are not fair use, so why would AI be any different? I'd be interested if you could point to a closer physical approximation, but I haven't found one yet.
That's not true at all. Any works in the public domain are not copyrighted, and there are things that are not copyrightable, like lists of facts and recipes.
Generative AI could be trained exclusively on such works (though obviously it would be missing a lot of context, so probably wouldn't be as desirable as something trained on everything).
- Harper & Row, 105 S. Ct. at 2232
- Marcus, 695 F.2d 1171 at 1175
- Radji v. Khakbaz, 607 F. Supp. 1296, 1300 (D.D. C.1985)
- Roy Export Co. Establishment of Vaduz, Liechtenstein, Black, Inc. v. Columbia Broadcastinig System, Inc., 503 F. Supp. 1137 (S.D.N.Y.1980), aff'd, 672 F.2d 1095 (2d Cir.), cert. denied, 459 U.S. 826, 103 S. Ct. 60, 74 L. Ed. 2d 63 (1982)
Copying and distributing someone else's work, especially without attributing the original, to make money without their permission is almost guaranteed to fall afoul of fair use.
So, if you are doing something and asserting "fair use," you are literally asking for someone to challenge you and prove it is not fair use.
Well the point is that it wouldn't go to court, as it would be completely legal.
So yes, if nobody sues you, then you are completely in the clear and aren't in trouble.
Thats what people mean by fair use. They mean that nobody is going to sue you, because the other person would lose the lawsuit, therefore your actions are safe and legal.
> you are literally asking for someone to challenge you and prove it is not fair use.
No, instead of that, the most likely circumstance is that nobody sues you, and you aren't in trouble at all, and therefore you did nothing wrong and are safe.
Theft is never legal; that's why you can be sued. "Fair use" is a legal defense in the theft of copyrighted works.
> They mean that nobody is going to sue you, because the other person would lose the lawsuit
That hasn't stopped people from suing anyone ever. If they want to sue you, they'll sue you.
> and therefore you did nothing wrong and are safe.
If you steal a pen from a store, it's still theft even if nobody catches you; or cares.
That's incorrect. You can be sued for anything. If it is theft or something else or nothing is decided by the courts.
Fortunately I am not talking about someone illegally taking property from someone else.
Instead I am talking about people taking completely legal actions that are protected by law.
> in the theft of copyrighted works
Actually, it wouldn't be theft if it was done in fair use. Instead it would be completely legal.
If nobody sues you and proves that it was illegal then you are completely safe, if you did this in fair use.
Firstly: Copyrighted work IS THE AUTHOR'S PROPERTY. They can control it however they wish via LICENSING.
Secondly: You don't have any "fair use rights" ... there is literally NO SUCH THING. "fair use" is simply a valid legal defense WHEN YOU STEAL SOMEONE'S WORK WITHOUT THEIR PERMISSION.
I'm jumping in the middle here, but this isn't true. They cannot control how they wish. They can only control under the limits of copyright law.
Copyright law does not extend to limiting how someone may or may not be inspired by the work. Copyright protects expression, and never ideas, procedures, methods, systems, processes, concepts, principles, or discoveries.
This isn't true though. There are lots of circumstances where someone can completely ignore the licensing and it is both completely legal, and the author isn't going to take anyone to court over it.
No, that right doesn't exist. If you put your work of art out there for people to see, people will see it and learn from it, and be inspired by it. It's unavoidable. How could it possibly work otherwise?
Artist A: You studied my work to produce yours, even when I asked people not to do that!
Artist B: Prove it.
What kind of evidence or argument could Artist A possibly provide to show that Artist B did what they're accusing them of, without being privy to the internal state of their mind. You're not talking about plagiarism; that's comparatively easy to prove. You're asking about merely studying the work.
Example:
If you studied my (we will assume "unique") work and used it without my permission, then let us say I sue you. At that point, you would claim "fair use," and the courts would decide whether it was fair use (ask everyone who used a mouse and got sued for it in the last ~100 years). The court would either agree that you used my works under "fair use" ... or not. It would be up to how you presented it to the court, and humans would analyze your intent and decide.
OR, I might agree it is fair use and not sue you. However, that weakens my standing on my copyright, so it's better for me to sue you (assuming I have the resources to do so when it is clearly fair use).
You have a right to say anything you want. Others aren't obligated do as you say just because you say it.
>If you studied my (we will assume "unique") techniques and used them without my permission, then let us say I sue you. At that point, you would claim "fair use,"
On what grounds would you sue me? You think my defense would be "fair use", so you must think my copying your style constitutes copyright infringement, and so you'd sue me for that. Well, no, I would not say "fair use", I'd say "artistic style is not copyrightable; copyright pertains to works, not to styles". There's even jurisprudence backing me up in the US. Apple tried to use Microsoft for copying the look-and-feel of their OS, and it was ruled to be non-copyrightable. Even if was so good that I was able to trick anyone into thinking that my painting of a dog carrying a tennis ball in his mouth was your work, if you've never painted anything like that you would have no grounds to sue me for copyright infringement.
Now, usually in the artistic world it's considered poor manners to outright copy another artist's style, but if we're talking about rights and law, I'm sorry to say you're just wrong. And if we're talking about merely studying someone's work without copying it, that's not even frowned upon. Like I said, it's unavoidable. I don't know where you got this idea that anyone has the right to or is even capable of preventing this (beyond simply never showing it to anyone).
Yeah, that's exactly why you'd get sued for copyright theft.
> you must think my copying your style constitutes copyright infringement
Autocorrect screwed that wording up. I've fixed it.
I'm not sure where you are going with this ... but for what it's worth, techniques can be copyrighted ... even patented, or protected via trade secrets. I never said what the techniques were, and I'm not sure what you are going on about.
I'll repeat this as well: "Fair use" DOES NOT EXIST unless you are getting sued. It's a legal defense when you are accused of stealing someone else's work, and there is proof you stole it. Even then, it isn't something you DO; it's something a court says YOU DID. Any time you use something with "fair use" in mind, it is the equivalent of saying, "I'm going to steal this, and hopefully, a court agrees that this is fair use."
If you steal any copyrighted material, even when it is very clearly NOT fair use (such as in most AI's case), you would be a blubbering idiot NOT to claim fair use in the hopes that someone will agree. There is a crap load of case law showing "research for commercial purposes is not fair use," ... and guess who is selling access to the AI? If it's actual research, it is "free" for humanity to use (or at least as inexpensive as possible) and not for profit. Sure, some of the companies might be non-profits doing research and 'giving it away,' and those are probably using things fairly ... then there are other companies very clearly doing it for a profit (like a big software company going through code they host).
I'm not privy to what goes on inside your head, I can only reply to what you say.
>Then, instead of debating what I meant to say (you know, the actual point of the conversation), you took my words verbatim.
The actual point of the conversation is about intelligent entities (either natural or artificial) copying each other's artistic styles. My answers have been within that framework.
>techniques can be copyrighted ... even patented, or protected via trade secrets.
First, what do you mean by "technique"? We're talking about art, right? Like, the way a person grabs a brush or pencil, or how they mix their colors...? That sort of thing?
Second:
>A patent is a type of intellectual property that gives its owner the legal right to exclude others from making, using, or selling an invention for a limited period of time in exchange for publishing an enabling disclosure of the invention.
Now, I may be mistaken, but I don't think an artistic technique counts as an invention. An artist might invent some kind of implement that their technique involves, in which case they can patent that device. I don't think the technique itself is patentable. If you think I'm wrong then please cite a patent on an artistic technique.
Third, how do you imagine an artist using a trade secret to protect their technique? Unless they do something really out there, most skilled artists should be able to understand what they're doing just by looking at the final product.
>I'll repeat this as well: "Fair use"
Okay, repeat it. I don't know why, since I never said that copying someone else's style or technique is fair use. What I said was that it cannot possibly be copyright infringement, because neither styles nor techniques are copyrighted.
>It's a legal defense when you are accused of stealing someone else's work
I'm not going to reply to any of this until you clean up the language you're using. "Steal" is inapplicable here, as it involves the removal of physical items from someone else's possession. What are you saying? Are you talking about illegal distribution, are you talking about unauthorized adaptations, are you talking about plagiarism, or what?
>"research for commercial purposes is not fair use,"
Sorry, what? What does that even mean? What constitutes "research" as applied to a human creation? If you say there's a crapload of case law that backs this up then I'm forced to ask you to cite it, because I honestly have no idea what you're saying.
Thousands of reviews, book reports, quotations on fan sites and so on are published daily; you seem to be arguing that they are all copyright violations unless and until the original copyright holder takes those reviewers, seventh graders, and Tumblr stans to court and loses, at which point they are now a-ok. To quote a meme in a way that I'm pretty sure does, in fact, fall under fair use: "That's not the way any of this works."
> There is a crap load of case law showing "research for commercial purposes is not fair use,"
While you may be annoyed with the OP for asking you to name a bit of that case law, it isn't an unreasonable demand. For instance:
https://guides.nyu.edu/fairuse#:~:text=As%20a%20general%20ma....
"As a general matter, educational, nonprofit, and personal uses are favored as fair uses. Making a commercial use of a work typically weighs against fair use, but a commercial use does not automatically defeat a fair use claim. 'Transformative' uses are also favored as fair uses. A use is considered to be transformative when it results in the creation of an entirely new work (as opposed to an adaptation of an existing work, which is merely derivative)."
This is almost certainly going to be used by AI companies as part of their defense against such claims; "transformative uses" have literally been name-checked by courts. It's also been established that commercial companies can ingest mountains of copyrighted material and still fall under the fair use doctrine -- this is what the whole Google Books case about a decade ago was about. Google won.
I feel like you're trying to make a moral argument against generative AI, one that I largely agree with, but a moral argument is not a legal argument. If you want to make a legal argument against generative AI with respect to copyright violation and fair use, perhaps try something like:
- The NYT's case against OpenAI involves being able to get ChatGPT to spit out large sections of NYT articles given prompts like "here is the article's URL and here is the first paragraph of the article; tell me what the rest of the text is". OpenAI and its defenders have argued that such prompts aren't playing fair, but "you have to put some effort into getting our product to commit clear copyright violation" is a rather thin defense.
- A crucial test of fair use is "the effect of the use upon the potential market for or value of the copyrighted work" (quoting directly from the relevant law). If an image generator can be told to do new artwork in a specific artist's style, and it can do a credible job of doing so, and it can be reasonably established that the training model included work from the named artist, then the argument the generator is damaging the market for that artist's work seems quite compelling.
That is precisely what I am arguing about and how it works. People have sued reviewers for including too much of the original text in the review ... and won[1]. Or simply having custom movie poster depicting too much of the original[2].
> "transformative uses" have literally been name-checked by courts. It's also been established that commercial companies can ingest mountains of copyrighted material and still fall under the fair use doctrine -- this is what the whole Google Books case about a decade ago was about. Google won.
Google had a much simpler argument than transforming the text. They were allowing people to search for the text within books (including some context). In this case, AI's product wouldn't even work without the original work by the authors, and then transforms it into something else "the author would have never thought of", without attributing the original[3]. I don't think this will be a valid defense...
> I feel like you're trying to make a moral argument against generative AI, one that I largely agree with, but a moral argument is not a legal argument.
A jury would decide these cases, as "fair use" is incredibly subjective and would depend on how the jury was stacked. Stealing other people's work is illegal, which eventually triggers a lawsuit. Then, it falls on humans (either a jury or judge) to determine fair use and how it applies to their situation. Everything from intent to motivation to morality to how pompous the defense looks will influence the final decision.[4]
[1]: https://www.law.cornell.edu/copyright/cases/471_US_539.htm
[2]: Ringgold v. Black Entertainment Television, Inc., 126 F.3d 70 (2d Cir. 1997)
[3]: Rogers v. Koons, 960 F.2d 301 (2d Cir. 1992)
[4]: Original Appalachian Artworks, Inc. v. Topps Chewing Gum, Inc., 642 F.Supp. 1031 (N.D. Ga. 1986)
> [Nation editor Victor Navasky] hastily put together what he believed was "a real hot news story" composed of quotes, paraphrases, and facts drawn exclusively from the manuscript. Mr. Navasky attempted no independent commentary, research or criticism, in part because of the need for speed if he was to "make news" by "publish[ing] in advance of publication of the Ford book." [...] The Nation effectively arrogated to itself the right of first publication, an important marketable subsidiary right.
The Nation lost this case in large part because it was not a review, but instead an attempt to beat Time Magazine's article that was supposed to be an exclusive first serial right. If it had, in fact, just been a review, there wouldn't have been a case here, because it wouldn't have been stealing.
Anyway, I don't think you're going to be convinced you're interpreting this wrongly, and I don't think I'm going to be convinced I'm interpreting it wrongly. But I am going to say, with absolute confidence, that you're simply not going to find many cases of reviewers being sued for reviews -- which Harper & Row vs. Nation is, again, not actually an example of -- and you're going to find even fewer cases of that being successful. Why am I so confident about that? Well, I am not a lawyer, but I am a published author, and I am going to let you in a little secret here: both publishers and authors do, in fact, want their work to be reviewed, and suing reviewers for literally doing what we want is counterproductive. :)
It’s not Harry Potter, they wouldn’t have written those words without someone else doing something of note the journo has nothing to do with, they just observed from a far and wrote the words about what happened from memory.
Kinda like an AI reads the action of their writing then can report on their writing.
It’s all just reporting on the actions of another, if the AI is in the wrong and needed to ask consent then the journo needs to ask consent from those they write about too.
For physical rival [1] goods, yes. Not necessarily the same for intangible non-rival things (e.g. the text of a book, not the physical ink and paper). Copyright law creates a legal right of exclusive control over creative works, but to me there isn't a non-economic-related social right to exclusive control over creative works. In the US, fair use is a major limit on the legal aspect of copyright. The First Amendment's freedom of expression is the raison d'être of fair use. Most countries don't have a flexible exception similar to fair use.
> OR, I might agree it is fair use and not sue you. However, that weakens my standing on my copyright, so it's better for me to sue you
No, choosing not to sue over a copyrighted work doesn't weaken your copyright. It only weakens the specific case of changing your mind after the statute of limitations expires. The statute of limitations means that you have a time limit of some number of years (three years in the US) to sue, with the timer starting only after you become aware of an instance of alleged infringement. Copyright is not like trademark. You don't lose your copyright by failing to enforce it.
Furthermore, even though the fair use right can only be exercised as an affirmative defense in court, fair use is by definition not copyright infringement [3]:
> Importantly, the court viewed fair use not as a valid excuse for otherwise infringing conduct, but rather as consumer behavior that is not infringement in the first place. "Because 17 U.S.C. § 107[9] created a type of non-infringing use, fair use is 'authorized by the law' and a copyright holder must consider the existence of fair use before sending a takedown notification under § 512(c)."[1]
(Ignore the bracket citations that were copied over.)
[1] https://en.wikipedia.org/wiki/Rivalry_(economics)
[2] https://www.law.cornell.edu/uscode/text/17/507
[3] https://en.wikipedia.org/wiki/Lenz_v._Universal_Music_Corp.
This is not universally true. Legislation is different from place to place.
They also don't seem to have much experience in the artist world. An artist usually can't reproduce a picture from memory, and if they can they are subject to copyright infringement depending on what and how they depict it, even if the image isn't a complete copy. By this logic of "bots are humans" a bot should be subject if they make a Not-legally-disctinct-enough talking mouse
I am SO tired of this non-argument
We needed huge amounts of human labor to fund and build Versailles. I'm sure many died as a result. Now we have machines that save many of those lives and labor.
What's your non-argument?
That perhaps we shoildnt compare modern capitalistic societies to 18th century European royalty? I sure don't sympathize with the justification of the ability to use less labor to feed the rich.
People keep making metaphors as if the AI is an entity in this transaction: it’s not! The AI is only the mechanism by which corporations launder IP.
No, the artists would be within their rights to do that if they chose to. This is corporations taking all the work of all artists regardless of the terms under which it was provided.
Most artists are happy to see more people getting into art and joining the community. More artists means the skills of this culture get passed down to the next generation.
Obviously a billion dollar corporation using their work to create an industrial tool designed to displace them is very different.
But that’s not even the important part of the argument. A lot of artists work for commission, and are hired for their style. If an AI can be trained without explicit permission from their images, they lose work because a user can just prompt “in the style of”.
There’s no real great solution, outside of law, because the possibility of doing that is already here. But I’ve seen this argument so much and it’s just low effort
Many artists don’t even go to art school. And those that do, do not spend most (all) of that time learning how to copy or imitate other artists.
I’m not expressing an opinion of whether GenAI is unethical or illegal - I think that’s a really difficult issue to wrestle with - just that this argument is a post-hoc rationalisation made in ignorance of how good artists work (not to say ignorance of the difference between illustration and art, conceptual art training vs say a foundation course etc).
He thinks he's an artist because he now has the ability to curate a dataset based off of one artist's work and prompt more art generated in that style. He did it, so clearly he is an artist now.
(salty salty~)
I'm just glad that so many more people have caught on to the bullshit than this time last year, or even six months ago.
I really don't even get the endgame. Art gets "democratized", so anyone who doesn't want their style copied stops putting stuff on the internet, and eventually all human art is trained, so the only new contributions are genAI. Maybe we could get a few centuries worth of stuff of "robot unicorn in the style of Artist X with a flair of Y" permutations, but even ignoring the centipede, that just sounds... boring. worthless.
https://www.aisnakeoil.com/p/generative-ais-end-run-around-c...
If it doesn't matter, then neither does the poisoning matter.
This, of course, assumes that "poisoning" actually works. Glaze and Nightshade and similar are very much akin to the various documented attacks on facial recognition systems. The attack does not exploit some fundamental flaw in how the systems work, but specific characteristics in a given implementation and version.
This matters because it means that later versions and models will inevitably not have the same vulnerabilities. The result is that any given defensive transformation should be expected to be only narrowly effective.
You mean like OpenAI and Adobe ?
Only the free and open source models didn't licensed any content for the training data.
OpenAI has provided no such documentation or legal guarantees, and it is still quite possible they scraped all sorts of copyright materials.
OpenAI and Shutterstocks publicly announced their collaboration, Shutterstocks sells AI generated images, generated with OpenAI models.
https://helpx.adobe.com/manage-account/using/machine-learnin...
"The insights obtained through content analysis will not be used to re-create your content or lead to identifying any personal information."
"For Adobe Firefly, the first model is trained on Adobe Stock images, openly licensed content, and public domain content where the copyright has expired."
(I work for Adobe)
[1] https://en.wikipedia.org/wiki/Derivative_work
BTW, the right to prepare derivative works belongs to the copyright holder of the reference work.
I doubt that many AI works are in fact derivative works. Sure, some bear enough similarity, but a gross majority likely doesn't.
> • can inject a small number of poison data (image/text pairs) to the model’s training dataset
I think thoes are bad assumption, labelling is more and more done by some labelling AI.
Enjoy the short term novelty while you can.
Why is this hippie nonsense so popular?
But it's still not clear why this is worse than the situation where not everyone can create perfectly-rendered pieces of whatever idea is in their head, and have to rely on others to do it for them, while being limited by what they can afford and what those others are willing to paint.
In this case, the mechanism for how it would work is effectively useless. It doesn't affect OpenAI or other companies building foundation models. It only works on people fine-tuning these foundation models, and only if the image is glazed to affect the same foundation model.
Anyone arguing against this technology following the line of reasoning you present is operating in adverse to the good of society. Especially if their only motive is economic viability.
> simply acquiring only training data you have permission to use
Currently it's generally infeasible to obtain licenses at the required scale.
When attempting to develop a model that can describe photos for visually impaired users, I had even tried to reach out to obtain a license from Getty. They repeatedly told me that they don't license images for machine learning[0].
I think it's easy to say "well too bad, it doesn't deserve to exist" if you're just thinking about DALL-E 3, but there's a huge number of positive and far less-controversial applications of machine learning that benefit from web-scale pretraining and foundation models - spam filtering, tumour segmentation, voice transcription, language translation, defect detection, etc.
[0]: https://i.imgur.com/iER0BE2.png
However - and this is a big however - I don't believe it deserves the legal protection to be used for profit.
I am of the opinion that if you train your model on data that you do not hold the rights for, your usage should be handled similarly to most fair use laws. It's fine to use it for your personal projects, for research and education, etc. but it is not OK to use it for commercial endeavors.
Say I train a machine vision model that, after having pretrained on ImageNet or similar, detects deformities in a material for a small company that manufactures that material. Do you not think that would be fair use, despite being commercial?
To me it seems highly transformative (a defect detection model is entirely outside the original images' purposes) and does not at all impact the market of the works.
Moreover, you said it was "Baffling to see anyone argue against this technology" but it seems there are at least some models (like if my above detector was non-commercial) that you're ethically okay with and could be affected by this poisoning.
>Moreover, you said it was "Baffling to see anyone argue against this technology" but it seems there are at least some models (like if my above detector was non-commercial) that you're ethically okay with and could be affected by this poisoning.
Just because I think there are situations where it's not ethically wrong to use someone's work without permission does not mean I think it's ethically wrong for someone to protect their work any way they see fit.
To use an extreme example: I do not think it's wrong for a starving man to steal food. I also do not think it's wrong for someone to defend their food from being stolen, regardless of the morality of the thieves' motivation.
I'd argue that essentially all work based off the work of others. I can only draw a "car" better than a random guess because I've seen many (individually copyrighted) car designs.
That's not to say we inherently have to treat use of statistical models the same, but rather that there does have to be a line somewhere to define where a new work, while dependant on previous works in aggregate, is sufficiently transformative - not carrying substantial similarity to any particular existing work that played a part in its creation - and can therefore be used by the author to make a living.
That line has to be placed in a way that prioritizes the progress of sciences and useful arts, rather than just enriching rightsholder megacorps like Getty Images/Universal Music. It should certainly allow training something like a tumor segmentation network, rather than rendering it infeasible.
Also, while whether it's morally okay is relevant and worth discussing, I think the question still stands of whether you believe my example would count as fair use, given the transformative nature and lack of impact on the market of the original work.
> Just because I think there are situations where it's not ethically wrong to use someone's work without permission does not mean I think it's ethically wrong for someone to protect their work any way they see fit.
> To use an extreme example: I do not think it's wrong for a starving man to steal food. I also do not think it's wrong for someone to defend their food from being stolen, regardless of the morality of the thieves' motivation.
I personally agree that they have a right to do so, but I don't think it'd be "baffling" that the [starving man/person training a tumor detector] would be against it, and it's likely not a "non-issue" for them to obtain sufficient [food/data] through other means.
Particularly since there are already means to opt-out that are respected by scrapers, and this is instead an attempt to do active damage. I guess in the analogy it'd be leaving out poisoned bread, although that's more extreme than I intend.
sorta like what the laptop did for writing
The poorest people have historically produced great art. Training a model, however? Expensive. Running it locally? Expensive. Paying the sub? Expensive.
Nothing is being democratized, the only thing this does is devaluing the blood and sweat people have put into their work so FAANG can sell it to lazy suckers.
It's still noticeably visible.
This will work about as well...
Oh, I forget, fighting music pirating was considered an evil thing to do on HN. "pirating is not stealing, is copyright infringement", right? Unlike training neural nets on internet content which of course is "stealing".
Many people would in fact argue that training AI on people's art without permission is copyright infringement, since the thing it (according to detractors) does is infringe copyright by generating knockoffs of people's work.
You will see some people use the term "stealing" but they're usually referring to how these AIs are sold/operated by for-profit companies that want to make money off artists' work without compensating them. I think it's not unreasonable to call that "stealing" even if the legal definition doesn't necessarily fit 100%.
The music industry is also not really a very good comparison point for independent artists... there is no Big Art equivalent that has a stranglehold on the legislature and judiciary like the RIAA/MPAA do.
AI is sampling other's works.
Musicians can and do sample. They also obtain clearance for commercial works, pay royalties if required, AND credit the samples if required.
AI "art" does none of that.
You sure about that?
Entire legal firm empires have been built on the licensing, negotiations, and fees that make up the industry.
I'm ain't talking about some dude on YouTube or Soundcloud. Few people care about some rando on Soundcloud. Those moles aren't big enough to whack. Vanilla Ice and MC Hammer were. OpenAI is as well.
There's even a company that specializes in sample clearance: https://sampleclearance.com
More info: https://www.soundonsound.com/sound-advice/sample-clearance
Also:
>not turned into a part of a pattern used to generate new sounds like what AI generators do with images
This is demonstrably false. Multiple individuals have repeatedly been able to extract original images from AI generators.
Here's one-- Extracting Training Data from Diffusion Models https://arxiv.org/abs/2301.13188
Text, too: https://arxiv.org/abs/2311.17035
The rumblings I'm hearing are that this a) barely works with last-gen training processes b) does not work at all with more modern training processes (GPT-4V, LLaVA, even BLIP2 labelling [1]) and c) would not be especially challenging to mitigate against even should it become more effective and popular. The Authors' previous work, Glaze, also does not seem to be very effective despite dramatic proclamations to the contrary, so I think this might be a case of overhyping an academically interesting but real-world-impractical result.
[1]: Courtesy of /u/b3sn0w on Reddit: https://imgur.com/cI7RLAq https://imgur.com/eqe3Dyn https://imgur.com/1BMASL4
Denoising is probably a good preprocessing step anyway.
Of course I'm assuming it works to begin with. Sounds like a game of cat and mouse. And AI has a lot of rich cats.
If you have to have both and instantly toggle between them to notice the difference, then it sounds like it’s doing its job well and is hard to notice the difference.
I can't really imagine a case where if I had only seen the AI edited one I would have any different reaction or response to viewing the piece of art compared to having only seen the original one.
Standards differ. I saw glazed images in the wild, was wondering why they have so much JPEG artifacts, until I saw the post of one of those anti-AI + glaze images on his profile.
https://i.imgur.com/I6EQ05g.png
https://i.imgur.com/zUVn8rt.png
But now that I double-check, I was comparing with the images zoomed to 200%. On desktop the artifacts are also noticeable at 100%, but not nearly as bad as in my previous comment.
It's a bad tradeoff.
Even before the current AI boom, plenty of artists have wanted to showcase their work/prove that it exists without necessarily making the highest quality original file public.
According to which authority?
I don't know if anyone else is still scraping new images into the generators. I've heard somewhere that OpenAI stopped scraping around 2021 because they're worried about training on the output of their own models[1]. Adobe Firefly claims to have been trained on Adobe Stock images, but we don't know if Adobe has any particular cutoffs of their own[2].
If you want an image that screws up inference - i.e. one that GPT-4V or Stable Diffusion will choke on - you want an adversarial image. I don't know if you can adversarially train on a model you don't have weights for, though I've heard you can generalize adversarial training against multiple independent models to really screw shit up[3].
[0] All learning capability of text generators come from the fact that they have a context window; but that only provides a short term memory of 2048 tokens. They have no other memory capability.
[1] The scenario of what happens when you do this is fancifully called Habsburg AI. The model learns from it's own biases, reinforcing them into stronger biases, while forgetting everything else.
[2] It'd be particularly ironic if the only thing Nightshade harms is the one AI generator that tried to be even slightly ethical.
[3] At the extremes, these adversarial images fool humans. Though, the study that did this intentionally only showed the images for a small period of time, the idea being that short exposures are akin to a feed-forward neural network with no recurrent computation pathways. If you look at them longer, it's obvious that it's a picture of one thing edited to look like another.
Study on the Influence of Adversarial Images on Human Perception
It's not random but it's not particularly curated either. Most of the time, any curation is done afterwards.
https://arxiv.org/abs/2201.12086
Your understanding of the attack was the same as mine, it injects just the right kinds of pixels to throw off the auto-labellers to misdirect what they are directing causing the tags to get shuffled around.
Also on reddit today some of the Stable Diffusion users are already starting to train using Nightshade so they can implement it as a negative model, which might or might not work, will have to see.
Generative models like text-to-image have an encoder part (it could be explicit or not) that extract the semantic from the noised image, if the auto-labelers can correctly label the samples then the encoded trained on both actual and adversarial images will learn to not take the same shortcuts that the proxy model has taken making the model more robust, I cannot see an argument where this should be a negative thing for the model.
I still feel it is absolutely wrong to roam around the internet and scrape images (without consent) in order to power one’s cash cow AI. I hope more methods to protect artworks (including audio and other formats) become more accessible.
in the same way bittorrent or gzip is
To train a model on the data.
I hope this is a special exception you've made, rather than your general approach towards interacting with your fellows.
Do I really have to explain this? You know I don't. Do better.
As for the card example it is on you to keep secrets secret. It is clearly a fault with how credit cards work and for things like that you should get insurance. Keep your card safe, or better yet, use cash. We can call it theft, doesn't matter to my point.
There is no "taking" or "grabbing" anything, I visited your website and was served a copy of the data because you made it do so. You wanted it to happen, for the public to see it, that was your goal. You expected it to happen. Do you disagree that me acquiring a copy was consensual? If so it is very different from the hypotheticals you're posing don't you think?
Once a copy is in my possession you would need to initiate violence to stop me from training a model on it which puts you on the wrong side of the moral line.
Also who said anything about selling?
> Also who said anything about selling?
All the corporations that are offering AI as a paid service?
Okay, extract the images from a Stable Diffusion checkpoint then. I'll wait.
It's not like lossy compression CAN'T be fair use or transformative. I'm sure you can imagine how that is possible given the many ways an image can be processed.
> All the corporations that are offering AI as a paid service?
Am I them?
I think it's worthwhile for such discussion to happen in the open. If the tool can be defeated through simple means, it's better for everybody to know that, right?
Causing car crashes isn't hard (https://xkcd.com/1958/). That doesn't mean Car Crash™ International®'s decision-makers know how to do it: they probably don't even know what considerations go into traffic engineering, or how anyone can just buy road paint from that shop over there.
It's everybody's responsibility to keep Car Crash™ International® from existing; but failing that, it's everybody's responsibility to not tell them how to cause car crashes.
Let me rephrase: Would AI-powered upscaling/downscaling (not a simple deterministic mathematical scaling) not defeat this at a conceptual level?
AI image exclusion standard
, similar to "robots.txt" -- which would tell an AI data-gathering web crawler that a given image or set of images -- was off-limits for use as data?
https://en.wikipedia.org/wiki/Robots.txt
https://www.ietf.org/
Robots.txt survived because the use of it to gatekeep valuable goodies was never widespread. Most sites want to be indexed, most URLs excluded by the robots file are not of interest to the search engine anyway, and use of robots to prevent crawling actually interesting pages is marginal.
If there was ever genuine uptake in using robots to gatekeep the really good stuff search engines would've stopped respecting it pretty much immediately - it isn't legally binding after all.
Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Robots.txt survived because the use of it to gatekeep valuable goodies was never widespread. Most sites want to be indexed, most URLs excluded by the robots file are not of interest to the search engine anyway, and use of robots to prevent crawling actually interesting pages is marginal.
Robots.txt survived because it was a "digital signpost" a "digital sign" -- sort of like the way you might put a "Private Property -- No Trespassing" sign in your yard.
Most moral/ethical/lawful people -- will obey that sign.
Some might not.
But the some that might not -- probably constitute about a 0.000001% minority of the population, whereas the majority that do -- probably constitute about 99.99999% of the population.
"Robots.txt" is a sign -- much like a road sign is.
People can obey them -- or they can ignore them -- but they can ignore them only at their own peril!
It's a sign which provides a hint for what the right thing to do in a certain set of circumstances -- which is what the Law is; which is what the majority of Laws are.
People can obey them -- or they can choose to ignore them -- but only at their own peril!
Most will choose to obey them. Most will choose to "take the hint", proverbially speaking!
A few might not -- but that doesn't mean the majority won't!
>If there was ever genuine uptake in using robots to gatekeep the really good stuff search engines would've stopped respecting it pretty much immediately - it isn't legally binding after all.
Again, name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
Nevertheless, I hope that at some not-so-far point in the future there will be more legal guidance about this kind of stuff, i.e. it will be made clear that scraping violates copyright. This still won't solve the problem of detectability but it would at least increase the risk of scrapers, should they be caught.
Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Currently I see no organisation who would be willing to do this or even just technologically able - as even just detecting such scrapers is an extremely hard task.
// Part of Image Web Scraper For AI Image Generator ingestion psuedocode:
if fileExists("no-ai.txt") {
} else { };See? Nice and simple!
Also -- let me ask you this -- what happens to the intellectual property (or just plain property) rights of Images on the web after the author dies? Or say, 50 years (or whatever the legal copyright timeout is) after the author dies?
Legal grey area perhaps?
Also -- what about Images that exist in other legal jurisdictions -- i.e., other countries?
How do we know what set of laws are to apply to a given image?
?
Point is: If you're going to endorse and/or construct a legal framework (and have it be binding -- keep in mind you're going to have to traverse the legal jurisdictions of many countries, many countries!) -- you might as well consider such issues.
Also -- at least in the United States, we have Juries that can override any Law (Separation of Powers) -- that is, that which is considered "legally binding" -- may not be quite so "legally binding" if/when properly explained to a proper jury in light of extenuating (or just plain other) circumstances!
So kindly think of these issues prior to making all-encompasing proposals as to what you think should be "legally binding" or not.
I comprehend that you are just trying to solve a problem; I comprehend and empathize; but the problem might be a bit greater than you think, and there might be one if not serveral unexplored partial/better (since no one solution, legal or otherwise, will be all-encompassing) solutions -- because the problem is so large in scope -- but all of these issues must be considered in parallel -- or errors, present or future will occur...
Yes, and who is supposed to run that code?
> Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
Github? OpenAI?[1] Stable Diffusion?[2] LAION?[3] What do you think why there are currently multiple high-profile lawsuits ongoing about exactly that topic?
Besides, that's not how things work. Training a foundation model takes months and currently costs a fortune in hardware and power - and once the model is trained, there is, as of now, no way to remove individual images from the model without restraining. So in practical terms it's impossible to remove an image if it has already been trained on.
So the better question would be, name two entities who have ignored an artist's request to not include their image when they encountered it the first time. It's still a trick question though because the point is that scraping happens in private - we can't know which images were scraped without access to the training data. The one indication that it was probably scraped is if a model manages to reproduce it verbatim - which is the basis for some of the above lawsuits.
[1] https://www.theverge.com/2022/11/8/23446821/microsoft-openai...
[2] https://www.theverge.com/2023/2/6/23587393/ai-art-copyright-...
[3] https://www.heise.de/hintergrund/Stock-photographer-sues-AI-...
People that are honest and ethical?
And/or groups that don't want to risk getting sued? (Your: [1] [2] [3])?
>> Name two entities that were asked to stop using a given individuals' images that failed to stop using them after the stop request was issued.
>Github? OpenAI?[1] Stable Diffusion?[2] LAION?[3] What do you think why there are currently multiple high-profile lawsuits ongoing about exactly that topic?
Because:
a) (Some) American Lawyers (AKA "Bar Association Members") -- are Sue Happy?
b) Because various Governments / Deep States (foreign and domestic) / Dark Money Groups / Paid (and highly biased) Political Activists -- want to see if they can get new draconian laws (whilst believing their actions to be super-patriotic to their respective countries!) -- or at least court precedents that move in that direction -- passed?
c) Because there's big money at stake, all the way around? (https://www.biblegateway.com/passage/?search=1%20Timothy%206...)
d) Because the alleged "victims" are "playing the victim card"?
(https://tvtropes.org/pmwiki/pmwiki.php/Main/PlayingTheVictim...) (Note that as a theory, this pairs well with (a)!)
(How much revenue will they be losing if their net income from artwork was $0? Also, wouldn't such high profile cases give the artists a ton of free advertising? The Defendant companies should counter-sue for giving the Plaintiff artists what amounts to free publicity for their artwork so great that they couldn't buy it with all of the Google advertising credits in the world!)
>Besides, that's not how things work. Training a foundation model takes months and currently costs a fortune in hardware and power - and once the model is trained, there is, as of now, no way to remove individual images from the model without restraining.
>"without retraining"...
Meditate on that one for a moment...
>So in practical terms it's impossible to remove an image if it has already been trained on.
In practical terms -- just retrain the model -- sans ("without") the encroaching images!
The models will need to be updated every couple of months anyway to include new public data from the web!
Create a list of images NOT to include in the next run (see above, "no-ai.txt" -- good suggestion incidentally!) -- and then don't include them" on the next run!
It's not Rocket Science! :-)
(Also, arguably Elon Musk doesn't think that "Rocket Science" is in fact as hard as "Rocket Science" is purported to be -- but that's a separate debate! <g>)
>So the better question would be, name two entities who have ignored an artist's request to not include their image when they encountered it the first time. It's still a trick question though because the point is that scraping happens in private - we can't know which images were scraped without access to the training data. The one indication that it was probably scraped is if a model manages to reproduce it verbatim - which is the basis for some of the above lawsuits.
Explain to me, from the point of view of an AI company, how that AI company is to know ahead of time NOT to include an image from the web? (And thus not break the law, copyright law at least, and thus not incur the lawsuits and all the chaos that will apparently follow such an act?)
How is the AI company supposed to know, ahead of time, that a given image on the web is not to be included?
How please?
Because you see, that's the root of the problem you are trying to...
EDIT: I have seen a few examples with GPT-4 V and how I imagine it wasn't deceived, I doubt this technique can have any impact on the quality of the models, the only impact that this could potentially have honestly is to make the training more robust.
Eventually I assume the poisoning artifacts introduced in the images will be very visible to humans as well.
Also... Maybe I am naive, but it seems rather trivial to work around with a quick prefilter? I don't know if tradition denoising would be enough, but worst case you could run img2img diffusion.
reply
Doing that requires much less compute than training a large generative image model.
I'll repeat this point for clarity. After going over the paper again, denoising shouldn't affect this attack, it's the ability of plausible images to not be detected by human or AI discriminators (yet)
That's actually quite plausible.
Maybe they're ignorant of it right up until you announce it, but then they're no longer ignorant of it.
I am not trying to belittle foundational model trainers, but a lot goes on in ML land. Even groups can't track every development.