88 comments

[ 3.0 ms ] story [ 164 ms ] thread
And let me guess, meanwhile they ask a big fee from AI companies for using the data.
No need to guess — that's what the protests are about.
Can they even do that?

I know that SO content is licensed under creative commons; is there an additional dual license that allows them to commercially use it under different (e.g. non-attribution) terms?

Content contributed on StackOverflow (and all the StackExchange sites I believe) is CC, so it's really a losing battle.
How is the use of CC-BY-4.0 by a LLM going to be attributed to satisfy the license conditions is my question. Every answer by the model contains the work as part of it's token weights and can regurgitate.
Yup, you need to cite every single poster ever.
Wouldn't a compliant solution be just a glorified search engine?
Copyright covers the words not the ideas/concepts/facts. If I read a StackExchange post, I can absolutely use those ideas/concepts/facts to write a new document, which I can choose to copyright and sell, and there's no need for me to cite the SE post.

Now, as a matter of academic courtesy it's nice to cite the SE post if it's feasible, but it's impossible for me to remember where I learned everything I've learned over the years. Likewise, an LLM shouldn't be forced to cite where it learned facts, which might be technically hard/impossible, but if there is a clear best source then as a matter of politeness it should. And LLMs mostly do this when they can!

> Now, as a matter of academic courtesy it's nice to cite the SE post if it's feasible, but it's impossible for me to remember where I learned everything I've learned over the years. Likewise, an LLM shouldn't be forced to cite where it learned facts, which might be technically hard/impossible, but if there is a clear best source then as a matter of politeness it should. And LLMs mostly do this when they can!

Scientific papers have included references for as long as I can remember. It's not about courtesy, but precision and acknowledgement.

So, are we letting LLMs run free and do things that would be frowned upon if they were done by humans?

When LLMs are used to write academic papers, then there is definitely a stronger requirement on the authors deploying them for identifying the source of ideas, as a matter of professional ethics (not law). But this isn't the issue being discussed, and it's not anything new with LLMs. Long before LLMs, academic authors occasionally got ideas from other places StackExchange without citing them properly in papers. (They frequently learn things from StackExchange, but most of the time they don't need to cite them because it's part of common knowledge. Cases where they got novel, cite-necessary insights is much rarer, as it will be for LLMs.)
LLMs don’t learn facts. They don’t think, cogitate, daydream, hallucinate, lie, or any other activity that requires intelligence, a mind, or a personality. Writing about them the way you did just advances the scam that is the current AI industry.
When I say "my thermostat tries to keep the temperature at 72", this doesn't mean I'm asserting anything about the thermostat having "goals" in some deep philosophical sense. It just means that the behavior of the thermostat can be usefully understood, in the relevant context, as goal-directed. (Likewise, "legs are for walking" even though legs were designed through a evolutionary process, etc.) We use this sort of language all the time, it's very useful, and it's mere pedantry to demand people not to. Likewise here, a machine can absolutely "learn" facts in the sense that it extracts them from the copyright-able creative choices in the text written by a human author.
You can't say I'm using the word learn as a metaphor for some purely mechanistic and deterministic process and not like when people say learn as in middle school kids learning algebra and then switch to using the second definition to absolve OpenAI from following the license.

That'd be like saying my computer learned the film Oppenheimer when bittorrent copied it to my computer's storage system, transcoding it to a lower bitrate, and claim I'm free of copyright law because my computer just learned some facts.

All of OpenAI's products are databases with highly lossy compression applied. Using language that implies a mind is pure scam.

I’m not using anything about “learn” to justify what’s copyrightable and what’s covered by fair use. Those things are defined by the output, not the process that produced them. The point is that LLMs are very effective at extracting non-copyrightable facts from the words and other creative choices made by an author.
It's a losing battle in that the CC license and StackOverflow's ToS make it clear that StackOverflow is allowed to restore the post regardless of the original author's wishes.

It's less clear that the license gives AI companies the right to train LLMs. They tend to take the view that any media can be used for training regardless of licensing because it's fair use. Many authors disagree and believe they must explicitly license their content for LLM training. AFAIK none of these legal disputes have been settled yet.

In my view you shouldn't really expect to have much control over who uses the content you post to Stack Overflow. Maybe your answer will be used by a CS101 student. But it could also be used by a defense contractor, gambling site, North Korean hacker, or darknet drug marketplace. Yes, the license requires attribution, but if ChatGPT ignores that requirement it's behaving like 90% of programmers.

Its CC-BY-SA so openAI has to release the weights obtained by training.
> Stack Overflow has been banning users wholesale who have attempted to delete or deface their own posts on the site

Its not just people who are upset getting banned for being upset, its people who are attempting to burn it all down on their way out the door in protest.

I get where the protests are coming from, but the cardinal rule of online communities is "once you post it, its out there". Other people have reacted to it, replied to it, quoted it. You break not just your own content but entire discussions if you mass-delete your contributions. They stopped being exclusively yours to take back once you contributed them to a broader conversation.

A right to one's own expression/speech is a basic human right.
Is this true? I don't disagree with the idea, but do you really have the _right_ to delete some previous thing you've said no matter where it is? Seems untenable.
The right to delete your own words after uttering them (and giving some company a license to reproduce them no less) is dubious. I guess it exists in the EU with their "right to be forgotten" and GDPR stuff, but I think not in most of the rest of the world.
There is no basic human right of “takesies backsies” though - that seems more like the relevant question, along with IP ownership.
Deleting your past speech is not a basic human right, for good reasons:

Imagine e.g. the effect on democracy of politicians being able to have all of their past utterances deleted from the public record because they don't feel like it represents their current branding anymore.

For private individuals not "of public interest", the situation is a bit different, but e.g. the EU's "right to be forgotten" is arguably not a basic human right, but a relatively new and narrow concept for which there isn't any type of international consensus yet.

I have a right for you to forget that it was me who signed that contract with you!
> but the cardinal rule of online communities is "once you post it, its out there"

That's you opinion, not a cardinal rule. For example, Reddit comments and posts are deleted by users all the time.Same for Twitter, where users delete their posts and reacts all the time.

Its a practical reality of the internet. It would be simply naive to believe that all content on Stack Overflow, Hacker News, and wherever else any of us post has not been scraped and archived by dozens of parties who I never explicitly authorized to archive my words.

When I say "rule", I'm speaking in terms of "how each person posting content should operate". Once you make your words public, you (should) have no expectation of being able to take them back.

It's true that I can't undo Reddit having sold my content for models, I don't lose sleep about what I can't change. But we have every expectation (on every site but this one) that we can delete our content to empty out the original context.
SO lets your delete your unanswered questions, and also your unaccepted answers.

It doesn't let you delete your question after someone has gone to the trouble of answering though. Good thing IMO.

I don’t know if it’s still the case, but for many years deleting something simply hid it and there were browser extensions to “undelete” comments.
SO is different. It's a community effort, an asker and a set of answerers create something together, and SO+moderators clean up so that something is easy to find by searching (and also make the total collection downloadable).

This asker ignored the rights of the answerers, moderators and SO, all of which put effort into creating that. I won't mind if someoen deletes his own unanswered question, but vandalising it after answerers put in an effort to answer? That's rude and egoistic.

Unlike on other sites, I don't participate here beyond anonymous throwaway comments because there's no freedom to delete my content. If sites don't allow that freedom, it changes how or if people will participate.

If there is a delete button, it's fair game to use.

There is a delete button for unanswered questions. As soon as someone else has put in effort and, the combined result is no longer yours to delete.
I've never participated on SO, I don't know if you're saying that the site doesn't let you delete in that scenario, or if it's bad etiquette to delete. If the latter, I'd disagree and say it's my choice alone (unless the site reneges on the ability to delete.)
The site doesn't let you.
I want to post a separate response to this.

Yes, the lack of that changes how people participag on SO. I think it's a considerable reason why SO is the large resource that it is, with as many answers as it has. If askers could delete their questions (and thereby had the ability to make my answers un-google-able), I'm not sure I'd bother to answer, for example. Would you?

> SO is different. It's a community effort…

More to your point, it’s focused on evergreen information. Ideally the questions and answers get refined over time to resolve in to accurate documents that the public can use to solve problems. Most social media is about attention/dissemination in the moment and puts the individual above all.

Aren't they just deleted on the front end though?

I thought reddit keeps them still in the backend.

Hard no. There is such a thing as the right to forget. At least in Europe. Stackoverflow likes to take that right away as it earns them more money, but that is never a good reason.
"Hard no. There is such a thing as the right to forget."

This only exists as a wish, but is not written in stone and some people actually disagree to that.

Actually it does exists, as part of GDPR and then added into the law of individual EU nations.

Whether it applies to Stack Overflow posts is another discussion. IMO it doesn't due to Creative Commons licensing.

The right to be forgotten does not mean you content has to be taken down, just that it no longer has to be associable with you.
> The right to be forgotten does not mean you content has to be taken down

As with almost anything GDPR: it really depends on the content, on the website, on the situation. There's no clear cut answer that applies to all cases.

And copyright law also enters into the picture here, which is why I added the second paragraph.

As I understand it, the right to be forgotten is a related but distinct concept to the GDPR.
The right to forget is about removing personal information from a site, or removing articles about you from search results. An answer to a Stackoverflow question isn't really personal info.
Right to forget can be achieved by unlinking the content from you, though, and making sure it contains no personal identifiable information. Doesn't mean it needs to be deleted.

Specifically since what you've posted on SO you've shared as CC BY-SA.

That's not what that set of laws/norms covers at all.

Try publishing a book with any European publisher and then "right to be forgottening" it out of existence.

> They stopped being exclusively yours to take back once you contributed them to a broader conversation.

Says who, exactly? Stack Overflow, previously, did not say this. Reddit threads get deleted all the time. Facebook posts slide into the ephemeral "past" and are never seen again. Old forums die entirely, with nothing but (hopefully) a copy on the wayback machine.

And that's just regular old rot, in this case, Stack Overflow is explicitly changing the rules on what they can do with writing provided by volunteers under a previous understood agreement, to a new agreement, with no opportunity for negotiation and no engagement with their community. Simply an edict, issued from On High: "We can now sell your contributions to AI companies." And I'm sure for plenty of people they don't give a shit, but clearly some do, and so we get what HN is constantly clamoring for, individuals making decisions about their own creations and their own speech, but now it's suddenly bad because it's the Wrong decision.

You're mistaken. All content on SO has always been creative commons licensed when you post it. Hence all spam duplicates on Google but also other cool usage of the massive data. They aren't retrospectively changing anything.

Edit: source https://stackoverflow.com/help/licensing CC BY-SA

In that case they are changing what they do instead of changing a rule about what they do. A difference with a slight distinction.

The point is: people don't want their code used to train code bots. Their wishes should be respected. Not because it's legally required, but because they are our peers in this industry and worthy of respect.

It’s fair use. Get used to it
You aren't factually wrong, but this attitude is probably why developers are torching their accounts over this. Legally being in the clear is not the same thing as ethically being in the clear, and the continued abuse by the public square by these giant, faceless corporations is just engendering more hostility.

And it's all well and good to make those decisions, but if code-generating AI is anything like text-generating AI, they're going to want more. Probably not a great plan to piss off all the people who produce the thing you need, for free, before you have enough of it. Assuming there is such a thing as enough of it, of course.

Everyone knew it went into the database and the fair use if you had been around SO since the beginning was always part of the deal. SO even serves ads.

These “developers” are very immature and naive.

SO is a business

> Stack Overflow, previously, did not say this.

It's always a good idea to read the copyright/usage terms of sites you might be contributing to.

Stack Overflow has been very transparently licensing their content under creative commons since the beginning; that's a big part of why I occasionally contribute to it.

It was always that way, the user content has always been CC-licensed. And SO has suspended users for deleting/vandalizing their own posts for a long time.
> You break not just your own content but entire discussions if you mass-delete your contributions.

If they allow users to delete or edit their own content, then what's the issue? That just sounds like a technical problem StackExchange didn't think of.

On the other hand, why is this behaviour deemed unacceptable, and StackExchange double dipping on user generated content is not?

They've definitely thought about it. This is not the first user to rage quit and vandalize their posts and they have standard procedures to deal with it. (IIRC their system will even automatically flag bulk edits for review.) If you would like to disavow your content, you can ask to have your name removed, but once the content is out there and considered sufficiently valuable, it will not be deleted.

I don't agree with how StackOverflow's current management has been running the site, but for anyone who has used the site, the outcome of this behavior should have been obvious. I'm sure Wikipedia would react the same if you deface all the pages you contributed to prevent OpenAI from consuming words you wrote.

> On the other hand, why is this behaviour deemed unacceptable, and StackExchange double dipping on user generated content is not?

At least I'm engaging on StackExchange with the understanding that conversations (questions, answers, comments) there go on the public record for the benefit of future curious humans. I see that as a way of giving back to a community that's provided me with invaluable knowledge.

If I'd known somebody might delete their half of a fruitful conversation as a political statement months or years down the road, I might never have spent the time and effort of participating.

Thinking of it in terms of co-authorship, one of several co-authors also doesn't get to retroactively destroy the combined work by ripping out their individual contributions. If you collaborate, make sure you know and are aligned with the terms of the resulting work.

I wrote a script to delete over 10,000 reddit comments from my accounts there when they enshittified past the point of no return last year. Yes, the whole point is to devalue the site so that old search results are broken and people stop considering it a worthwhile place. The remaining users who are docile enough to remain on a shit site are holding the internet back from evolving through better sites.
"Once you post it its out there" sure... but if you piss off huge portions of the platform, then they have just as much right to now become your enemy and flood your system with worse trash than the AI is capable of.

Great, so how did these companies expect to stab so many people in the back and then continue as if it didnt happen again?

It's not clear to me what the deal is supposed to be about. Isn't it expected that Stackoverflow questions and answers can be used by anybody including to train models?

If Stackoverflow is trying to make exclusive deals with Openai, that is against the collaborative spirit of the platform, and I will stop contributing. After all, Openai is charging people for service. If Openai are the only ones given access, Stackoverflow becomes a gatekeeper, peddling my contributions. It'll beget a fork.

It's shitty to take content under an attribution license like the CC-BY-SA license SO uses and pour it into a soup of linear algebra where the content remains but all attribution is lost.
> Isn't it expected that Stackoverflow questions and answers can be used by anybody including to train models?

I don't think so. Content contributed to SO gets licensed under CC-BY-SA, no? How do these AI models respect the "BY" portion of that license? How do we enforce the "SA" portion of the license on people who use the output of the model?

The answer is they don't, but the big companies decided violating copyright is OK so long as they do it all at once, because there's a lot of money to be made if you ignore copyright.

Personally I'd be OK with a compromise where any entity that creates or uses an AI trained on copyrighted data forfeits copyright on all of their own works (not just those created by AI, all of their works).

> Isn't it expected that Stackoverflow questions and answers can be used by anybody including to train models?

CC ShareAlike requires attribution + derivative works to be shared under the same license. ClosedAI is absolutely in the wrong here.

> It's not clear to me what the deal is supposed to be about.

AI is unpopular and makes this an unpopular move, enough so to cause this drama. It's really not any more complicated than that.

I don't get it.

Like, it's one thing if a fact-collecting business like the NYTimes doesn't want its stories to train an MML. I think under current law they don't have much of a case, because facts aren't copyrightable, but there's a reasonable argument that the law should be updated somehow in light of technological change.

But the work produced by all StackExchange users is explicitly released under a CC BY-SA license. The whole point is to collect and publish facts/ideas/understanding for anyone to see and use for any purpose, including running a business. Yes, the "SA" (share alike) part means if you want to use and modify the words then you need to release them under license that is at least as permissive, but LLMs aren't using the words; they are clearly digesting the facts and expressing them in their own words. And, unlike the NYTimes, there is no issue of "couldn't new tech undermine society's current method of economically incentivizing fact-collection?". The StackExchange users are not being paid, and the fact that the license is not NC (non-commercial) explicitly means that using their hard work to make money is allowed (and encouraged!).

It's not clear whether LLM actions are derivative works or not. The only way they would not he derivative works is if there's specific logic in the implementation to check for all copyrighted works used in training and prevent an infringing output from such a work.
There doesn't have to be specific logic.
> Yes, the "SA" (share alike) part means if you want to use and modify the words then you need to release them under license that is at least as permissive, but LLMs aren't using the words; they are clearly digesting the facts and expressing them in their own words

The CC BY-SA text <https://creativecommons.org/licenses/by-sa/4.0/legalcode.en> says nothing about the words. The words "word" and "words" do not even appear in the legal text. What it says, however, is:

> In addition to the conditions in Section 3(a) , if You Share Adapted Material You produce, the following conditions also apply.

> 1. The Adapter’s License You apply must be a Creative Commons license with the same License Elements, this version or later, or a BY-SA Compatible License.

> 2. You must include the text of, or the URI or hyperlink to, the Adapter's License You apply. You may satisfy this condition in any reasonable manner based on the medium, means, and context in which You Share Adapted Material.

where "Adapted Material" is defined as:

> material subject to Copyright and Similar Rights that is derived from or based upon the Licensed Material and in which the Licensed Material is translated, altered, arranged, transformed, or otherwise modified in a manner requiring permission under the Copyright and Similar Rights held by the Licensor. For purposes of this Public License, where the Licensed Material is a musical work, performance, or sound recording, Adapted Material is always produced where the Licensed Material is synched in timed relation with a moving image.

So if you want to argue that LLMs don't have to follow the SA clause, then you have to argue either that:

1. LLMs aren't an arrangement or transformation of their input, or

2. the license doesn't apply at all, eg. because it's fair use in whatever jurisdiction they fall under.

OpenAI is using argument 2 <https://news.ycombinator.com/item?id=37780199>.

LLMs do not operate on ideas, they do not understand things. They operate on tokens which are phonemes, words or phrases. Think of it as a fancy autocomplete.
The ability for a person to freely use facts/concepts/ideas learned from a copyrighted source does not require the person to "understand" them. (How on Earth would a court ever determine that?)
It’s a legal thing. Is an LLM a person?
I don’t understand what you’re arguing
I asked a question. What are you arguing?
I'm using "words" as an informal summary of the large legal concept of what can be copyrighted, and "facts/concepts/ideas" for what cannot be. So it's not quite a fair use argument (which someone uses the words for certain protected purposes like parody), and I do not think OpenAI is making a fair use argument (although I'd welcome links to the contrary).

In other words, it has nothing to do with your or anyone else's interpretation of what the CC license claims to protect ("an arrangement or transformation"), and only relies on what rights they are legally allowed to assert.

Legality aside, I think the "payment" people get from posting free knowledge on the Internet is the human connection, and the satisfaction of knowing that other people are reading and appreciating it directly.

Injecting an LLM middleman between your post and the end user changes this dynamic quite a bit - without the human component, the feeling is that you're just doing unpaid labor for a profit-oriented company (OpenAI).

Sure, that's fine as a reason for those people to not contribute in the future. They are free to do as they please.
> I don't get it.

It's not about legality, it's that sites like SO and Reddit have turned a corner and are no longer sites or businesses that people want to support. The contract of user generated content has been disrupted, we'd have happily given them content to profit from forever if they didn't turn shitty. And now people are lashing out even if it's futile because the content has already been sold. These sites failed a generational marshmallow test, taking short term profit at the expense of souring people on the idea of providing free content going forward.

It's fine if they don't want to support them going forward. The question is whether users have any reason to claim that they have been harmed, and I'm arguing that they don't.
One can decide they don't like the site anymore because they changed the color of the logo. There can be any subjective reason, right? No one has to justify being against or for the site's recent decisions.
Stackoverflow made millions, people got badges.
People also get a freely accessible database dump licensed under CC-BY-SA. That's more than almost every other content-oriented platform out there gives back.
People also got answers to questions from other professionals that probably helped them personally financially and professionally in some way.
Fascinating. Perhaps Stallman's greatest innovation is copyleft. The idea of required reciprocation seems to tie deeply into people's views. For the little OSS I have I picked it by default but would gladly use BSD or some safe PD license on the other hand.

The idea of Pillaging the Commons is interesting. I wonder when the mainstream opinion started shifting. It wasn't quite sudden but it seems to me that even ten years ago the dominant Internet visible position was that much of copyright was bogus: information wants to be free / if a pirate copies your stuff, you still have it

But now there's a stronger sense of "this information is ours". Perhaps that subculture moved somewhere and this one came here or perhaps I moved from where the former was to where the latter is.

I find it an interesting sociological phenomenon.

Ultimately they are digging their own grave (who needs SO if you can ask ChatGPT and shell out a few bucks to Microsoft eh?)

If anyone else thinks it's a bad move, the most efficient way to boycott it is by adding senseless questions and answers and upvoting them. Us people is how they got big, us people is how they go down.

If people stop posting, even chatGPT will be useless since it can't keep up with current bugs, new ways to solve them, etc...
StackOverflow is destroying its brand one step at a time. ChatGPT is good for boilerplate and generic errors. I still use SO for complex errors that are still getting updated with new ways to solve that said error, etc...

Without the community posting and answering questions, ChatGPT won't work anymore. They (SO) have to block any scrapping, wait until GPU prices go down, or use open-source LLMs with their data and figure out how to monetize that service (maybe giving some percentage to devs, etc...) or even check if that approach (add a chatbot service) makes sense.

They just caved to the FOMO mentality without considering that tech is always evolving and they need engineers, dev, etc... to keep finding out bugs, writing about their experiences on how they solved those errors, etc...

We'll see if a different contender figures this out and comes out with that solution if SO doesn't change its course.