I have a hard time sympathizing with people complaining that Reddit made it difficult to freely scrape the entire site to train AI. I also have zero empathy for Reddit that they are hopefully going to lose a large chunk of that data from users that don't like being treated as free labor.
With Reddit's history of editing the database directly to make a point at the expense of its users, who's to say they don't have the full history of a person's post and will just discard the posts changed by addons like this? Or if not revert the changes on the frontend, they just provide the full history to AI trainers?
Of course we may never know for sure, but if you are European, they have to include all data about you in a GDPR data request. Also, I'm not sure if GDPR grants you the right to delete your posts for good?
yes, and if they cannot, they are violating the GDPR and have to pay fines.
This is why datasets are rarely sold as massive CSV's in the modern world - instead companies with data sell access to API's, with the expectation you'll query for what you need in real time.
They only need to delete personally identifying data. That means they could probably just remove the username from your post, but leave the post text there attributed to "anon".
Recital 66's wording ("right to be forgotten") suggests that Article 17 should be understood in this way, but Reddit might claim the 3(d) exception. I don't think that would be valid, but you might have to go to the courts if they do.
When the API changes were introduced, I tried to overwrite and delete my comments with a similar browser addon.
I had to repeat the deletion for months afterwards every week, because Reddit restored some random comments of mine again and again, even though they supposedly can not be recovered after being deleted.
I'm fairly convinced that they keep the data even after you delete it. I tried to follow up with a GDPR request, which they answered dishonestly and incomplete, I escalated that to my local authorities and then it took a few months for that authority to get back to me, requesting more information. Sadly I'm not in the mood to throw more of my personal time on this, but hope that at some point Reddit faces some legal actions for their behaviour.
Of course. Does anybody really believe any online company "deletes" their content? Even if some company does make a good faith effort to delete. They have backups, and probably shoddy backup practices where your data remains, gets brought back, is even just laying around in some 'backup_old' directory.
Reddit said years ago that they keep the content of deleted comments, but editing overwrites the content in their database, that is why these extensions were written.
They must have changed it or been lying from the start. (Reddit was partly open source waaayyy back in the day, so one could go check)
Or they're conveniently considering the use of those extensions as an ongoing cyberattack (they probably go against ToS, at the least), and use this opportunity to test their ability to restore from backups.
Based on the information provided being contradictory with itself, and omitting things that were at that time plainly visible on the site. Also, there were comments restored against my will from years ago, which were not contained in the data dump, even though others were. Which means that Reddit holds data in other places (otherwise they would have been unable to restore that), but have not detailed them in the GDPR request, which means that they have answered dishonestly and incomplete.
> who's to say they don't have the full history of a person's post and will just discard the posts changed by addons like this
They have done in the past. With the API changes I used a script to edit and then delete all of my reddit comments, and I then deleted my account. I checked recently and all my pre-edit comments were restored.
I don't think reddit let's you do this in anymore than a superficial way. I think reddit keeps the old edits internally so it won't harm the LLM. There were reports after the last protest of reddit reverting mass edits.
I mean, it's the only meaningful way of punishing the company/site. It becomes unusable, people don't contribute anything further because it stops being a hub/valuable site, and eventually their costs outweigh their benefits. That last bit is probably a pipe dream, but saying "Oh well, might as well still enrich them with my knowledge/contributions" doesn't seem like an alternative.
Since the blackouts last year and the recent IPO, it feels like astroturfing and spam have increased, while quality contributions have decreased. All usage metrics are up according to Reddit's IPO filings, but it feels like engagement is actually down, or at least lower quality. Many niche subs feel like ghost towns now.
Is this just my subjective impression or do you feel the same?
Twitter feels the same way, they are claiming to have more active users then ever but that probably includes the horde of LLM bots and MY PUSSY IN BIO spam.
Spam increased exponentially after the 3rd party kill switch. There was profound options for bots to add to your mod list to help combat spam, repost accounts, and more.
They existed before the whole 3rd party fallout, but it does not even come close to how bad it is now.
IME the niche subs are still doing fine, it's the popular ones that are getting astroturfed and Eternal September'ed into oblivion. I do expect the LLM bots to eventually render the platform unusable, they would need to implement a very aggressive personhood verification policy to prevent that.
I sense that real world people are a more serious problem when it comes to Reddit's manipulation. It seems relatively easy for a coordinated group of moderators and power-users to sway a subreddit's tone.
I browse with a plugin that keeps track of a user's cumulative upvote/downvote score based on my votes of their content. I quickly noticed that the most downvoted users crosspost the same low effort content on a regular basis.
The API rugpull was a real setback for content and if they had followed through with claims at the time to allow charged access that could have worked but they never rolled anything out it was just a ruse.
Subjectively, I feel the same. That said I don't use it much any more -- when Apollo closed I stopped participating on the site.
I saw lots of comments shortly after the blackouts that 'felt' AI-generated, and when I rarely go there now from search results, using the awful new site, I see little content of value.
Browsing /r/all is a cesspool now. It feels like the same 30 topics with random OnlyFans wannabes and seemingly outrageous relationship stories/advice. It used to be such a great way to find and explore new topics.
Niche sub-reddits largely seem to either (1) be growing so large they become bland (2) dying and moving to other platforms.
I basically only enjoy the live sporting game threads now. Even then, it's a pretty shallow level of enjoyment.
I use /r/all but filter out about 100 subreddits to make it work. Unfortunately a lot of them were once great but get now exploited with fake stories or low effort karma farmers.
When Apollo used to work (before the 3rd party apps purge), it would let you block any amount of subreddits - the first 100 it would block using the reddit api (which has that as a limit) and everything after, it would filter out on device. I think by the time it stopped working, I was blocking a couple of hundred subreddits.
The incentive to contribute is based on the potential return of social currency (prestige, togetherness, etc). If it's evident that you won't generate enough currency to outweigh enriching Reddit, why bother?
Maybe it is just me, but when reddit pops up in my search results (and since I am using Kagi it ranks quite often to the top) the topics are mostly useless to help me solve an issue or extract information. The threads are often outdated, and littered with personal opinions up to outright opinions and personal anectada. Compared to Q/A sites like StackExchange, the quality of information - at least for me - is very poor. Which is fine, since reddit claims to be a social network, too.
Reddit didn't reach this point because they're good, but because it's the least shitty option right now. (God I wish that wasn't the case.) I'm not saying there's no astroturfing going around there - - there absolutely is -- but it's still the only "mainstream" website where I'm confident I can find some dissenting opinions about a product that are written by actual human beings.
50/50 - I’ve been surprised about the number of Reddit threads that have been more useful than other results. Even if it’s been a discussion that doesn’t give me a solution but helps me shape what I’m trying the find.
Although it would be nice if unanswered posts didn’t rank so highly.
Sometimes I just want the opinion of an actual human being. It's hard to find that online anymore, without affiliate links and/or $COMPANY_NAME deleting negative remarks.
My experience has been the opposite in the last few years. I've found myself filtering results google/duckduckgo specifically for reddit, because I was finding better answers to technical questions. Anecdotal, of course, and it does seem to be getting worse (less successful for me) over the last 6 months.
The top of my mind was when I was having all sort of trouble with my Dell XPS and needed to find info on some bios operations, GPU testing, etc. Turned out it was a hardware failure that was tough to prove. Google yielded nothing, but there were a few threads on reddit that sent me in the right direction.
Same for me. A very specific non technical example was when I was searching about Natto , the Japanese fermented soybean food. About how to make and tips on how to better prepare it.
A search in Google yields pure SEO garbage. Adding site:reddit.com gave some good advice around natto and even pointed to some cool YT video (natto dad or similar).
Yeah, I had exactly this problem with Google the other day, I googled something and saw the first result was a reddit post and the short summary under the link was like "Yes I've seen this problem BUT WHAT YOU REALLY SHOULD BE DOING" and I was optimistic that someone had some good guidance. Guess what I should be doing? Uninstalling windows and running Linux... That answer somehow had made it into the Google summary despite being downvoted on actual reddit.
You could always just try that out mate. You might actually like it. Just get a usb-c nvme drive housing and put a medium sized nvme drive innit, then install fedora with kde.
If you're not an online game player, it's actually a solid choice.
If you're... Well, then you won't be for much longer, as you'll be banned by Anti-Cheat within a few days
Just so we're clear, this is using reverse psychology, right? They do want you to replace your comments with copyrighted text.
I assume the wording is because of legal ramifications. I wonder if such a defense works in court.
Personally, I think doing this is pointless. LLMs already use copyrighted works, so this isn't helping at all. The only way to tank Reddit is to add meaningless text which would make LLMs worse.
I know, right. The last thing I'd expect a self-proclaimed anti-capitalist to be defending is intellectual property, especially one of a corporation (NYT).
If Reddit keeps a copy of the data edits, this move also just serves to hamper open source models who can only train on scraped data, while those with enough money can buy the full dataset with history.
What I mean is, I agree and I think this plugin will do the opposite of what the authors expect.
In theory, Reddit won’t be keeping full edit histories of comments/posts. At some point, the edit history will stop recording and the original comment won’t be recoverable.
Or maybe Reddit is flush with cash and keeping all of the edits.
In any case, more edits means increased cloud bill.
If every conversation about any topic has responses copying unrelated New York Times articles, what are the chances LLMs trained on that data will hallucinate even worse than before?
I think the best way to sabotage LLMs trained on Reddit data would be to post something on topic, but straightup wrong, in some other way misleading or with subtle inaccuracies that would cause LLMs to produce bad results in ways that are hard to detect.
It's happening to entire internet. A lot of content generated in last few months is AI, some pretty good, but not great, all kind of on 'crappy' side. The 'crappy' feedback loop into training data is going to be real problem.
Wonder if internet will migrate back to each person having their own blog that they can control.
As I understand it, reddit as it has been has never not lost money. What, exactly, makes switching from a burn pit business model to one thst actually makes money qualify as "a bit shortsighted"? They've been doing this for two decades already. How does going from X-ten(?) billion cat photo comments to Y-ten billion open opportunities worth more than the cost of waiting yet more decades to actually make money?
If most of Reddit's new content is spambots pretending to have conversations in order to promote their product, why would anyone pay for that? Providing Reddit data to LLM trainers is directly encouraging this outcome, so it's shortsighted.
You've missed my point. Why would anyone pay for it anyway, and is that greater than the opportunity cost of waiting? They already have many billions of unadulterated comments that would work great as training data. How is a couple more, that everyine here seens to think will be corrupted anyway, going to improve the value calculation? Reddit's in the business of running a business, not a public benefit time capsule. You can't criticize just one side of the balance without mentioning the other, so to speak. (And actually, that's worth asking, tangentially: Do you think reddit's already being contaminated by spambots, or that the only way this happens is if reddit itself joins it?)
This is the end of Web 2.0. There will be a blip on signal/noise ratio (which wasn't that great to begin with, 99.9% of UGC is trash anyway) as procedurally-generated content floods sites with even more nonsense – and then once they become unusable (reddit already is), the next crop will pop up.
I'm long on people with great taste, trendsetters and commentators, editors, and curators. They'll be the vanguard of this next iteration of the internet.
Slightly off topic, but since the HN site and API is open to all, it'd be silly to assume our comments aren't also part of several datasets used to train LLMs.
What's wrong with people? Reddit has great content. I often use Google to search it for info. Why ruin it? LLMs are also very useful and we all benefit from them.
Reddit is a company with expenses so they need to make money somehow. You didn't have to use it if you don't want your content in LLMs training data.
> Repost deleted/removed information. Remember that comment someone just deleted because it had personal information in it or was a picture of gore? Resist the urge to repost it. It doesn't matter what the content was. If it was deleted/removed, it should stay deleted/removed.
There is a torrent of all Reddit comments up till at least 2020 floating around. And I'm pretty sure they have the rest of the data ready to sell to AI companies.
GDPR is irrelevant here and won't help - Reddit wants the text, not the PII surrounding it.
Another flavor of this would let the user submit their comment and it'd suggest a semantically similar excerpt from "non-"copywritten text. That'd address the edit reversion dilemma.
Are these people even sure the comment is even deleted on the backend where I assume the data will be taken from? I feel like they'll be pissing upwind and en-shit-ifying the site that will only harm users and not the data harvesting. If anything you want the public facing stuff there and free to scrape by any average Joe.
The reason I started leaving more comments on Reddit is precisely because it is going to be LLM training data. My wit is going to be part of our AI overlords
I hate the fact they allow bots and trolls to make tons of accoutns and tons of spam/troll posts daily. It would be trivial to fix this partially by putting limits on what a user can post per minute and per day, and try to make it harder to create new accounts and start spamming.
I suspect they make more money from allowing bots and trolls then doing the work of fixing this problem.
Why do so many people, even web developers, think anyone lets you do `UPDATE` or `DELETE` in their databases?! They let you do `INSERT`. That's it. You can insert add a new edit and you can add a delete. They don't actually delete or overwrite anything.
I can't even begin to fathom why anyone would want to train an AI on this corpus. Reddit isn't a social media site. It's not organic. The vast majority of the content of the site is created by just a dozen users. (Those people have to be doing it as a full-time job.) At the end of the day, Reddit is a top-tier porn site, with just enough "social" thrown on top to give people something to read between wanks.
I see a lot of people express that they get value out of the technical subs, like finding answers to programming questions there, but for the life of me, I can't see it. Ninety percent of the time, there's not even a bad answer. If there is, there are narcissists and sociopaths pedantically arguing about it. If Reddit has captured a particular search, and is taking up the first several slots, I will add "-site:reddit.com" (and YT) to my terms. I keep wondering what I'm missing, and it's starting to feel like I'm being gaslit into believing there's something of value there with internet-wide astroturfing.
And the same thing goes for any other sub, too, from mechanical keyboards to so-called "audiophile" gear (don't get me started) to various specific gaming "communities" I've tried to participate in. Contrary opinions, no matter how delicately expressed, are run out of town on a rail. There may be a useful comment now and again, but they are drowned by rudeness, ignorance, stupidity, pedantry, and -- most of all -- gatekeeping. Do I sound bitter? I'm bitter. Good luck with that.
99 comments
[ 2.6 ms ] story [ 176 ms ] threadWith Reddit's history of editing the database directly to make a point at the expense of its users, who's to say they don't have the full history of a person's post and will just discard the posts changed by addons like this? Or if not revert the changes on the frontend, they just provide the full history to AI trainers?
This is why datasets are rarely sold as massive CSV's in the modern world - instead companies with data sell access to API's, with the expectation you'll query for what you need in real time.
I had to repeat the deletion for months afterwards every week, because Reddit restored some random comments of mine again and again, even though they supposedly can not be recovered after being deleted.
I'm fairly convinced that they keep the data even after you delete it. I tried to follow up with a GDPR request, which they answered dishonestly and incomplete, I escalated that to my local authorities and then it took a few months for that authority to get back to me, requesting more information. Sadly I'm not in the mood to throw more of my personal time on this, but hope that at some point Reddit faces some legal actions for their behaviour.
Honest question: How young are you? This reads like someone who's very young and naive learning for the first time how the digital world works.
They must have changed it or been lying from the start. (Reddit was partly open source waaayyy back in the day, so one could go check)
Based on what?
They have done in the past. With the API changes I used a script to edit and then delete all of my reddit comments, and I then deleted my account. I checked recently and all my pre-edit comments were restored.
Is this just my subjective impression or do you feel the same?
They existed before the whole 3rd party fallout, but it does not even come close to how bad it is now.
I browse with a plugin that keeps track of a user's cumulative upvote/downvote score based on my votes of their content. I quickly noticed that the most downvoted users crosspost the same low effort content on a regular basis.
I just read article about marketing companies using bots that post 'pretty good comments, that slightly agree with you but mention the product'.
It's more valuable to astroturf and spam in reddit than never before.
I saw lots of comments shortly after the blackouts that 'felt' AI-generated, and when I rarely go there now from search results, using the awful new site, I see little content of value.
Niche sub-reddits largely seem to either (1) be growing so large they become bland (2) dying and moving to other platforms.
I basically only enjoy the live sporting game threads now. Even then, it's a pretty shallow level of enjoyment.
I've started getting in the habit of deleting my account every few months.
Reddit didn't reach this point because they're good, but because it's the least shitty option right now. (God I wish that wasn't the case.) I'm not saying there's no astroturfing going around there - - there absolutely is -- but it's still the only "mainstream" website where I'm confident I can find some dissenting opinions about a product that are written by actual human beings.
Although it would be nice if unanswered posts didn’t rank so highly.
A search in Google yields pure SEO garbage. Adding site:reddit.com gave some good advice around natto and even pointed to some cool YT video (natto dad or similar).
If you're not an online game player, it's actually a solid choice.
If you're... Well, then you won't be for much longer, as you'll be banned by Anti-Cheat within a few days
I assume the wording is because of legal ramifications. I wonder if such a defense works in court.
Personally, I think doing this is pointless. LLMs already use copyrighted works, so this isn't helping at all. The only way to tank Reddit is to add meaningless text which would make LLMs worse.
If Reddit keeps a copy of the data edits, this move also just serves to hamper open source models who can only train on scraped data, while those with enough money can buy the full dataset with history.
What I mean is, I agree and I think this plugin will do the opposite of what the authors expect.
Or maybe Reddit is flush with cash and keeping all of the edits.
In any case, more edits means increased cloud bill.
If every conversation about any topic has responses copying unrelated New York Times articles, what are the chances LLMs trained on that data will hallucinate even worse than before?
Use proven information warfare tactics.
Wonder if internet will migrate back to each person having their own blog that they can control.
Here is how platforms die:
* first, they are good to their users;
* then they abuse their users to make things better for their business customers;
* finally, they abuse those business customers to claw back all the value for themselves. Then, they die.
I'm long on people with great taste, trendsetters and commentators, editors, and curators. They'll be the vanguard of this next iteration of the internet.
Reddit is a company with expenses so they need to make money somehow. You didn't have to use it if you don't want your content in LLMs training data.
They already restore user comments against their will (and hilariously that’s also against their own reddiquette see extract below)
https://www.reddit.com/r/privacy/comments/14dcxy4/reddit_res...
> Repost deleted/removed information. Remember that comment someone just deleted because it had personal information in it or was a picture of gore? Resist the urge to repost it. It doesn't matter what the content was. If it was deleted/removed, it should stay deleted/removed.
GDPR is irrelevant here and won't help - Reddit wants the text, not the PII surrounding it.
I suspect they make more money from allowing bots and trolls then doing the work of fixing this problem.
I see a lot of people express that they get value out of the technical subs, like finding answers to programming questions there, but for the life of me, I can't see it. Ninety percent of the time, there's not even a bad answer. If there is, there are narcissists and sociopaths pedantically arguing about it. If Reddit has captured a particular search, and is taking up the first several slots, I will add "-site:reddit.com" (and YT) to my terms. I keep wondering what I'm missing, and it's starting to feel like I'm being gaslit into believing there's something of value there with internet-wide astroturfing.
And the same thing goes for any other sub, too, from mechanical keyboards to so-called "audiophile" gear (don't get me started) to various specific gaming "communities" I've tried to participate in. Contrary opinions, no matter how delicately expressed, are run out of town on a rail. There may be a useful comment now and again, but they are drowned by rudeness, ignorance, stupidity, pedantry, and -- most of all -- gatekeeping. Do I sound bitter? I'm bitter. Good luck with that.