60 comments

[ 2.1 ms ] story [ 51.1 ms ] thread
> but as Wired notes, it relies on "automated tools" as part of the process, which may have been how the more than 50 ads TTP discovered made it through.

Again, and again, and again, these technologies have proven ineffective to moderate content. User posted and otherwise. Until we have a legal mechanism in place to hold these companies meaningfully liable for this, it will not stop.

Every single one of these has the same damn list of excuses about cost of hiring human moderators, but I promise everyone reading this if you make the executives of a social network legally liable for distributing CSAM on their platforms, they will find all kinds of money to get human moderators really fucking quick.

36 million CSAM media removed in 2025? Why aren't millions of people in jail? Wtf?
(This reminds me of, and not to be political. This is a technological, rather than political angle) There's a TED talk by Carole Cadwalladr about "Facebook's role in Brexit" in which she talks about the ads the Leave campaign ran. This is what is meant by Facebook's "breaking democracy", where campaigns don't have to go through the usual disclosure avenues

Are there reasons why Brexit might have been popular? Yes, in the sense I've heard about them. Should we then be blaming Facebook?

The problem is consolidated power. Carole herself said in her talk that it's not about Trump vs no Trump (sorry. It's been a bit since I've seen the talk. I shouldn't just paraphrase), it's about citizens' right to meaningfully choose in an information landscape

This is the problem with Facebook. It becomes an Everything App. Who cares about fraud (say, on marketplace, needless to say the site itself, the way it's screwed over businesses) on the platform when you can grow big? Let's say in this case, the actual case I'm commenting on - "Facebook didn't know". Well then that's the problem, isn't it? It's a company set up by someone of low moral reasoning (https://news.ycombinator.com/item?id=1692122) that doesn't set out to make a good product, something people will actually like. It's about dominating an industry and ads can be totally unvetted or scummy or scammy if it enables them to do this

All their fines are merely a cost of doing business, and they won't change their ways until the fines hurt.
"They call them fines because if you can pay it, it's fine"
I appreciate recent EU regulations choosing to penalize corporations on the basis of a percentage of revenue.

It effectively mandates a lower-limit on spend for budgeting purposes.

Sure, that money might be spent ineffectively... but corporations will figure it out if their only options are to

1. Not invest in regulatory compliance at all and get fined for noncompliance.

2. Throw money at the problem, spend it inefficiently, and STILL get fined for noncompliance.

3. Throw money at the problem, spend it well enough to pass muster, avoid fines.

I'd be interested to know if the same amount of leniency shown here would be applied if we were talking about ads depicting violence against elected politicians.
So that's why they are lobbying for age verification, i.e ID verification?
> and ran across Facebook, Threads, Messenger and Instagram.

So it's the SAME AD PLATFORM? Even in MESSENGER? My god. Not only is this whole thing horrible but it's doubly so

What's crazy is how long it takes to report something like this to a big company and actually have them take action on it. I remember 10 years ago I reported a Giphy ad for the same thing, and it took them months to take action.
(comment deleted)
(comment deleted)
Somewhat related: open YouTube in an incognito window.

Search something rather innocuous like "news". Click the first thing then go back to the main page. You have to watch through the ad.

The amount of slop you will get suggested as soon as the algorithm warms up is nuts. The ad you are first served might also be slop. I mean AI generated video advertising overt bogus cures (a memorable one recently - "did you know the Bible has the answer to Alzheimer's?") over AI slop footage.

When I compare to my normal/auth'd Youtube experience, it feels like a totally different app. I have never really experienced such a cheap illustration of the "Youtube rabbit hole" effect. The degree to which AI authored advertising is participating in this is imo pretty concerning if you have, in particular, older parents or relatives.

This is what happens when you let a company be controlled by one person who has no reason to be accountable to anyone.

If Zuckerberg wants total voting control, then he can also deal with the consequences of being caught hosting CSAM.

I'm starting to wonder if any of this is better than local newspapers, where there's an editor with oversight over all content...
I'm wondering what people expect these companies to do? Human moderators? Sure, but Meta products have approximately half the worlds population using them. At this scale it's pretty mind bogglingly difficult to moderate down everything. The ads/posts served per second is an astronomical number.

This truly is a case where AI is the solution. There's no way to automate this at scale with humans. As AI gets better hopefully detection and moderation will catch up

(comment deleted)
They could absolutely moderate this at scale. They would just make less money so they have no incentive to do that.
Weird how they never thought to require ID verification for advertisers hmmm
for real. if you want to make the web safer for children, start by holding ad networks to a higher accountability. it's painfully obvious "protect the children" is not the real goal.
As if you didn't need another reason to use an ad blocker.
I've noticed on YouTube I see a lot of adult sexual ads. Things like home cleaning ads that have an unmistakable wood-grain image of fellatio. I've always wondered "how are these getting past the moderators?". I guess the answer is the obvious one: no one is moderating anything.
But that can't be true! From the article (with a probably irrelevant fact added by me):

  "Sexual exploitation is horrific, and we work aggressively to keep it off our platform" a Meta [which in the past 2 years has laid off and disbanded all teams responsible for this] spokesperson says.
Firefox and uBlock Origin will prevent you seeing any ads. I didn't even want to use it until the adds got so repetitive.
(comment deleted)
I've noticed this with obvious scam ads on the YouTube app or even Google search results. I've determined that (much like Twitter/X) the "verification" (or "moderation") is simply just "did they [the advertiser] pay us?"
You guys see ads on YouTube?

Brave browser is a thing by the way.

Every time I got an ad for Falung Gong or Epoch Times related properties or that annoying Epoch Times Russian-American ( Roman in this article https://www.nytimes.com/2020/02/05/technology/epoch-times-yo... ) I used to screenshot it and email it individually to every single Google Board member I could find.

I haven't seen any Epoch Times ads in Youtube for a while... maybe it worked !

> AI-generated

How on earth can they know?

Read the article. Between the lines it doesn’t seem like the real issue is any specific image, it’s the ”nudify” AI apps.

This is why they pushed for the change from “child porn” to “child sexual assault material” because LOTS OF THINGS can be “materials”.