Didn't get past the paywall but, recently a friend had their primary school targeted by blackmailers who took public photos of children and made (I'm told) extremely explicit images with them, threatening to release them if not paid.
What's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel.
Don't post innocuous images of children ever? Seems like losing.
This has nothing to do with “deepfakes”. These girls could have been attacked by aliens and be received with more credulity. There has to be a point where you understand that this behavior towards girls and women is simply being allowed.
One of the mothers says this quite explicitly:
> Calling the event rumors and speculation when a crime occurred was almost worse than the crime
This is sadly becoming very common and they are worringly good enough for people to assume they are real. I had a friend who had this issue, she has tried to ride it off as no clue who made them or shared them but I know it can't be easy for her. There needs to be appropriate laws for this the same way there is for revenge porn etc.
I don't know how society will function when it's as easy to fake a video or image as it is to draw a stick figure. Hopefully it at least means that people view what happened here as akin to scribbling boobs on someone's photo, but we're not there yet apparently.
This kind of behavior should be met with swift and strong reaction from both the school authorities and the law enforcement. Kids responsible should be put on trial and face serious consequences including jail time for most egregious cases. Let the news cover it nationwide. "This is what will happen if you even think about creating and circulating nude pics of anyone" should be the message sent. This is the only way to prevent this behavior - not more censorship, not technical solutions
> "This is what will happen if you even think about creating and circulating nude pics of anyone" should be the message sent. This is the only way to prevent this behavior - not more censorship
Saying "don't make a fake picture of anybody naked or you'll go to jail and your life will be ruined forever" sure seems like a form of censorship
I don’t think you understand the psychology of a teenage boys. If you do all this, all you accomplish is informing the entire nation of kids that making deepfake nudes of their classmates is possible. From there, it will proliferate much more rapidly than its current trajectory.
There’s really no way to close this Pandora’s box. So, I’d fight fire with fire instead of crying about it if I was a teen girl in this situation. Make deepfakes of the boys have micropenises and other potentially embarrassing things. And then just learn to laugh about it. If everyone is a target and victim the kids will find it boring fast enough and this will fizzle out. It’s not like these kids aren’t exposed to porn and all that early on. They all are, have been for years now, the victim here feel awful because they’re the only ones being targeted.
I know this sounds bat shit crazy but normalization of it is really all we can do now.
> Throughout the night, whenever one of the speakers brought up holding Big Tech accountable, and specifically Apple and Google’s app stores, the crowd applauded.
The framing bothers me. It's shifting responsibility away from kids and the community. Deepfakes didn't do anything: kids made and used deepfakes in destructive ways.
Big tech sucks, you get no argument from me there. But, how do people so quickly get over the fact that a kid is sexually harrassing someone?
This is like when a mass shooting happens and everyone only talks about guns. Well, yeah, if you didn't have guns a mass shooting couldn't happen, but isn't the underlying issue that someone decided that hurting a bunch of people is the best thing to do?
The more people dislike a crime, the less likely they are to talk about the perpetrator's inner life, but, come on, these are kids. How do people get so side-tracked?
Even though they fluffed the messaging I think the school was right, in the absence of any actual
deepfakes and even after the police department had scraped all the boys phones, to be wary of accusing anyone in particular of doing anything AI related. Kids are weird and one boy saying he “dropped $250” on making deepfakes of “that hoe” sounds as much like a brag about money than it could be about making fake videos. There’s clearly enough of a text message trail between these boys to give them a significant reprimand for misogyny.
The PD’s PR team changing their narrative seems to lack competence. The school board focusing on being light touch on a specific case instead of cracking down in general seems like another error of judgment. This whole article says more about the effectiveness and competency of cops and school boards as it does about generative imagery.
> There’s clearly enough of a text message trail between these boys to give them a significant reprimand for misogyny
I skimmed but the worst I saw was one of them referencing her as “that hoe”. Not nice but also punishing kid’s private conversations outside of school this closely seems like an overreach. Worse, is the message it teaches the younger generation that speech should be censored and isn’t as free as they think. I feel that’s a worse outcome on a longer timeline.
I think sharing these images is sexual harassment and it's pretty clearly wrong and deserves punishment. Other than that, I don't think it should ever be possible to commit a crime by providing inputs to an air-gapped "clean" computer and then view the output. But it seems like that's not the case.
The issue here isnt even the deepfakes. If the kid made them and never showed them to anyone else no one would care. The issue is that he let the whole school know about it, knowing that would create an environment they dont feel safe in.
The article intentionally obfuscates the difference between images depicting sexual abuse that did not happen, and actual sexual abuse. Ironically this makes it harder to address the problem on the level where the actual abuse happens i.e. bullying, lack of empathy, teenage body image issues in the properly fucked up american high school environment.
For example here the word "abuse" technically refers to the making and spreading of these images and attendant bullying, but obviously has connotations of actual sexual abuse:
>Despite all this, Radnor’s administration failed students in the days and weeks after it learned about the abuse,
This is maybe subtle but later the article gets more explicit about it:
>this technology [...] bears little difference from the non-consensual intimate imagery that’s plagued young girls and teenagers since the invention of the camera.
(i.e. a straightforward equation of images of nudity that did not happen, and images produced by actually pointing a camera at someone who is physically present with their nude body)
>Because the images aren’t “real,” authorities grapple with how to handle them.
Putting "real" in scare-quotes, very nice.
Dorfman is also quoted doing some nice sleight of hand, going in one sentence from "It was about the creation of the videos" to "and then share them with others as if the girls were something to be passed around." - i.e. equating the making of videos depicting unreal events with something that almost sounds like gang rape.
Anyway enough examples, article is full of them. I'm not saying there's no problem here, just that these people seem to have some kind of ideology of the sanctity of the image, i.e. a realistic image always depicts real events, and should always be interpreted as if it does. If it does not, clearly that's a problem to be corrected by reinforcing the connection between images and reality by making it impossible to produce realistic images of non-real things. It strikes me as exactly the wrong way to go about it, that can only make the bullying and harrassment (the actual problem which should be solved on the social level) worse by making its ammunition stronger.
(Slight aside but I do think the closing quote by Woelfel makes a good point)
21 comments
[ 4.6 ms ] story [ 48.1 ms ] threadWhat's the defense? Intelligent screening of incoming messages so that the threat never reaches the blackmail target? I imagine they'll find an unprotected channel.
Don't post innocuous images of children ever? Seems like losing.
One of the mothers says this quite explicitly:
> Calling the event rumors and speculation when a crime occurred was almost worse than the crime
I hope we don't start getting xkcd fakes.
Saying "don't make a fake picture of anybody naked or you'll go to jail and your life will be ruined forever" sure seems like a form of censorship
There’s really no way to close this Pandora’s box. So, I’d fight fire with fire instead of crying about it if I was a teen girl in this situation. Make deepfakes of the boys have micropenises and other potentially embarrassing things. And then just learn to laugh about it. If everyone is a target and victim the kids will find it boring fast enough and this will fizzle out. It’s not like these kids aren’t exposed to porn and all that early on. They all are, have been for years now, the victim here feel awful because they’re the only ones being targeted.
I know this sounds bat shit crazy but normalization of it is really all we can do now.
The framing bothers me. It's shifting responsibility away from kids and the community. Deepfakes didn't do anything: kids made and used deepfakes in destructive ways.
Big tech sucks, you get no argument from me there. But, how do people so quickly get over the fact that a kid is sexually harrassing someone?
This is like when a mass shooting happens and everyone only talks about guns. Well, yeah, if you didn't have guns a mass shooting couldn't happen, but isn't the underlying issue that someone decided that hurting a bunch of people is the best thing to do?
The more people dislike a crime, the less likely they are to talk about the perpetrator's inner life, but, come on, these are kids. How do people get so side-tracked?
The PD’s PR team changing their narrative seems to lack competence. The school board focusing on being light touch on a specific case instead of cracking down in general seems like another error of judgment. This whole article says more about the effectiveness and competency of cops and school boards as it does about generative imagery.
I skimmed but the worst I saw was one of them referencing her as “that hoe”. Not nice but also punishing kid’s private conversations outside of school this closely seems like an overreach. Worse, is the message it teaches the younger generation that speech should be censored and isn’t as free as they think. I feel that’s a worse outcome on a longer timeline.
For example here the word "abuse" technically refers to the making and spreading of these images and attendant bullying, but obviously has connotations of actual sexual abuse:
>Despite all this, Radnor’s administration failed students in the days and weeks after it learned about the abuse,
This is maybe subtle but later the article gets more explicit about it:
>this technology [...] bears little difference from the non-consensual intimate imagery that’s plagued young girls and teenagers since the invention of the camera.
(i.e. a straightforward equation of images of nudity that did not happen, and images produced by actually pointing a camera at someone who is physically present with their nude body)
>Because the images aren’t “real,” authorities grapple with how to handle them.
Putting "real" in scare-quotes, very nice.
Dorfman is also quoted doing some nice sleight of hand, going in one sentence from "It was about the creation of the videos" to "and then share them with others as if the girls were something to be passed around." - i.e. equating the making of videos depicting unreal events with something that almost sounds like gang rape.
Anyway enough examples, article is full of them. I'm not saying there's no problem here, just that these people seem to have some kind of ideology of the sanctity of the image, i.e. a realistic image always depicts real events, and should always be interpreted as if it does. If it does not, clearly that's a problem to be corrected by reinforcing the connection between images and reality by making it impossible to produce realistic images of non-real things. It strikes me as exactly the wrong way to go about it, that can only make the bullying and harrassment (the actual problem which should be solved on the social level) worse by making its ammunition stronger.
(Slight aside but I do think the closing quote by Woelfel makes a good point)