OK, and what's the problem with that specifically? I presume they will use more sophisticated methods for age assurance than "I'm 18".
Besides, people are using LLMs for exactly that for ages (including Claude and ChatGPT), so the only difference is that the non-NSFW behaviour will be better (less crippled).
In general I think it's perfectly fine to have uncensored NSFW chats. The fact that all of the mainstream LLMs are way more restrictive than basic web searches we've had for decades is kind of ridiculous.
In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.
I don't have issue with NSFW content per se, but this? This isn't a problem of whether NSFW content should exist. It's a much bigger issue than that.
First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being.
Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?
"Now that we have been able to mitigate the serious mental health issues and have new tools"
Huh? Quite the statement when there are still people out there having parasocial relationships with chatbots. This problem is going to get exponentially worse when the chatbots can start to get sexual.
"We made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realize this made it less useful/enjoyable to many users who had no mental health problems..."
I dread to think where society is going to be in 10-15 years. We've had a generation or two raised thinking porn == sex and the next generation will all be in romantic relationships with ChatGPT. Businesses have just given up on having any social responsibility whatsoever.
It's crazy that Visa, Mastercard & other payment processors were debanking actual creators and artists for adult content recently and now OpenAI is doing this.
It's true that a lot is already changing, and the fact that AI is developing is interesting. I recently tried a website for exposing people through AI, here it is- https://ai-deep-nude.com/, and what was surprising was that it worked. I don't know what will happen next.
28 comments
[ 2.9 ms ] story [ 60.4 ms ] threadOpenAI: We are... doing something else...
Besides, people are using LLMs for exactly that for ages (including Claude and ChatGPT), so the only difference is that the non-NSFW behaviour will be better (less crippled).
Win/win. No? Why?
In this particular case though I can't imagine it's a good idea to hand Sam Altman and his company chat logs of your explicit fantasies tied to your real identity.
First, mental health issues surrounding this are far from being solved. Having a sycophantic robot faking intimacy looks manipulative, ripe for exploitation, and damaging to long term psychological well-being.
Second, this is a service that manufactures compromising chat logs and stores them for profit. Yeah, what could possibly go wrong?
Google will happily return NSFW results, without age verification.
Google will approve ad campaigns for adult websites.
Amazon will happily sell you NSFW books and tools. etc.
But OpenAI should reject prompts that result in adult content?
Well, here we go.
Huh? Quite the statement when there are still people out there having parasocial relationships with chatbots. This problem is going to get exponentially worse when the chatbots can start to get sexual.
I dread to think where society is going to be in 10-15 years. We've had a generation or two raised thinking porn == sex and the next generation will all be in romantic relationships with ChatGPT. Businesses have just given up on having any social responsibility whatsoever.
Presumably this will just be part of that offering.