Ask HN: Is AI for online segregation ethical?
A friend informed me that AI is being used to separate certain individuals in online spaces. He expresses this use of the technology is quite new and is an evolution of shadowbanning certain persons that otherwise add toxicity to discussions. The persons shadowbanned in this instance are tricked into assuming they're not banned by fake interactions generated by the AI towards real content while nonshadowbanned users interact with each other to the content. My friend said the technology is just the beginning and it eventually will be used for certain demographics throughout online spaces for certain governments. I'm curious how ethical is this?
27 comments
[ 0.24 ms ] story [ 61.6 ms ] threadBut hey, maybe he's right. I don't know (or really care) what our next steps are as a society if it's true, but assuming he's telling the truth seems a bit like jumping-the-gun.
The ethics of all this have already blown over. Twitter and Facebook have both been proven to shadowban controversial figures, and no ethical panic ensued. People don't care, they want a Tik-Tok style feed of sugar water and sweet dreams fed to them on an IV drip. If the next step is fabricating fake content (again, considering how many real content creators exist this seems unlikely), then there is no ethical discussion. It's as fake as the AI-corrected profile-picture you shot on iPhone. It's as real as your approximate location being tracked by Walmart WiFi and then processed into shopping habit data to sell to competitors. If you use Facebook or Twitter (or arguably any social media) then you're already being manipulated. They don't need to promote fake content to make you think what they want.
2) We know that shadowbanning exists and is used to contain spammers and other users that a platform doesn't want on their site.
Given that the previous two facts are true, it seems like a perfectly logical outcome that somebody would decide to experiment with some kind of AI powered chatbots to keep shadowbanned users better contained.
Who knows though, I'm willing to entertain anything here in the grand ol' USA. Still, logic suggests that there's a simpler answer here.
I'm sure this would be reasonably effective on the specific goal of occupying these users' time for days/weeks/months/or even years until they realized that they were talking with robots, but it seems like it might have significant negative social consequences for some groups.
For instance, imagine somebody dealing with depression who genuinely needs a human to talk to. Like many in modern society, maybe social media is the only human interaction they have until they get shadowbanned based on tenuous reasons. God, what happens then when depressed and/or unstable people only have robots to talk to for years? What happens when they realize that they've been tricked and feel intense anger/sadness/hopelessness?
This is playing with peoples' lives with fire and shouldn't be an acceptable practice.
Pavlov has nothing on the business of training people through computing.
I'm not aware of this and any argument for censorship is usually quite a long stretch of hypertheticals.
For violating TOS people should know what rule they have violated. For example doxing, spamming or just being insufferably rude. Punishment without explanation or reason is obviously unethical.
I think shadow banning people and then actively keeping them in loop can hardly argued to be ethical. Shadow banning itself is barely ethical.
If AI could help people to bring their point or grievance across in a clear manner, this would be the opposite of a shadow ban. This can be done transparent, in Form of a suggestion.
E.g to write penis as p.e.n.i.s. to make clear that proton enhanced neutron induction spectroscopy is abbreviated here, might be helpful to some.
AI can create a feedback loop ethically, if it makes itself know as an AI or automated system or Eliza 2.0. The user can choose to just opt out or mash on his keyboard as he pleases, as we do since 1964.
That is all ethical, but deceiving users and trapping them definitely isn't.
This doesn't make sense to me, because it seems like a huge amount of investment to...what? Get them to see more ads instead of getting sick of people not reacting to their trolling and leaving entirely? If the return on investment is high enough for this to be practical, it suggests the community has a toxicity problem that itself needs to be addressed. What makes so many people so angry and toxic?
No misguided popular movement (or even factual information, lacking critical context of course) will be able to gain momentum, as its promoters will be unknowingly yelling into the void. On the other hand, movements and ideas that promote wellbeing and harmony will spread easily. It does not take advanced AI to categorize vocal people by politics, and quarantine those with hateful ideas.
This is our chance to safely defuse humanity's hateful instincts, and we should take it.
Best of all, it is completely ethical because, as a since-deleted post pointed out, it is vaguely hinted at in the Terms of Service. Voluntary agreements are the highest form of ethics. They are beyond moral question, and in fact the whole purpose of society is to enable and enforce them.
Those who don't like it are free to stop participating in online society. With such an easy and safe way out, there is absolutely nothing to worry about.
That's not how humans work.
This is a complete unhinged fantasy.
As described, it's not even about segregating different audiences, but about sequestering and silencing specific people, yet keeping them engaged at the same time, perhaps to be able to continue to show them ads and keep up the platform's KPIs.
In a way, that'd be quite similar to dating platforms creating fake profiles to keep their members engaged, which I doubt anyone would consider ethical behaviour.
If an online service doesn't want certain types of opinions, ideas, or people on their platform, that's absolutely fine. Just tell them, so they can take their business elsewhere.