Ask HN: How do we stop the polarization/toxicicity filling the web?

422 points by dabockster ↗ HN
Hey HN, I've noticed a huge uptick in the toxicity online in the last 5-7 years. Before, around 2010-2012, people who disagreed would usually leave it at that and walk away respectfully. Now, it seems like everyone treats everything as an argument or debate to be won at all costs. Even niche sites like HN are not immune.

So how do we fix this? I've heard some talk that upvote systems and algorithms might be at fault. Do we ditch them and go back to a literal timeline? Or is this more of a social problem that code can't solve? Let's hear some input on this, because I can't shake the feeling that tech isn't totally innocent in this mayhem.

858 comments

[ 2.9 ms ] story [ 446 ms ] thread
Still on the tech side of things HN is doing quite well, with clever mechanics to downrank incendiary stuff, killing troll comments asap, etc. Combined with excellent, consistent moderation (courtesy dang et al).

With growing awareness + press coverage, those platforms who deliberately implemented bad algorithms to harvest maximum attention (FB, YT, TW) increasingly find it damages their brand image. There is an incentive to (at least marginally) improve their features / biz models.

Then there is digital literacy. We used to have netiquete and that can be taught. If you read the (very entertaining) article The Internet of Beefs [0] you'll see there is a solution by not getting involved in a beef, or extracting yourself if you got baited. Similarly it helps to know how to avoid trolls [1].

It will not be easy to change cultures large-scale. Many people just like to beef (there is a similarity with road rage too; people forget themselves online). Others enjoy starting beef wars for the lolz, or - more sinister - with strategic objectives.

At least we should be able to create more safe harbours, where people thrive from uplifting experiences online. Changing culture bit by bit.

[0] https://www.ribbonfarm.com/2020/01/16/the-internet-of-beefs/

[1] https://github.com/prettydiff/wisdom/blob/master/Avoiding_Tr...

I think one of the things with HN compared to FB et al is that HN isn't a for-profit company. It's essentially a public service of YC. They don't make a dime off of this, as far as I can see. Because of that, they don't have to do evil engagement-boosting tricks to try to make more dimes.
>They don't make a dime off of this, as far as I can see.

Maybe not directly, but every YC company advertises themselves and their projects here, and HN is known as the hub for the SV tech and startup scene, which gives YC an automatic amount of "street cred" and visibility in all of the discussions had here. I'm sure Hacker News has made YCombinator more than a few dimes indirectly from all of that.

Well, perhaps. But if you're right, then HN makes them more dimes by not turning into a sewer.

The point is, HN has different incentives from FB. That matters in the culture of the resulting community.

In general internet communities face a trade off between monetization and quality. The more you monetize a community the crappier it becomes. In the long term, the key to running a healthy online community is to find a good balance, which essentially means figuring out how to not make too much money.
All the more reason to keep HN from becoming a cesspit, as the negative costs would be internalised by negative reputation.
By not perpetuating it.

Thats all we can do. But the most important step.

If enough people don't perpetuate it, that turns down the gain in the echo chambers. That cuts down on the feedback, and the noise becomes a lower fraction of the total.
> Before, around 2010-2012

Eh, people were being jerks to each other on usenets and bbs's way before this.

Godwin's law is 30 years old at this point.

There are many pervasive, interconnected issues and trends to it, so there's no simple or complete answer:

0. Behavior online doesn't arrive out of a vacuum. If people are miserable because they're working harder, making less and their society is in retreat, they're probably going to take out their frustrations out on the easiest targets.

1. Unplug from social and mainstream media because it doesn't have much value.

2. Stop demonizing, hating on groups of people and falling for the unthinking of mob tribalism, even rhetorically. Hate bad ideas, not people.

3. Realize that we're divided-and-conquered if we're going to let a few rich people and their corporate media keep us set against to each other. Solidarity is the only way.

4. Anonymity is good in small doses, but it's too easy for people to act unreasonably hiding behind it (cyberdisinhibitionism). DHH's company wrote a blog article about improving the quality of discussions with profile pictures and real names.

5. Stop and use every instance of it as a teachable moment, where feasible. It only works though if people have shame and can be brought around to the Golden Rule/empathy... it seems to me most parents these days aren't as involved in active parenting, so their kids run ferrel and so more people grow up to act more brutally and sociopathic. Furthermore, the current prevalence of parasitic vulture capitalism valuing myopic greed and selfishness above all else reinforces a disinterest in the concerns and well-being of others... which is antithetical to community and civilization.

6. There's nothing yet so far to replace the community function filled by religion, and so many people aren't interested in behaving themselves or doing right by their neighbors or strangers if they can get away with it.

7. More people have lost most of their hope about the future. For example, no healthy society has mass shootings/suicides nearly every day that no longer make the news.

Re 3: I wonder if part of it is that many people don't have an identity. So they make a tribe their identity.
I really appreciate the thoughts above, but I have to question point 4:

> improving the quality of discussions with profile pictures and real names

As a counter-point, imagine a discussion forum in an authoritarian country where your picture and real name is placed next to everything you say online. The discussions may end up being very polite, and full of agreement, but that doesn't necessarily mean that the community is well served by that forum.

To some, that concern may seem irrelevant, since most governments wouldn't attempt to control people that way, but I don't think we have to look very far to find examples where people expressing unpopular opinions face social and professional punishments. Perhaps you would agree that anonymity can be helpful in such situations, (checks notes) "anonsivalley652".

I've been active online since 2000.

There was a theory in 2004, known as GIFT: Normal Person + Anonymity + Audience = Total Fuckwad

Guess what? People without anonymity are total fuckwads too - this happens on Facebook, Instagram and Twitch, in an era where you could probably find someone's personal details if you look hard enough.

I think the key is audience. Bullying feels good for a lot of people. Bullies will go for low hanging fruit where they won't be struck back.

You see people acting this way even in once helpful sites like Stack Overflow; downvotes will pull bullies in like a magnet. You see people picking on anti-vax, flat earthers, Justin Bieber, not so much because they do harm, but because they're easy targets to hold down.

Viral algorithms amplify this effect. It highlights bad news that everyone can join in and rage on. It's not a new thing; news channels have done this for decades.

We can't really fix it. I'm more a community nomad these days. It's easy to move on to other new and old communities, away from this effect. I've been happy with HN, Discord, and IRC lately.. IRC has picked up back to 500 people per channel, and it's probably no coincidence.

> You see people picking on anti-vax, flat earthers, Justin Bieber, not so much because they do harm, but because they're easy targets to hold down.

Your other examples were solid, but anti-vax absolutely does cause harm, and it seems inappropriate to dismiss the possibility that in the case of anti-vax people are motivated by genuine fear for our collective safety and that of our children.

The claim wasn't that they're harmless, but that they're easy targets.
The claim was that people were motivated to argue by the ease of the target rather than by the genuine threat of harm. In the case of anti-vax, I don't agree. I think people see a threat to their kids and react accordingly.
It goes beyond hash criticism into gleeful joy making jokes about kids dying.
Anti-vaxxers are only a threat to kids who have another health condition that prevents them from being vaxinated. So, in most cases, it's a threat to somebody else's kids (who isn't even present in the conversation) not a threat to the anti-anti-vaxxer's kids.
This is not true. Vaccinations are not 100% effective. They're usually in the range of 90% to 99% effective. Protection also wanes over time. Because of this, herd immunity protects everyone, not just those who are unable to be vaccinated for health reasons.
Even if you don't feel strongly on the topic of vaccination, going out of your way to bash anti-vaxxers is great at signalling how you are scientifically woke. The GP is positing that people who bash anti-vaxxers do so overwhelmingly out of this motivation rather than true pro-vaccine activism.
I understand the GP's take. I think it's both incorrect and uncharitable. People care about their kids more than imaginary internet points.
I disagree. The loudest activists too often tend to be younger people who either don't have kids, or are /r/childfree types who actively disdain the concept.

Of course, by "activists", there's a difference between the genuine voices, versus the Reddit or HN meme-slingers. The latter group seems louder due to style. While they happen to be on the right side (from my POV), they're still quite awful as people.

> to dismiss the possibility that in the case of anti-vax people are motivated by genuine fear for our collective safety and that of our children.

People who are genuine in that NEVER bash. For the simple reason that bashing doesn't work. What they do do is respectfully argue with any false data.

But you'll never see someone like that insult people or call them stupid, ignorant, or doubt the love of an anti-vaxxer for their own children.

I'm not anti-vax, but this is a discussion on toxicity on the internet, and I see plenty of people who take great pleasure in just unloading on anti-vaxxers because they know it's a target nobody will scold them for being cruel to. It's pretty obvious these types don't really care about changing the minds of the anti-vaxxers either, people usually don't have an epiphany about their life just because somebody was mean to them online. If anything, it's an opportunity for anti-vaxxers to band together against people who are cruel to them and probably even more deeply ingrain their beliefs.

This doesn't mean anti-vaxxers should be tolerated as a viable alternative lifestyle, but throwing curses at them online and spamming memes that make them out to be mentally challenged really doesn't do anything but satisfy a bully.

I also think the lack of consequences makes it very easy for people to post all kinds of shit.

On HN this is greatly reduced by the point system and the opacity of bad posts. A bad post fades away so it doesn't look as important as other posts.

In real life you can get a punch in the face if you say nasty things to someone.

But on Twitter, Facebook and YouTube most trolls wont ever learn because they just can say whatever they want.

Worth considering that this isn't simply mechanical: to make those posts fade away requires humans clicking the downvote button. Which requires some kind of culture that includes clicking the button on "bad" posts, for whatever the definition of "bad" is. If there were downvoting on say, YouTube, I'm not sure that it would produce the same results that it does on HN.
Hacker News is indeed a special place on the internet and it would probably be difficult to reproduce its style of discussion. That being said I think it is worth considering why HN has succeeded and to what extent is this a function of the presentation algorithm (upvotes/downvotes)?

It is worth remembering that the visible part of an internet community is a small part of the total possible community. Following the classic 90-9-1 rule there are a lot more people who could participate than people who do participate. This means that the visible face of an online community has a lot of room to change.

> On HN this is greatly reduced by the point system and the opacity of bad posts. A bad post fades away so it doesn't look as important as other posts.

The problem is, this functionality is popularity based. Yes, posts that get downvoted are usually bad posts. However, some are simply disliked by the majority of people who wanted to vote on them and are not actually "bad" by the standards of this discussion. Similarly, I have seen toxic posts (that I have downvoted and flagged) upvoted (at least once) when the target of the toxicity was "acceptable".

I think consequences are an illusory deterrent personally. People thought real name policies would help. Even with people losing jobs over posting the needle didn't move.

In truth consequences can be an incentive for bad actors. To them saying offensive things and getting a burner account banned is boring compared to tricking people into getting banned.

> On HN this is greatly reduced by the point system and the opacity of bad posts. A bad post fades away so it doesn't look as important as other posts.

I really dislike that. But, I have put in CSS so that bad posts don't fade away, and enabled show dead so that all messages can be seen. But at least we have the choice!

I thought this was the case too.

One of the things that surprised me was how people who are horrible online are even worse offline.

I think there are plenty of online consequences. Post a controversial post and someone will verbally slap, share, shame you. Shaming might be far worse than a physical punch to some people.

I think a lot of people who become trolls don't become trolls for the sake of of trolling. They do it because they're trying to enforce consequences upon someone.

> People without anonymity are total fuckwads too

Hell, go read any "opinion" article from any newspaper since the dawn of the printing press. They were well-written fuckwads, but they were pretty much all fuckwads.

In the old days you only ever saw that embarrassing uncle with the extreme views on Thanksgiving. Now he's on your Facebook/Twitter feed every day.
I don't think we should try to stop it. I like discussion groups where the only thing moderated is spam. Yes, you'll get a lot of noise - but they can also be the only source of discussion that lies outside the overton window.

I've found it easy to ignore content I don't like, but it is getting harder to find open discussion forums.

>outside the overton window

I feel like what you describe here ... is the noise.

Not everything outside the overton window is noise. It sure isn't all signal, though. It almost certainly has a higher proportion of noise. But it's also where the new directions for society are going to come from, for good or ill.
There's a "outside the overton window" description (and similar descriptions) I hear folks talk about when it comes to the value of internet un-moderated discussions and .... honestly I've found it mostly to be poorly thought out at best, often painfully ignorant as far as the motivations go.

There seems to be some folks who talk about really valuing novel ideas and how they can't show up on moderated discussions but I just see a lot of noise that might not be "overton window" but are mostly pithy garbage.

I find that anything mildly thought out usually fits inside even the heaviest of moderated type discussions.

> I find that anything mildly thought out usually fits inside even the heaviest of moderated type discussions.

Depends on the moderation. Here, if it's well thought out (and expressed in a non-antagonistic way), it usually fits. Not every moderated place will that be true, though. And even here, certain topics may not run afoul of the moderators, but users may still downvote them to oblivion. (For example: There is some suggestion that autism may be caused, in at least some cases, by gut bacteria. But if I were to link that idea to the suggestion that the measles vaccine might, in some cases, cause gut issues, I would expect to be destroyed by downvotes, no matter how good of an argument - or even evidence - I had.)

Disclaimer: I acknowledge that "toxic" is a loosely-defined term that can be thrown around at people that really aren't... I'm mostly meaning people that go out of their way to be negative/harmful in unnecessary ways, harmful forms of trolling, the inability for people to have a discussion without it dissolving into attacks/etc extremely fast... that kind of thing

I think we're looking back at history with rose-tinted glasses here. Toxicity has always been around. Maybe in recent years it has grown, but I think that's just the nature of the technological beast.

It doesn't mean that on a broad scale technology always actively contributes to making things more toxic- but just that it amplifies and contributes to all sorts of things, and that includes the negative. We're more connected than we've ever been, and the unfortunate side-effect is that the degrees of separation between us and those that are toxic have been significantly reduced. Anonymity is maybe a small part, but there are plenty of openly toxic people, both online and off.

Toxic people are just toxic people and I think it's a social issue that is just always going to exist at some level. Maybe there are ways to use technology to assist in fighting against it and maybe not. I think it's just a potentially-unsolvable complex problem that will always arise in society.

I don't know the most effective ways to fight it. However, I'm trying my best not to contribute to it, and maybe personally fighting it within myself will have an outward effect on others. While I wouldn't say I'm mean/toxic/etc online, I do try to stay self-aware of my actions/reactions/emotions and what I post online (and have failed to do this sometimes) because it's very easy to get caught up in negative news/misery and then it's easy to branch off from there into an unhelpful level of anger/negativity.

I try to do my best not to assume the worst of others, to realize there are beings with entire lives unknown to me behind every screen name (if it's not a bot) and to realize it's sometimes difficult to properly infer the tone of what someone is saying online. It's still an internal work-in-progress, but I think I'm far more mindful of my behavior now than in years past.

I don't think OP is claiming toxicity is new, but the extreme polarization of everything is.

Look into the lives of politicians in the 1950's and 1960's. They frequently socialized together and worked together. They were able to find common ground. Every victory for one party wasn't necessarily a loss for the other. How often do you think Mitch McConnell goes out for a drink with Bernie Sanders?

Tribalism, especially in relation to things like sports, is super-old. But it's spread to all parts of our lives. Often it's semi-friendly (are you a vi or emacs person?), but it can get out of control.

So how do you fix it? That's tough, especially when every news story seems to have two equal but opposite sides.

"Look into the lives of politicians in the 1950's and 1960's. They frequently socialized together and worked together. They were able to find common ground. Every victory for one party wasn't necessarily a loss for the other. How often do you think Mitch McConnell goes out for a drink with Bernie Sanders?"

That's the problem with transparency and constant scrutiny. In the 50s and 60s you could hide affairs like Kennedy did. Or you could have a drink with people from the other party, discuss things openly and find a deal without anybody knowing. If McConnell met with Sanders today there would be a huge uproar. There is something to be said for the ability to make backroom deals.

It isn't necessarily about making backroom deals. The tribe mentality is so deep that I'm not sure that Sanders and McConnell would recognize that the other person is trying to do what they think is best for the country. I'm not sure they could sit down and talk about their families or their favorite place to travel.
I just think the tribe mentality got informed by the constant news cycle now. A lot of sane people have probably left congress and now you have a lot of hyperpartisans who like fighting for its own sake.
That's a highly complex problem, IMHO; since it involves lots of variables and variability. And, quite honestly, I doubt there's ever going to be a proper way to solve it.

But here are some of my observations:

- Everyone's online. Everyone. That includes people a) who had a less than stellar upbringing (whatever that means to which one of us); b) with mental illness (some of them untreated and/or self-diagnosed); c) from other cultural background (which don't necessarily align with western point-of-views); d) who are underaged; e) who are (very) bored (and some find entertainment in provoking chaos); f) who lack proper education; g) who simply do not care about educating themselves and others; and h) who are naturally antagonistic for whatever reason.

- Bots. There are also a good number of botnets out there (the "like" economy comes to mind) or subverted systems (smartphones, routers, PCs, etc) which act without the owner's knowledge;

I'm convinced there's also botnets out there that purposefully amplify certain controversies online (websites' comment sections come to mind). Now, understand, this doesn't apply to every controversy. But I've seen some weird stuff on YouTube, for example. And, quite frankly, it's not that hard to extrapolate that since there are "like" bots there are equally "hate" bots as well. The end game is, in most cases, visibility. In others, it's probably social engineering for whatever reason. Mostly political.

Unfortunately, media outlets have fallen into this scheme as well. I mean, it's not like the concept of clickbait is new. Attractive headlines are as old as newspapers/journalism.

- Highly progressive opinions will always clash with the status quo;

- There's a fundamental and unavoidable loss (or lack) of signal whenever people communicate in short sentences, or when they do not have enough time to fully understand what's being said, or when they communicate with people who they don't know;

If I have a friend who's a prankster/jester I might be used to their shenanigans and tolerate them--a stranger might not find them funny. Maybe the stranger will find it funny after they know my friend, but that would depend on a lot of other variables as well.

- There's also the problem of the person who transmits information not expressing themselves properly (for whatever reason) which will unavoidably lead to miscommunication;

- Social networks are fundamentally designed for engagement--now that everyone is online there will be a clash of ideas. Tribes will organically form (just like offline). And - with few exceptions - what was meant as a benign message ends up in a declaration of war from the other tribe.

So, in sum, I just scratched the surface of the problem. It's very hard to make sense of all the noise and coming up with a proper solution to this problem.

Is it an education problem? Is democracy the root cause? Would a totalitarian (regardless it being Right-Wing or Left-Wing) system work? Is it something fundamentally ingrained into our human condition that makes it impossible to solve this problem? (Look at bees, for instance, they're ruthless and yet highly efficient at what they do.) Is it a fundamental purpose (or lack thereof) that each and everyone of us has defined - through whatever heuristic and for whatever reason - that's to blame for all this chaos? Is it its visibility?

Yeah. It's a hard problem to solve. Maybe lots of compromise would help.

I honestly don't know.

The quote

  "All models are wrong, but some are useful." --George Box
comes to mind.
This is not an algorithm problem. It's a people problem. Start with yourself: http://www.paulgraham.com/identity.html

An algorithmic solution would be to rigorously hide everything that looks like mere unproductive outrage from public discourse. However, not only would that amount the severe censorship but it'd probably also not be exactly easy to implement.

Besides, platforms such as Twitter or good old-fashioned news thrive on outrage. If you take that from them there's probably not much left, which is why it's not in these platforms' interest to do something against the issue.

So, it's back to square one: Yourself. Keep your identity small and try not to perpetuate outrage on the Internet.

Truth be told, the most practical solution is to stop centralising everything and using these giant social networking sites that force people with nothing in common together. The bigger your audience gets and the less focused on any one topic it is, the harder it is to moderate/keep under the control, and the more drama you'll inevitably have when groups clash there.

Smaller internet forums, subreddits, Discord/Slack groups, etc tend to be a lot more civil than the likes of Twitter or YouTube are.

So a revival of those types of sites and communities will help a lot.

As will returning to the days of multi pseudonyms for different websites. Because people are not one sided. They don't always act the same way in every setting.

No, their behaviour depends on the company they're with. They might act one way with family, another way with friends, another way at work, etc.

That's how society stays together to some degree. People don't know how others act in other settings, and they don't care. Your coworkers likely have a whole mix of political opinions, but since it likely doesn't come up during work, it doesn't really matter.

Social networks seem to be trying to demolish this sense of separation between sides of people's personalities, and that's making society more and more fragile, as one wrong move means someone's entire life gets destroyed by the internet mob.

Oh, and decent moderation too. Unfortunately for Facebook and co, you can't automate moderation and expect it to work well, and you can't outsource it to a bunch of full time employees in a distant office somewhere. It has to be done by people with a real investment in the community, which is again where a well run small community shines.

>As will returning to the days of multi pseudonyms for different websites. Because people are not one sided. They don't always act the same way in every setting.

I never stopped doing this. The problem is, a lot of younger people were never taught to or never learned they should do this and a lot of older people same thing sort of.

I was kind of lucky I suppose, years ago I had a friend say something on a work Facebook page that caused some trouble, I realized Facebook wasn't a place I could have people like that, so since I've kept Facebook or any other social media website with personal information and concersations on it strictly professional or Christmas dinner at grandma's house level. Which pretty much means, no politics, no getting involved in other people's arguments, no posting things I wouldn't want an employer or my grandma seeing, no friends that post ridiculous things on my feed etc.

Then i've got my forum and other online site accounts that lack, for the most part, studd that could easily identify me, though I'm sure someone with lots of time and dedication(dunno why though), could figure it out, that use a different email than my 'real' email, where I can talk about things without worrying that I might randomly piss off someone I know.

If I want to have potentially divisive conversations with people I know in person, I'd rather do it in person or at least not on what might as well be the community billboard.

> stop centralising everything

Even federated approaches like mastodon also have big issues with toxicity.

Just making a smaller Twitter won't change the nature of the Problem. It's less about the size of the community than the amount of topics, I believe. If you have a community that is about trains, and trains only, you may get a heated discussion about some train stuff, but you won't get a brawl about the political issue de jour.
Unfortunately, I don't think it's as simple as "just go back to smaller groups". For companies, more users = more revenue, there isn't realy much incentive to not try and pull in as many people as possible. And then for most normal users, if they here about some big site, they're inclined to join that so they don't miss out on the the funny tik tok memes/all of their friends being on instagram/etc. For them, what benefit is there to a smaller site where you can't get as many followers or where your friends/favorite celebrity isn't a member.

I agree with you that size is one of the main contributing factors to the problem, I just don't think smaller sites is a practical solution for the public at large. That being said, if you don't care about "fixing" the public problem, then you're right on the money. If you personally don't want to experience toxicity, get off the big sites, it's that easy. I just don't see that being a fix for the average teenager/college student/boomer

...it doesn't need to be a huge company (or company of any kind) to run these things. Back in the early 2000s, a volunteer who knew about computers would set up phpBB on a church's website, or a radio station would allow one IT person to spend half their time maintaining something like this, and that would be it. No need to turn millions in advertising dollars to have an online community.

I do agree with the parent comment, that we may well see a resurgence of small and medium-sized online communities, for the simple reason that more fragmentation could be a good thing. When a community has its eternal september, people can move elsewhere.

I meant more that even a new, small company would have no incentive to not want to become the next big thing/the next facebook. Good point though that we don't need companies/start-ups to feed us online communities, particularly since the users are almost always the ones bringing value to platform like a message board/forum sites.
That won't happen because the benefits of network effects accrue to the people across the network as a whole as well as the proprietors/advertisers.
It helps to realize that much of it is intentional, especially on behalf of companies like Facebook. Once you realize this it has a sort of spell-breaking effect. Ask yourself if you would say the same sort of thing to someone if you were face to face. If the answer is no, think twice about posting it online.
I don't think you can fix it, it's just the nature of the Internet. I was talking to some older coworkers who were adults before the Internet became mainstream, and they said that before the Internet, your social circle was neighbors and co-workers, so being an ass would have direct, and sometimes physically painful, ramifications. They said that on the Internet, there's no real ramifications for being a horrible person, and you'll always find a group of people that agree with what you say, whereas before you'd get ostracized, or worse, for treating your neighbors/co-workers poorly. I think the best you can do is encourage people to interact outside of the Internet, and hope that the manners required to function IRL stick with them when they go online.
It's not just that, it's the fact that most interaction on the net is text based so you miss out on tone and body language. I feel like some discussions escalate too high on the net due to the text based format.
Definitely. I remember one time a manager from another group at work asked me a question about when a project would be done, and I responded along the lines of "I'm working on it, and I don't know when it'll be done." because it was the truth, and there was nothing else to say about it. They interpreted my single sentence reply as rude and dismissive, then complained to my manager about it. When my manager talked to me about it, he said something like "Oh, ok, your reply is fine, dont worry about it."
Stop responding to it.

No seriously, just stop. This isn't a "complex problem that needs nuanced technical and legislative solutions".

Back in the old day, there was this saying. "Do not feed the trolls". Sadly, we've forgotten that.

Our current approach is, "create rigorous 30 minute point by point take down videos to defeat their point of view". Our urge to debate and correct people who are wrong just fuels them making more content. A troll needs reactions to survive. Just downvote and move along.

I think its a fallacy at this point to assume the people pushing toxic or objectively wrong viewpoints are trolls. If it ever was 100% trolls, that time has passed and their target audience is expanding their work in earnest.

We now have people who 100% believe objectively wrong things and have an obsession to spread their belief as fact.

Edit: If there is a solution to this issue, it will depend on the ratio of these people who are willing to change their mind. A real solution might involve a procedure to move people from the more stubborn camp to a more open minded camp.

When someone on the street corner tells you the world is ending you ignore them. You dont need a complex technical or social solution.

When someone tells me that xyz plant oil cures cancer or the earth is flat... I ignore them. If I want to be a troll I may play along or challenge them if its fun.

That's the internet. There have always been nutters- they just found other nutters to talk with and you get a loud feedback loop. You can happily mute them still.

What happens when your child, sibling, friend, parent, or lover is saying those things that they got from the internet?
The problem is when people with such beliefs acquire position of power or influence, which sadly has already happened.
I don't think ignoring the nutters is viable. Enough people are believing anti-vax lies to start bringing back deadly disease which affect more than just themselves. Enough people are believing climate change propaganda which is slowly harming the habitability of our planet for our human race.

What was once contained on the internet is leaking out onto the streets and is already affecting you and I in many ways.

Propaganda has always been there.

During the Golden Age of broadcast TV and Radio (pre-internet), the big networks broadcasted plenty of unchallenged lies. The difference now is that laymen can fact check the content put out by the big players. But the price for this is that every troll or nutter has access to the some of the same tools to spread their own lunacy.

I far prefer the current situation over the previous. While it may have felt more comfortable when people believed that news readers were telling the truth or reporting truth, it never was that way.

Trolls (either human or bots) are way more dangerous that TV propaganda because the act as legitimate actors in the public discourse.

It gives them the ability to hide between other people and manipulate the conversation.

It's interesting that you mention climate change in this, I agree that it's ground zero for demonstrating the phenomenon of expressing things as objective truth, or fact, that are much more complex than a simple binary.
>When someone tells me that xyz plant oil cures cancer... I ignore them.

What happens when you see that same person talking to a cancer patient trying to sell them plant oil?

When you ignore them you tacitly endorse their position. Their propaganda is being broadcast uncontested, there will be people who believe it. Those people will spread it to other people. Pretty soon whooping cough is back and people are dying.

The truth can't advocate for itself.

'The world as we know it is ending and people like crmrc114 are to blame. There s/he goes right now, messing up the world as we know it!. You know what to do people.'

Added as we know it because it's actually quite easy to persuade people that what they like about the world is under dire threat, as opposed to the objective existence of the planet or life thereon. People's individual worlds tend to be quite small and it's easy and socially/politically profitable to market to them with threats rather than inducements to expansion with all the unpredictability that entails.

Now, imagine that you've been identified to or by an angry group as the cause of their dissatisfaction. This is a very different dynamic from 'someone on a street corner' that you can usually safely ignore, and against whom you probably feel you could defend yourself if necessary. I don't think you'd be so dismissive of nutters in groups if you were negatively impacted.

>We now have people who 100% believe objectively wrong things and have an obsession to spread their belief as fact.

That's not remotely a new thing. Ever since bits could be sent over the wire we've had Dale Gribbles trying to spread their weirdass conspiracies using the web. Only difference is that back then it existed in the form of homemade webpages with remarkably bad color theory rather than the poorly punctuated social media posts of today.

I think the difference is that it’s not fringe obsessives but rather everyday people spreading bad info. Stuff like QAnon, white nationalism, anti-vax, GamerGate and so on might be mostly started and kept well alive by fringe obsessives but plenty of normal people are sharing their memes, lies and content in an uncritical manner in a way that’s very different to personal websites. Social networks have made it much easier for these lies to be spread and repeated whitewashing their true origins and becoming accepted.
> We now have people who 100% believe objectively wrong things and have an obsession to spread their belief as fact.

There's usually enough truth behind every lie - enough to make it compelling enough to believe in. I'm sorry but I don't think it's as obvious as you're making it out to be. We all probably believe something that's objectively wrong. The truth is really in the middle, but all I see is people going further towards fringe opinions.

I think it's worth expanding your definitions, eg

trolls: people who say absurd or mean things for lulz fools: people who truly believe absurd or mean things because they are naive or gullible scammers: people who say absurd or mean things for profit, and may present as fools or absurdist trolls when challenged

This!!!

There was even a "emoji" of beating a troll back in the days o ubb and vbb

We found a lot of lies during the UK election last month. Not difference in opinions, not beliefs about whay may or will happen, easily proven lies, posted across community forums, copied and pasted to other ones, and repeated in an increasing cresendo

People then believe those lies, they repeat them, and even if they don't those lies sink into their subconcious and change their behavior, not necessarily today or tomorrow, but for the next 30 years

Ignoring them doesn't fix the problem.

You might find that the people you see posting and repeating these lies see the things that you post and repeat as lies.
And one of the sides has to be right. Sometimes the facts are difficult to ascertain, but so many of the lies spread via social media are easily disproved by consulting primary sources.
>And one of the sides has to be right

Not necessarily. In the US one of our presidents taught us a long time ago that "both may be" wrong, and "one must be" wrong.

Perhaps the following is obvious, but other possibilities may exist:

- both sides are wrong

- the participants are unwittingly talking past each each other

Etc.

But the thing is, while facts are objectively true or false, a policy choice can't be objectively right. What you often see is, policy masquerading as facts.

"If you accept X then we need to do Y."

"I don't think we should do Y"

"Then you reject facts."

Something everyone seems to have forgotten is that intelligent, well-informed, people of good will can look at the same facts and come up with different policy prescriptions.

As I've gotten older, I've started to doubt the idea that there are any objective facts at all, or at least if there are, the human brain has a limited capacity to comprehend and communicate them.

(Edit) This doesn't mean I don't believe in truth, right/wrong etc... it means that I'm constantly balancing what's most likely to be trueish - subject to higher quality information at a later time.

a policy choice can't be objectively right

A policy choice is the linkage of a fact to a particular goal; while few policy choices are so simple as to admit of a binary choice, you can certainly rank them on a gradient.

Of course, it helps if your goal is clearly definable and you maintain awareness of consistency. Otherwise, a goal of, say, improving life expectancy might be satisfied by a eugenics policy which made unpersons of those with medical conditions that would lower life expectancy.

But a goal cannot objectively be right or wrong. It could be agreed upon, but it can never be true in the sense that objective facts are true.

To go even further, people may agree on the 'what' of a goal, but disagree on the 'why' of a goal, which very much inform what policy choices they are amenable.

Even more than this- the desire to silence and destroy those who disagree, sometimes physically.

Some have called this increased polarization.

I see it as a slide towards violent authoritarianism.

> but so many of the lies spread via social media are easily disproved by consulting primary sources.

I wish this were true. I used to post snopes links and primary sources to Baby Boomer posts on Facebook, but it's hopeless. They either don't trust the fact-check, can rationalize it away, or just don't care. One of the most shocking realizations of my adult life has been learning that a very large portion of my otherwise high-functioning friends will believe anything, no matter how crazy or self-contradictory, if it reinforces their sense of self-righteousness.

Oh, no doubt. Easily disproving something is very different than convincing someone that it's disproven.
And a whole bunch of people that see the minority or unpopular opinion as more valid because of it.
Why exactly should they trust Snopes in particular, as opposed to Washington Post, Fox News, RT, the North Korean news agency, etc.
They frequently do see things in that way - and they're wrong. In fact, they're worse than wrong, because many people see the dueling assertions of fact and give up on knowing the truth of a situation altogether. This is a classic disinformation technique.

We do have the ability to determine truth from fiction, it just takes more work than cynically throwing up your hands and smugly concluding all sides are lying.

The desire to "correct" other people who are wrong is the fundamental impulse of authoritarianism.
(comment deleted)
No, the desire to correct other people who are wrong is the fundamental impulse of pedantry.

The desire to compel others to conform to one’s ideal of correctness is the fundamental impulse of authoritarianism.

...but also libertarianism, for a particular aspect of correctness.

Huh? Can you explain?

My understanding is that the core value / principle of libertarianism is individual liberty.

How do you derive compelling others from that?

Yeah, I agreed until his comment went off the rails there. I have noticed a movement to try to brand libs as 'crypto-republicans' recently for whatever reason. Its okay, and rational to not only think along 2 (or 3 or 5) party lines.
> My understanding is that the core value / principle of libertarianism is individual liberty.

Yes, and libertarians tend to hold that it is right and proper (and even often define “violence” to exclude this use of force) to use any degree of force necessary to get others to observe the individual liberties libertarians see as essential.

> The desire to "correct" other people who are wrong is the fundamental impulse of authoritarianism.

Maybe, but it's also the impulse of people who rightly care about the future of our shared world.

Rightly according to your subjective experience.
> Maybe, but it's also the impulse of people who rightly care about the future of our shared world.

Literally no authoritarian says "i want to suppress people because I'm evil mwahaha." Every single authoritarian says "i need to suppress this evil disinformation because i care about the future of our shared world---unlike you unworthy people who presumably don't care."

Furthermore, it is rationalism which exists as the first non religious justification of hierarchy. Read Plato.
"People are lying" - "They'd say that you are lying" - "BUT I AM RIGHT".

That's not rationalism, that's just saying "I'm right, they are wrong, end of discussion".

That's because this conversation is occurring in the abstract - surely you can think of examples which don't fall into your supposed pattern (flat earth, pizza parlors, etc.)
But those are super edge cases, the vast super majority of things aren't clear cut at all. "Is that policy going to increase employment? Will it depress wages, and by how much?"

Good luck with judging who's right and who's wrong.

These "super edge cases" are happening monthly. THAT's the problem. The examples given weren't a historical review, they're a sampling of what happened in 2019! If these were in any way rare or outside the norm, I'd feel safe ignoring them, but even in cases of absolute truth and fact (jade in your vagina does not cure anything) we get a netflix series.
> These "super edge cases" are happening monthly.

Yes, in a world with literally billions of people, you have a few millions who believe outlandish things. If that was the extent of the problem with polarization/toxicity on the internet (or public debate in general), I doubt we'd talk about it, and I'd be very happy with the state of the world.

Those people have no large base, no stable membership, no money, no power. Focusing on them is like decrying the fall of science because 6yo Timmy still believes in Santa Clause.

You say "millions of people believe foolish things", and then completely disregard exactly how many there are and how concentrated they become. I disagree with the assertions at the end that "a few million" do not constitute a large following, and allow me to provide a few counterexamples:

* the Flat Earth Society has a very stable membership and patreon. Mark Sagent's youtube channel alone has 58k subscribers. Social media influence is the source of money, and a power all on its own. * Gweneth Paltrow's pseudoscience has a facebook group with 500k members. She has a netflix series and a reliable income from her online storefront. The facebook group came first, then the netflix series. * QAnon is a persistent conspiracy theory with no basis in fact. Regardless, tripcodes (a public hash of the password used for identity verification on 4chan) denote a persistent online identity, so he's got a following... and the following is what causes power.

Power in its purest form is asking someone for something and getting it. This looks different in the modern age than it did previously, but saying that celebrities don't have power belies the entire concept. These are celebrities, either advocating obviously false things, or due to their advocation of obviously false things, and millions of people are taken in.

In contrast, the expected Iowa caucus turnout numbers are going to be around 60,000. Or, in other words: There are more people believing in flat earth than there are democrats caucasing in Iowa. How in the world is this not a problem.

> Or, in other words: There are more people believing in flat earth than there are democrats caucasing in Iowa. How in the world is this not a problem.

I mean, isn't the answer already in these sentences? The world vs Iowa.

It's not that I don't believe pseudoscience and cults are a problem, it's just that they are a small problem on the grand scheme of things. Increasing polarization of society at large is a problem on a different scale. It's something that has very tangible effects for most people, some guy believing that the earth is flat and having 60k people watch his videos really doesn't.

9-11 was a super edge case. Yes, absolutely it's difficult to make firm judgements about many issues, but we should still pay attention to edge cases because even though the people out at the edges of discourse seem nuts doesn't mean they're not serious or motivated or capable.
Sure, sure, but "serious, motivated and capable" still doesn't give them leverage. You will always have individuals committing terrible things, there will always be the next school shooter or terrorist, but those are, while tragic, small events, and if you didn't turn on the TV, you usually wouldn't notice them if you lived a few hundred miles away. Change the policies of a nation and you'll have a much larger effect that can be felt everywhere within its borders.

So sure, paying attention to the edge cases is fine, but focus most of your attention on the big issues.

Changing policies is the point of terrorism. You seem to be assuming it's randomized and atomized rather than itself being networked and (loosely) coordinated.
So... would you consider that an argument against the sanctions levied against, for example, doctors who lie and fake data to stoke fears about vaccines and autism? What about fighting against conspiracy theories about the deep state and pizza parlors?

There's a tendency to wishfully think that people are rational and should be expected to sort out their own information environment with no governmental influence whatsoever, but I don't buy it at all. We're predictably manipulable, emotional creatures, and we can decide rationally to improve our information environment without falling into your implicit slippery slope.

> would you consider that an argument against the sanctions levied against, for example, doctors who lie and fake data to stoke fears about vaccines and autism?

Yes. I never said authoritarianism is bad. In fact, I probably consider myself an authoritarian.

I definitely wasn't cynically throwing up my hands and smugly concluding all sides are lying. All I intended to do was demonstrate how cheap it is to call someone a liar on the internet. It costs nothing to the reputations of you or your "lying friend" to call one another a liar and thats why it doesn't mean anything. The sooner people realize this the better off we'll be.
My prediction is that this is what will, in the end, change; technology will advance far enough to severely de-anonymize online interaction, at which point one's reputation again comes into play and people will find there are consequences for thoughtless shitposting.

It has begun to happen, with phenomena such as people being fired for Facebook or Twitter posts. It doesn't seem impossible to tie a sufficiently-advanced pattern-recognition network to the firehoses of data on YouTube, Facebook, Twitter, et. al to automatically tie together the scraps of personal info people accidentally leave behind and severely compromise online anonymity.

Be interesting if it happens.

Economically I think this will be huge. Reputation based economies are incredibly more efficient than regulatory ones. Theres no amount of regulatory compliance that can tell consumers the information they want in the way a 2 star average uber driver review does.

On the social side I can't even imagine how destructive it could be. People (especially on HN) love to lament how restrictive and oppressing the "everyone knows everyone" small town life can be. So now that we have the anonymity online we can escape to, we've all turned around and started building the biggest "small town" imaginable! One with no escape.

Exactly. Mostly because we've discovered that the small town is oppressive, but the Wild West is full of gangsters. ;)
> technology will advance far enough to severely de-anonymize online interaction, at which point one's reputation again comes into play and people will find there are consequences for thoughtless shitposting.

This is naive. Facebook has just as many extremist bigots as any other anonymous platform.

> I definitely wasn't cynically throwing up my hands and smugly concluding all sides are lying.

Apologies, I didn't mean to insinuate that you were. My point was that this is the usual (and often intended) consequence of your argument, as I understood it and have seen it in the world.

Calling someone a liar doesn't help by itself, but if we can bring clear and irrefutable evidence to a discussion, I think we can reasonably reject outright incorrect views.

> We do have the ability to determine truth from fiction, it just takes more work than cynically throwing up your hands and smugly concluding all sides are lying.

It also takes more work than "But I'm right!"

If you've done the research, if you know that you're correct, it's one thing. (Even then, not everyone who is incorrect is lying.) But it's a real temptation to say "I'm right, they're wrong, they're lying" when you haven't actually done the work to be sure you're right.

I am prone to that temptation. You almost certainly are, too. So be careful. You can be the one in the wrong.

I don't disagree with anything you've said, but I often find myself in situations where I have gone out and tried carefully to understand what's true. When you've done the research, it's very frustrating to be confronted with exactly what you're describing.
Sure. But even then, knowing that in other circumstances it can be you behaving that way can give a bit more empathy for the other person. That doesn't make it less frustrating, but it may help you handle it a bit more gracefully.
They're not necessarily wrong. For example, one of the big anti-Brexit talking points beloved of both Corbyn and social media users before the election was that a trade deal with the US would mean maggots in orange juice. This also, as I recall, became part of the narrative about Brexit supporters being mislead, with the line being that they were sold all those false dreams and would get maggots instead. It was a complete and utter lie: https://fullfact.org/health/maggot-orange-juice-USA/

And I really do mean a complete lie. This wasn't a dispute over creative redefinitions of terms like Boris' NHS funding claims, or some nitpick about a minor detail. Corbyn and a worryingly large chunk of the press took an example of US food safety regulations being unambiguously stricter than EU ones - of them placing all the same restrictions on food manufacturers that the EU does, plus more - and falsely claimed their regulations were weaker instead, using graphic, emotive, memorable language, and everyone believed and repeated this total inversion of the truth.

The thing that gets me is that on some level, people must've known that US food isn't really unsafe. There's not some big movement of people who refuse to eat US food - by and large, everyone trusts food there as much as they would food here. The other thing is that despite this pretty much the entire press dropped the ball on this lie. (It is not even close to the only prominent anti-Brexit or anti-Tory lie they left unchallenged or outright made themselves.) Even Full Fact did initially - they actually helped spread the false claim themselves, and only came back to it a month or so later after it had spread across the internet multiple times and been used by Corbyn repeatedly in his campaigning.

The biggest problem from the last 10 years is the spread of "everyone's entitled to an opinion". It seems that objective truth no longer exists in the eyes of the population.

This is both a cause and a consequence of the defunding of journalism and the change of the profession from news to views.

Erm... defunding journalism by who?

Private funding is making the situation worse.

Public funding is the instrument of authoritarian regimes- state sponsored media.

I think the root cause is lack of objective, critical thinking skills, and the glorification of "how it makes you feel" being more important than "is this reasonable".

I.e. emotion driving reason, rather than reason driving emotion.

By society. We don't want to fund people to separate fact from fiction, yet we lack the time and ability as a population to do it ourselves, so we latch onto outlets (especially celebrities) that seem to match our world view, and we treat what they say as gospel.
Isn't everyone entitled to an opinion though? What you're hitting on, I think, is that the so-called "toxicity" of the internet is just broad disintermediation. Previously, a few people controlled the public narrative. Now, everyone does. Turns out most people don't very much like the worldview that the media elite pushes.

Journalism is dying because it's become not only useless as a means of information dissemination --- new media is better at that --- but also because journalists have become contemptuous of the public. They have only themselves to blame.

That's not a novel phrase, and it's also at least partially a peace treaty between worldviews with fundamental differences.
And if it's an opinion on things like "should it be legal to have sex before marriage" or whatever that's fine

The problem comes when you have 5 civil engineers saying a bridge is not safe, and 50 random members of the public saying it's safe. If we treat those opinions as equal, we end up with a bridge collapsing.

In the root, there are people who knowingly lie. Hitler knowingly lied. Stalin knowingly lied. Many many people lie being fully aware they lie.

The hell, average maanger lies.

The problem with lies in politics for me is that every politician needs to do them to stay competitive. Also every party has politicians with different objectives, which makes things even harder. Also a good leader should be well compensated, at the same time people are envious of politicians who make a lot of money legally, which makes corruption for politicians necessary.

The only improvement I see is decentralization, which is a very slow, but powerful process. The Gutemberg printing press showed that it is possible, and Bitcoin is doing the same thing right now, but I think superior technology for organizing people and resources is the only solution.

I don't know if ignoring lies is necessarily a problem. Because what are the realistic chances that anyone responding to non factual information, is responding with factual information? Probably pretty low on the net if we're being honest.

That said, yes, we absolutely cannot ignore the toxicity in its entirety. Ignoring it entirely is how little old ladies at church bible studies wind up dead. There are certainly classes of toxicity that it's just military sense not to ignore. Religious and ethnic extremism, etc. Basically anything that is going to cause issues with physical violence. To my mind, violence is the line.

> Ignoring them doesn't fix the problem.

"The problem". What problem are we talking about again here? Is the problem that people are believing wrong things, or the spread of polarization and toxicity?

I don't care if people believe "wrong things". How's that old song go? "All lies and jests, still a man hears what he wants to hear, and disregards the rest"? People will always believe whatever they want to, regardless of "evidence", regardless of history, regardless of persuasion. "Post-truth" society is such a ludicrous term. There was never a "truth society" to begin with. Never. If someone doesn't want to change their mind, you're tilting at windmills. Doubly so if this person is an anonymous account.

What I care about is stopping the spread of toxic and divisive stereotypes.

Look at the front page of Reddit. Every other post is a screenshot of an outrageous anonymous tweet, or a picture of a receipt with a nasty note on it, or a text message conversation. Look at how the public receives this: "Who cares if it's real or fake? The point is that it reinforces my stereotype of 'them'. We know 'they' exist, and we must do something about 'them'."

That's what's driving polarization and toxicity. The urge to respond with outrage to anonymous trolls. This is a problem we can fix by down voting and moving on.

> I don't care if people believe "wrong things".

But those beliefs lead to actions, which have negative consequences, which can affect us all.

Indeed, but attacking that with anger, outrage, and witch hunts rather than tact is not only ineffective, it may even create a positive feedback loop.
Actually, it is rather effective. Your immune system doesn't rely on tact once a particular foreign body proves to be hostile or dangerous; rather tt initiates inflammation and countermeasures.
We must be careful when using microbiological metaphors to propose solutions for macro social problems; such language has often been used to justify genocide (i.e.: "hygenic cleansing of parasites"). Besides, what we're talking about here is more akin to autoimmune disfunction, and not healthy immune function.
Besides, what we're talking about here is more akin to autoimmune disfunction, and not healthy immune function.

No it isn't. Responding to toxicity or an external insult is precisely what the immune system does. An autoimmune disorder would be an activation of the immune system against some other bodily system that is healthy and functioning.

An autoimmune disease is a condition arising from an abnormal immune response to a normal body part. People having different opinions is normal.
People having different opinions is normal, but not all opinions are thereby valid. Promoting genocide or child abuse have a deleterious effect on people in the in the respective target groups and so we sanction such opinions because of their demonstrated harms that result from their implementation.
The problem is how people define and extrapolate what constitutes promoting genocide or child abuse is often erroneous.

For instance: some people consider anti-vax sentiment to be child abuse, but dont consider cross-sex hormone injections for young children to be child abuse (and vice versa).

Another example is how many consider the swastika to be a symbol of genocide, but give a free pass to the hammer and sickle -- even though both of these symbols' ideologies have been similarily genocidal.

Honestly that's somewhat nonsense. People don't just believe whatever they want to believe, education and diffusion of information has radically changed humanity over the last few centuries and you're fooling yourself if you think that somehow improved communication and discussions didn't drive that. Schools have improved reading and mathematical literacy of the general population, that isn't just some made up statistic.

Humans are incredibly social beings, they hide in each other, as well as grow in each other. People absolutely can and do change their minds on all sorts of things every single day, and it's a "throw my hands up in the air and quit" to say otherwise.

Yes... and also no.

Yes, people change their minds. But the more passionately they care about something, the less likely they are to change their minds about it. On the big questions that people care deeply about (politics, religion, vi vs. emacs), evidence doesn't seem to change peoples' ideas nearly as much as it should.

> I don't care if people believe "wrong things".

If you are an ethnic minority in a society where xenophobic nationalists believe you should be killed, do you think you'd care if people believed those "wrong things"?

(comment deleted)
I have trouble seeing responding as much of a fix, although it depends a bit on the platform. On Reddit, Facebook, and the like, there is a pattern where you have highly upvoted/liked posts, where the top comment is about how the thing is obviously wrong.

Most people just glance at headlines, image, or whatever, and don't read articles or examine comments. Those comments about it being wrong only help inform the subset of people who bother to look at comments.

This is like saying "Just ignore the problem until it goes away," which is cute, but very naive. This is a systematic problem with huge economic incentives pushing things to the extreme. There is massive funding from state and political institutions amplifying and promoting extreme political views. This is come a long way from some lonely dweeb in his basement just looking to get a rise out of someone online.
hmm, I think that in this particular case ignoring it will make it go away.. because in the end, the problem is that people pay attention to it.

suppose nobody paid attention to such content in the first place, would it really be a problem in that case?

I think the tricky part is that if I ignore it, but no one else does, the problem is still there.

Suppose cancer didn't have any negative effects, then getting cancer wouldn't be a big deal.
Part of the problem is that social platforms online are built around heavily optimising for engagement. Content that gets engagement must be better, so it gets promoted more heavily, and algorithms show you personally the content it thinks you're most likely to react to. You can't leave because it's messily wrapped up with your social connections to your friends.

Until this system dies, we won't solve this problem. It's not good enough to instruct people to stop feeding the trolls: there are huge troll-feeding dopamine farms feeding and nurturing trolls by the millions. Until we shut them down the situation will continue to get worse.

You don't have to leave, although I think most people overestimate how much it would hurt their social connections if they did. You just have to refuse to engage with toxic content when you see it, the same way you avoid debating with an obnoxious friend. (Newer social media platforms, unsurprisingly, are designed to make this easier; it's much easier to avoid dumb arguments on Instagram or Tiktok than Facebook or Twitter.)
It's you against a whole bunch of bright, motivated, and very smart people trying to keep you commenting, clicking, and getting involved. It's not that easy.
What's new is the political Echochambers.

Stop feeding partisan BS. You are not Left nor Right!

Even those have been around on the internet since the dawn of the internet.
When you stop responding, AKA reacting, you are not solving the problem, you are making it worse.

In fact I would say that "don't feed the troll" is the root cause of the huge spike in trolling that we have now.

Do not feed the troll meant, from what I understood back then, kill it, not let it grow somewhere else where it's protected.

Exactly. "Don't feed the troll" means report it to the moderator so they can ban them. Letting trolls spew their message unopposed is how you lose your community.
Stop responding is a fools argument. The game has changed a lot since the days of your average internet trolls because the line between internet and reality has become increasingly blurred.

For example, I don't use Facebook. But my parents do. I've had to talk with them on more than one occasion because they would get caught reading objectively wrong things spread on Facebook by bots. Thankfully my parents trust me enough that I can be an authority on those sorts of things, but it's not something I can simply ignore. If I were to let it fester, eventually it could turn into things like 'vaccines contain brainwashing bleach' or 'the government wants to take away your spleen' levels of nonsense.

At a certain point it's a good idea to stop platforming people like anti-vaxxers but it's also irresponsible to say it's possible to just ignore it.

'responding to it' is engagement, and there is a financial incentive for that.

So the algos are boosting controversy, to boost engagement, to boost financials.

Not feeding the trolls is good advice for one's personal emotional health, but it has never made the trolls go away. There's too much infrastructure supporting them: they know what works, and they broadcast to everybody. It only takes one response to give them the burst of dopamine they're looking for.

Responding makes it worse for you. It gives them a second chance aggravate you, this time with more precision. Downvote and move along is excellent advice -- especially if you're on a platform that helps you filter them out in the future. But don't fool yourself into believing that they'll go away, or that people aren't listening to their misinformation and incorporating it into their belief system -- even if they know it's false.

yes, not feeding the trolls is like "don't respond to spam." doesn't really solve either.
I'm only responsible for me. These people won't change, no matter how eloquently I phrase my fact-filled take-down of their arguments. I'll sometimes argue just for the audience, but I can't fix everyone that believes something (I think is) wrong. It's not my place, anyway. People are slowly becoming more "street-wise" on the internet. This is just one of those traps people can only avoid after they've learned their lesson first-hand.
Completely off topic, but I love your HN handle!
"Stop responding to it."

Then they win elections.

I'd agree in some cases, and disagree in others.

In terms of things like 'fake news' and media outlets peddling absolute lies, ignoring it altogether may not be the wisest move. Might in those cases be better to calmly deconstruct the lies and prove the stories are wrong.

In terms of things like personal attacks, political toxicity on Twitter, etc? Ignoring the trolls is 100% the best thing to do. The folks that send threats and mock others online want a reaction, and the more reactions they'll get, the more the person reacting will get targeted by even more of them.

Absolutely. I'm afraid to admit how long it took me to figure out that you shouldn't argue with people that aren't willing to change their mind.
+1. These days, if someone tries to steer me into some sort of polarized political discussion, I give my hourly rate and ask to be paid upfront.
Some family members that once said "don't believe what you read on the internet" and resistent to the early internet are now some of the biggest sharers of hyperpartisan alarmism online.
"Don't feed the trolls" has been my strategy for as long as I've been on the web, but what disconcerts me the most these days is the doxing and death threats. A reporter can simply retweet a news article and instantly be flooded with death threats and see their address posted to the web. There's no way I could tell that person "don't feed the trolls". That's a real problem with real life consequences, and I have no clue how you could begin to solve it, aside from total anonymity.
Back in the old day, there was this saying. "Do not feed the trolls". Sadly, we've forgotten that.

It has never worked. Put yourself in the position of someone who is being maliciously harassed by trolls and getting no help from anyone else. It's like telling a weak kid that is being bullied to just ignore it; the reality is that bullies are determined and tend to escalate rather than abandon their aggressive behavior. At best they will move on to picking on some other weaker person.

Do not feed the trolls made Kathy Sierra go out of Internet. It blames victims for daring not to be silent. It is like telling bullied kid to "avoid attackers" or "not be shy" or "do what they want".

Ultimately, it rewards trolling behavior.

Make it harder to use, like it was.

Doing things on the internet used to be harder. It used to be a network of loosely interconnected websites. You wanted to have a voice you made a website. You wanted to talk to others you joined a chat room or newsgroup or message board.

Then we invented comments. Now we have apps with SSO. You don’t even need to make a username anymore. The entirety of the internet congealed into 50 or so web properties.

Slashdot is still around. It’s relatively hard to use. Their moderation system brutally punishes trolls and rewards good behavior. It also allows for jokes and sarcasm.

What? What's wrong with it?

The arrogance behind thinking "how do we fix the way everyone behaves"... jesus holy eff.

Vigorous debate is good, even if you get manic israel vs palestine or weirdly spergy tabs vs spaces spats as a side effect.

Writing is the tip of the iceberg. I used to run a forum, and the write versus read rates are enormous. 1 to 20+ ratios.

Argument brings out the best ideas. That energetic passion, that desire to win, makes people give it all they've got. And people read. And people can detect between wisdom and dumbassery. And they learn and benefit from it.

It's a key factor in educating the next generation. It's good. Go clutch your pearls elsewhere.

> And people can detect between wisdom and dumbassery.

Nope

Guess you should intern them at your I'm Super Smarter Than You reeducation camps then.
You've unfortunately been breaking the HN guidelines a lot by posting in the flamewar style, snarking, and being nasty. That's not a legit use of this site. We ban accounts that post that way—we have to, because they poison the well and push the site further down the classic internet forum path to heat death. HN from the beginning has been an experiment in whether we can stave off that perhaps inevitable decline. See https://news.ycombinator.com/newswelcome.html and https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu...

On the other hand, you've also posted some substantive and interesting comments, so I don't want to ban you. Would you please review https://news.ycombinator.com/newsguidelines.html and use HN in the intended spirit? The idea is: if you have a substantive point to make, make it thoughtfully; if you don't, please don't comment until you do. When you know more than someone else, share some of what you know in a respectful way, so we all can learn something. Don't just put others down.

You should all downvote harder. It might make you right! :D
You gotta see the irony in being censored on the thread about this topic with one of the most correct responses! Typical!
(comment deleted)
We're essentially feeling negative effects produced by sorting a list of items. Currently they are sorted based on friend interactions and other criterion; mainly popularity. They sort this way because it increases engagement. What we've also found out is that this is also negatively effecting peoples emotional health.

My personal feeling is that reverse chronological order with maybe throttling your chronic over-sharing friends would probably go a long way to helping blunt some of the negative effects we see today. But it would also lower engagement and lead to revenue losses so they probably haven't earnestly considered it. Kinda like how the cigarette companies don't want you to know that smoking is bad for you, because you might smoke less.

That's exactly how FriendFeed worked, and it was great.
I don't think anything really changed. Only the scale of things, with platforms like Twitter that can be extremely viral.

Everybody remember the collective insanity of the Covington Catholic school fiasco where journalists and celebrities were publicly wishing for the death of a bunch of kids wearing MAGA hats or at the very least getting them doxxed or hurt all because of a one minute video taken out of context. And those who approached the story in a cautious manner were called out by the rest for being to soft or accused of being part of "the bigots", Ironically, the account that initially twitted the video snippet was banned after a few days.

I don't think the population is more deranged than before though, I mean the 70's were pretty violent politically, more than today.

The solution is to quit social media or join smaller communities free of wedge issues and identity politics. Twitter, Facebook or Reddit aren't going to fix themselves, they make money off outrage and petty divisions.

And finally you don't owe activism on a specific cause or an opinion to anyone. It's OK not to have an opinion or not wanting to get involved in a political debate. Anybody that attacks you for refusing to take a stance on any issue should probably be muted/blocked or removed from your life, that person isn't your friend and will try to make you look bad at the first opportunity just get brownie internet points for themselves.

Read "Amusing Ourselves to Death" by Neil Postman.

You will realize that Social Media is designed in such a way intentionally to draw toxicity from society.

No technology is neutral. Technology gives and technology takes away. Medium is the message. Communication evolved because of the medium. For every evolution, it gives something and it takes away something. From oral communication to the printing press to telegraph to TV to the internet to social media. Every evolution gives birth to something and destroys something.

For example, TV makes everyone reachable (what it gives), but makes everything into entertainment (what it takes), even important topic such as politics, religion, war, poverty, pestilence, etc science becomes pure entertainment, juxtaposed between endless drama, reality show, and ads, coupled with background music and personas that manipulate the minds. The more "entertainer" you are, the better, regardless whether you are a dumb scientist or a dumb lawmaker that will affect many people's lives using your policy.

Social media such as twitter, for example, everyone now has a voice (what it gives), but with its char limit (what it takes) doesn't give critical thinking and rational debate a highlight, therefore it spirals down into madness. The more outrageous you are, the better, because it will go viral and people will react in such a predictable way.

A good example of a person who knows exactly how TV audience and social media audience will behave in a predictable way, and took advantage of that, is President Trump.

You want to design a medium/platform in such a way so that the pros outweigh the cons. But I think the hard part is knowing how will people use the platform. Those social media giants started out with good intentions, and only later and later down the road, and here we are right now, that we discover its true effects.

> A good example of a person who knows exactly how TV audience and social media audience will behave in a predictable way, and took advantage of that, is President Trump.

Trump wasn't the first though, and contrast the coverage: Obama's digital strategy was lauded for its tech-savvy genius by the media, whereas Trump's campaign was linked by the same to white supremacists wrt Pepe the Frog etc.

He wasn't. I'm just pointing out he is doing a good job at it. It is no secret for people who work in the media industry that "entertaining" and "outrageousness" is a recipe for success.
> Social media such as twitter, for example, everyone now has a voice (what it gives), but with its char limit (what it takes) doesn't give critical thinking and rational debate a highlight, therefore it spirals down into madness.

Twitter has a hard, small limit. Most other platforms either have no limit, or the limit is fairly large.

The problem is, people don't use it.

Worse, those that do use it are ridiculed, or their words are ignored (TL;DR anyone?)...

Thinking about this, I wonder if any of it has to do with people's "inner monologue" that was discussed yesterday here on HN? If you didn't see it, the gist was that there are some people who don't have such a monologue, and it came as a surprise to one person. Similarly, those without such a monologue are often surprised that others have it; one person commented that they often wished that the voiceover of characters in a movie, expressing their inner thoughts, was a real thing - and were shocked to find out that for most people - it is!

Anyhow - does this play into how people write online? Do they tend to write less or smaller messages, because their inner monologue is too loud or constant? Do those without such monologue write more thoughtful and longer posts? Then I think of myself; I have an inner monologue, but I tend to write long things (case in point - this post?) - but I don't find my inner monologue a burden.

But some do - I know I have read of people who either must always have some noise around them to drown out their "inner monologue", or if left in silence, even for small moments, will declare themselves "bored", perhaps because their inner monologue isn't perceived as interesting (whereas I and others have no problems thinking and pondering things, in silence, with no boredom)...?

Does this effect how people compose and type their messages? Does it help or hinder understanding? Does it facilitate or does it block meaningful conversations?

Twitter may have tapped into something that was always there to begin with, and in essence has helped foster that communication style - making it acceptable widely - conversation as "sound bites" - which has perhaps led to our present situation.

Twitter is just an example. If you read that book, the gist is basically Social Media makes it easy to brain dump and leave that brainfeces all over without having to look it back again (paraphrasing mine). Anyone in the world can post anything, without any accountability, without the need to carefully revalidate and be validated/invalidated.

I saw the post about inner monologue but didn't read it. But I believe it could be related.

I highly suggest reading the book because I'm doing a disservice trying to explain about it. It basically explained how oratory, printing press, telegraph/telephone and television really changed society a lot, but in subconscious ways that most of us don't think.

It's a problem IRL, too. I am astonished by how much disinterested people are in each other. I am very good at keeping a conversation going, I become genuinely interested in the person and ask as many follow-up questions as possible. Unless I know what we're talking about falls into my experiences, I'd refrain from talking about myself.

But what I see constantly is that people have gone from a "what about you" mindset to "what about me" mindset. My conversations end as soon as the person is done answering my questions about them. Like, zero reciprocation, which is god awful.

If these people participate online, where they can mainly get away with being a shitty personality, then this toxicity is not that surprising to see.

User experiences are crafted to make the user the center of attention, or gives them the levers to do so (Instagram and Facebook, for example). The result, while depressing (and what you observe), should be of no surprise to anyone.

I have no solution, only a small piece of advice: seek out others with empathy and active interest in others. Avoid narcissists like the plague. Be humble.

While there is definitely an uptick in polarization, I think the more important and insidious trend is the increasing ubiquity of bullshit. We are flooded with information online, most of which is irrelevant or counterproductive to our interests. Needing to constantly wade through that in triage mode (with a judgmental attitude) has the general effect of wearing down people’s psyche and making them feel exhausted, anxious and on the edge. In that mindset, of course small things are going to set them off — but that is just the symptom, not the root cause. This is also a much harder problem to wrangle with because it is less specific. The causes of this problem are deeply embedded inside the incentives we have set up on the web over the last two decades — to challenge those will require answering some hard questions. At some level, people realize this (hence small efforts like the slow tech movement, digital detox, etc), but they are yet to find the right balance of convenience and sanity (for lack of a better word).
Encourage people to participate in physical social gatherings that center around non-political issues, like hobbies.

We need to start emphasizing what we have in common, help people see that ultimately we're really not all that different from each other. The internet lets people hide behind this isolating veneer that makes it too easy to just shout at each other and behave in extreme ways that would never be socially acceptable in the real world. Interacting in real life significantly moderates people's behaviour and when social media and the internet facilitate segregation and amplification of extremes, spending more time in person might really do us a lot of good.

We need to put people in a context where politics is irrelevant and a shared interest has the opportunity to bond people who would otherwise not meet. It's the only way I see of countering Identity Politics that try to be all consuming.

It would also be helpful to encourage people to focus on more positive events. Outrage culture is a thing, only exacerbated by social media, where rage = clicks/views = money. We need to change the economics of this equation. We would really benefit from a culture that gave more attention to people doing good rather than just focusing on the villains in society.

(comment deleted)
the dream of every authoritarian government.
Encourage people to participate in physical social gatherings that center around non-political issues, like hobbies.

I think there is a lot more to this than many people think.

If more people participated in hobbies, then they would spend less time on the internet. The time they do spend would be more targeted and focused instead of mindlessly scrolling and scrolling and getting baited and agitated.

They would also form communities, as you suggest, with common interests and get to know people better. It's basic socialization.

Part of the problem is that for some reason there is a notion that everything has to be a business today. There's a Fidelity Investments TV commercial running right now where a daughter says to her retired mother, "Did you paint this [painting]? You know you can sell these!" And a business is born. Why? Why can't she just enjoy painting for painting's sake. For her own enjoyment? Why is money what decides if something is valid or not?

I encourage people to start hobbies. And be bad at them. Be terrible at reading, stamp collecting, woodworking, gardening, model railroading, brewing, or whatever. Do it because you like it. If you happen to be good at it, great! If all of your carrots die, that's OK, too. You got to spend quality time with yourself, which is more important than all the carrot sales you could possibly make.

I raised the same point about businesses in a comment a few days ago, among other issues https://news.ycombinator.com/item?id=22025971

[warning, cynic paragraph ahead] We don't have time to socialize, we obviously live to work. We might be stressed as we don't get to disconnect much, but you know, that would be so wasteful! Streets are not for people to socialize, they are for cars and for going somewhere else to do business. Spaces can only be there for money, otherwise they are an inefficiency which we'll have to fix. If you are good at something, you should be earning money from it. We live in a global world. We have so many hobbies! But only so many people fits in an area, so matches are unlikely. Anyway, if you are willing to go out for socialization any hobby is ok. If you are interested in finding interesting people... sorry, they are busy at the moment. That's what interesting people do. Be stressed and busy trying to fix the world from crashing by hitting harder the accelerator. Ah, the beauty of an efficient market. Perfecting time and spaces.

Damn, this is a great idea... I’m going to try woodworking and make the shoddiest set of chairs one can imagine, but they’ll be my chairs. Could take up to a year maybe of practice but who cares!
I hope this leads you to make friends with the other local woodworking nerds :)
As a matter of fact, i picked up woodworking as a hobby last summer and made some really good friends. You don't have to be good at it, just the whole process of going through it is rewarding. Look up "Mr. Chickadee"s channel on YouTube, watching his videos is like a meditating experience.
"... start hobbies. And be bad at them." Love it. The reasoning sounds like Chestertonian "common sense."
Agreed wholeheartedly. Some hobbies have become more chic because of the analog "in-person" aspect (like tabletop gaming/role-playing and adult sports leagues), but culture is still losing the fight against isolation.

I optimistically think people are appreciating face-to-face time more, and I hope we think of a lot of new excuses to meet up over the next decade.

Unfortunately the problem is preexisting. The local communities can and have been the most psychotically toxic places.

If something is political is only about the level of agreement and not about sanity, decency, or morality. It may be easier to (not) think about divergence of views but that doesn't solve the particular underlying issue isn't real.

Exactly this.

A few years ago I was at a local community meeting about expanding a school (USA). Let me tell you something, online trolls have nothing on the people who were for or against the expansion.

I left totally shocked with the toxicity, outright lies and innuendo. At one point someone on the board said the school was a front for prostitution. The audience audibly gasped.

(comment deleted)
> We need to put people in a context where politics is irrelevant and a shared interest has the opportunity to bond people who would otherwise not meet.

We had that thing. It was called organized religion. Then liberals systematically destroyed it. In typical fashion, they never thought about what would replace what they were tearing down.

Oh please, politics are an extremely important part of organized religion, at least in the United States.

Also "chosing not to participate" is not the same as "systematically destroying."

It wasn't just "choosing not to participate." It was activism seeking to exclude religion from public life. The most important of those being the elimination of religion from public schools in the 1960s. (I should caveat the following by pointing out that the below is not an attempt to convince anybody about what policy would be better. Instead, it's an attempt to describe what I see as a fundamental tension in the approach that we have, for better or worse, adopted.)

A key function of most religions is providing people with a specific moral framework. Fundamental to that is almost always the process of socializing children in that moral framework. (Indeed, the UN recognizes that as a fundamental human right.) At the same time, a key function of schools also is socializing children in the values and morals of their community. For most of American history, there was no conflict between these two institutions--America's overwhelmingly Christian communities socialized their children in their religion through public schools.

The Warren Court's decisions in the 1960s broke that process. Parents had to socialize children in their religion "on their own time." Meanwhile, because teaching morality is an indispensable aspect of socializing children, public schools created an alternative, secular moral framework to impart onto children. Under those precedents, even in communities that were overwhelmingly Christian, and where Christian parents wanted their children raised with a Christian moral framework, public schools were required to teach them something else, in competition with whatever religious instruction they might receive on their own time. It's a unique scenario where attempts to vindicate the individual right of being free from unwanted exposure to religion in schools, has the side effect of dramatically curtailing the ability of the majority in the larger community to impose their religious values into their children.

Taxing people, then using that money to create public schools, and then requiring people to send their kids to those schools, and then prohibiting those schools from teaching kids the religion of their parents, very much has the effect of undermining the propagation of religion. It gives the secular teachings of teachers primacy over whatever religious teachings parents may be able to impart during the waking hours when children aren't in school.

Whether this that approach is nonetheless necessary in a multi-cultural society is a different question. I would point out that countries like Sweden seem to be doing fine allowing religious parents to choose to send their kids to publicly funded religious schools. But I think the effect of promoting secularism and undermining religion is hard to deny.

No offense or anything (or maybe offense, I don't know) but it wasn't "The Liberals" who systematically destroyed religion. A whole lot of the downfall of religion (which hasn't fallen, by the way) was predicated on religious institutions eating themselves from the inside out. Think about the excesses of the Christian churches of the west, based on the teachings of a man who taught forgiveness and the moral wrongs of excess. Think about the Bhuddist monasteries in the east who have fallen to, what can only be described as gang wars over the best tithing lands. The Shia and the Suffi try to kill each other over supposed differences in Muhammad's teachings. Churches did a fine job of destroying religion, long before people started blaming Liberals.
Does it not seem somewhat disingenuous to lay the blame for the dip in religious affiliation and the rise of secularism entirely on liberals? Could the internet and increased access to conflicting information have played a role?

Not to mention the irony of addressing the toxicity and polarization of the internet by adding yet more toxicity and polarization.

While I'm not sure I agree with your point about liberals "destroying" organized religion, I agree that churches (and other place of worship) unite local communities and the members look after one another.

We should really be putting far more effort into building similar non-religious communities. Things like book clubs, hiking clubs, or anything that involves shared interests.

(comment deleted)
Throughout history there has always been a large majority class of people who were suppressed and controlled by the elites just like today. The difference is that today, the suppressed classes are comparatively highly educated and have access to limitless information. Before, this knowledge was accessible mostly by the elites.

Today, the lower classes know what's going on politically and economically better than many of the elites. That's why distrust of institutions is at an all time high. That's why books which label the social order as a fiction like 'Sapiens: A Brief History of Humankind' are top sellers. For the first time in history, the correlation between wealth and knowledge has disappeared and is even starting to reverse.

It's difficult for the elite to control a class which knows what's going on better than they do. And BTW, fake news has a purpose. It's a political and economic weapon invented by the lower and middle classes to serve their needs.

Fake news is owned and created by elites though. It's meant to generate outrage to support specific political causes. The greatest deceptions it perpetuates are fear-and-scarcity-based appeals to a binary political system (elites have created a policy-bundled system where campaign finance reform never happens and lobbyism thrives). In reality there is abundance and deep commonality between working class people in America, and uncovering it is one of the information revolution's greatest threats to the control class's divisive attempts. Fake news is a tool of the elite to counteract that effect, as is any erosion of critical thought, any disinformation, any suppression of empirical science.
I would honestly struggle to do that. When one side of the argument is effectively arguing for my own removal / loss of rights / loss of dignity, I don’t see how I can have a dialogue with them about anything, since they clearly see me as inferior / unworthy.

Brexit effectively ruined a few experiences for me, like pycon UK, and I’m really not looking forward to picking them back up or risk being in that position again, sorry. I respect everyone’s opinion until it starts making me an unperson, there I draw a line.

Do not respond, block, then report.