79 comments

[ 5.2 ms ] story [ 180 ms ] thread
Quick question to people that know more about these things than I do (pretty much everyone on HN):

Is there a way that Twitter can prevent users from creating another Twitter account to continue to send threats and horrible messages?

The worst messages we see on Twitter always seem to be from new accounts with 3 followers, clearly throwaway accounts. Ban one, they start another.

Not without making it much harder to onboard new users. User growth (Monthly active users) is a business goal Twitter reports to investors so that's a non-starter.
They already force people in some ip ranges (for example tor exits) to do mobile # auth.
I can't think of a reasonable way of blocking people with bad intentions from creating Twitter accounts. But there are other things they could do.

One approach would be to expand their verified user program to people like me (ie the proletariat) and then have an option to switch the blacklist model of blocking people to a whitelist model of showing only tweets from verified users.

Or they could make a whitelist based on people I follow or that friends follow (or friends-of-friends etc...).

Or maybe just get serious with analytics and sentiment analysis and don't show me stuff that is likely a troll.

For a service that's trying to grow, that would force them to put all new users into an "unverified" bucket, which will probably be a turn-off to those users.
> that would force them to put all new users into an "unverified" bucket

But that's exactly how it is now.

I personally like the verified user option but I can understand how some wouldn't for reasons like the one you give. Frankly, I think Twitter's focus on growth is a big part of what got it into this problem in the first place. I'd rather see them focus on quality than growth and I think expanding the verified user program does that.

The measure-of-connectedness option is a little gentler and would probably fix a pretty big piece of the problem.

> I'd rather see them focus on quality than growth...

Quality of what? Discourse? Network connectedness? Ad-accuracy? (I'm nitpicking, but I'm curious what you mean.)

That's a good question. From my perspective as a user and fan of Twitter, I would say quality of discourse. That's a funny thing though because reading a tweet can be like trying to decipher a vanity license plate. Still, that's enough to communicate some pretty important stuff (like during the Arab Spring events a few years ago).

So the logical next question is how does Twitter shape how it is used? I think the answer to that is in part, let other people take care of that. In some ways, Twitter-the-platform is much more interesting that Twitter-the-product. My current favorite example is Nuzzle.

Unfortunately, Twitter is a $13 billion (and falling!) company. Investors think Twitter is Facebook Jr. and it really isn't.

Here are some common answers:

- ban the email address associated with an account from creating other accounts, or in the softer form make someone blocking a user on Twitter block every address using that address. This would run into problems with things like + aliases and people running custom domains who have an effectively unlimited number of addresses, all of which can be reduced but not eliminated if you invest time in it.

- require every account to be linked to a cell phone number using SMS (“mandatory two-factor for everyone!”). This would be more effective than emails but would cost some users real money, screw or delay others if they have unreliable cell carriers, and completely block anyone who doesn't have a cell phone.

- require every account to be verified using a credit card, blocking anyone without a card and no doubt discouraging others. This works great for metafilter.com but there's also a reason why MetaFilter is a site loved by thousands of users rather than millions.

The problem is that Twitter was a VC-funded company which had a big IPO based on highly optimistic growth estimates and their corporate thinking appears to be focused on maintaining those unsustainable numbers. Anything which slows people creating accounts goes directly against the goal of having ever-larger numbers to report.

- require every account to be linked to a cell phone number using SMS

They currently do this to "problem accounts". I have no interest in giving Twitter my phone number and would ideally like to not even have a phone number in the next few years.

That's a perfect example of the problem: it'd make it harder but far from impossible to cheat (cheap SIMs, spoofing through insecure telcos, etc) and there are a non-zero number of legitimate users who don't want to give Twitter a phone number.

You'd probably need some sort of hybrid approach to do this for real – SMS validation counts as x points, y months of interaction with other users without a complaint counts as z points, etc. It's similar to the email anti-spam measures but a less daunting problem since they don't interoperate with many thousands of other peers (for better and for worse).

There really needs to be an option that users can turn on to block all @ from people they don't follow. Even temporarily, say for a period of a month at a time.

I'm also a fan of the "reddit gold" style idea of cheap paid accounts that don't necessarily have to be paid by the account holder. That would make it easy to allow people to filter out unpaid unknown accounts and raise the cost of abuse.

The underlying problem is that comment moderation is a kind of emotional labour that can be fairly gruelling at times, and it needs suitably paid staff to do. Attempts at automatically dealing with it are very much like the early days of spam fighting: not very accurate and constantly shifting. But whereas spam is broadcast, abuse is targeted.

> There really needs to be an option that users can turn on to block all @ from people they don't follow. Even temporarily, say for a period of a month at a time.

Get a blue tick :)

I have the worst source (I think I heard it on a podcast...) but I'm pretty sure that verified Twitter accounts get an extra notification option to prevent notifications or messages from non-verified users from appearing. It basically turns Twitter into a verified-users-only service where you never see the regular plebs.

That's the behaviour, yeah. Verified accounts live in their own rareified world. The idea being that high-follower count accounts are probably more interested in chatting with their peers (most often, celebrities) than with deal with the deluge of plebeian notifications.
I suspect that it's now a solvable problem to determine if the first few messages from an account are, if not "harassment", at the least... argumentative. Angry. Uncharitable. Sentiment analysis is pretty well-established, as is figuring out what people are talking about for the purpose of advertising at them.

If a new account joins and immediately starts expressing strong opinions on, say, a certain Breitbart reporter and how much ethics is in his journalism, whatever those opinions are, those don't need to be sent as notifications or show up as a reply to other tweets. It's not like Twitter guarantees reliable delivery, anyway. If they've been around on Twitter for a bit, sure.

But it's not as clearly in the interest of profit as identifying advertising interests (or even identifying spammers).

"The worst messages we see on Twitter"

The key might be the verb "see". If a troll trolls in the forest and no one sees it, did it actually troll?

This eliminates trustworthy delivery and predictability, you'll have to send tweets and just kinda hope they appear rather than expecting them to always appear, but it might be worth it. Or make it optional.

The new Twitter policy is already used to mass-silence activists by dedicated (paid) teams of trolls.

http://euromaidanpress.com/2016/01/09/twitters-new-policy-mi...

I'm curious to know how this is happening. Perhaps the people who handle complaints in Russian and Ukranian are Putin supporters and bring their personal animosities to work. It would be hard for Twitter to hold accountable judgement calls in languages management doesn't understand.
>I'm curious to know how this is happening.

Seems pretty straightforward if you believe the claim that the abuse complaints are coordinated, even if they're "legitimate". Both pro-Ukraine and pro-Soviet users are violating the new rules, but people are systematically seeking out and reporting violations on pro-Ukraine twitter accounts and the same isn't happening to pro-Soviet accounts.

Maybe because there aren't actually any Soviets anymore?
Yeah. There have been a few instances of this already. Not just trolls, but journalists, people discussing politics, etc. I feel like Twitter trying to bend over to appease the people who want to combat unpleasantness online will have more unintended consequences.
I've seen multiple people claim that it would be easy for Twitter to ban harassment on Twitter.
The same way it would be easy for crypto companies to build a backdoor, in that if you dont understand the problem, it is easy to solve.

edit: (and remain secure)

More that it is easy if you don't care about throwing away other things you value in pursuit of that goal
I don't envy Twitter's position right now. They are stuck between (1) trying to renew their platform to monetize and grow, (2) facing huge amounts of criticism on how they dont properly handle abuse, and (3) expected to keep their reputation of openness still left over from the 'Arab spring'.

It is doubtful that they can survive without sacrificing at least one.

I think they are well on their way to sacrificing 2 and 3.
I agree. Monetization is their goal. It needs to happen to appease investors and the like. We'll have to see how much stink people put up when Twitter compromises on either 2 or 3 here.
Should be "threats of violence" not "violent threats". Since people think anything can be deemed violent nowadays.
I don't get nostalgic for much, but one thing I miss about the earlier internet was everyone's ability to dismiss internet tough-assery as ridiculous, overblown stupidity. I guess that's the difference between a pioneer town and a safe space on a university campus.
I'm particularly sad about the evolution of the word "troll" to mean "anything someone else doesn't like".

The idea of "flamebait" has also completely disappeared, and we've lost the ability to roll our eyes at it.

Most people didn't have to deal with it on a daily basis, and hardly anyone had threats that were deemed credible enough to actually happen.

Sorry, but it's not all ridiculous, overblown stupidity anymore. Some of these people seem stupid enough to actually follow through on their threats.

"Seem" is an interesting word here, as well as the phrase "deemed credible." Both indicate that my point is not being rebutted.

I'm not denying that the scale of the problem has grown to the point that rare events (someone following through on Internet bluster, in this case) will occur. I'm simply remembering a simpler time, when people didn't clamor for the sanitization of their daily Internet lives.

Not wanting to receive threats of violence against you or family members is hardly clamoring for sanitization. Sure, most of those threats aren't actually going to happen but a real human has the stress of having to evaluate each one and hoping they didn't get it wrong.

It's also not as if the only two possibilities are “actual stalker attacks you” and “nothing happens”. SWATing, spamming friends/family/coworker with hateful propaganda or photoshopped porn, placing embarrassing ads with the victim's actual contact info, etc. are all things that happen in the real world and don't require some blowhard to leave their house or risk persecution anywhere near as much as a serious physical attack would entail.

I'm sorry, but I think the phrase "clamor for sanitization of their daily internet lives" is very much undermining the problem of people who are receiving death and rape threats by the ton on a daily basis. And further, I cannot, at all, look down on them for wanting that to go away.
Sorry, but it's not all ridiculous, overblown stupidity anymore. Some of these people seem stupid enough to actually follow through on their threats.

I understand the scariness of receiving such a thing, but is there any evidence to suggest that the person willing to act on such a threat is influenced by (1) inability to send or (2) confirmation of receipt (or lack thereof)?

Separate from that question, how and why is it better than the intended recipient knowing credible threats have been made on their life? When is denying them the agency to decide how to respond to the threats acceptable? Does it accomplish anything but alleviating the mental turmoil associated with understanding the realities of their own life?

Exactly this. It's like the generation today consists of people who forgot to put their big boy clothes on.
The most interesting reveal to me has been the the "verified" flag isn't really a verification at all.
Especially after the removal of verification from noted cultural theorist Milo Yiannopoulos.
Yeah. I don't particularly like the guy, but it's not like he stopped being Milo Yiannopoulos (sadly).
Twitter's rules say they can remove your verified status at any time for violating their ToS. It's pretty obvious that Milo has violated their ToS many, many times, so he's not verified anymore. Don't know what the big deal about that is.
I would say that the big deal is, if that is the policy, then verification does not represent "verification" so much as "you play by the rules"... As has been said elsewhere, just because Milo violated some policies, he didn't stop being Milo.
I play by the rules and I haven't been verified.
"Don't know what the big deal about that is."

Verified was originally sold as twitter saying the account belonged to a verified person or business. We could trust it was that person or organization and not some fake account.

This isn't true anymore and they should rename it to something else. The other part is that their are apparently some advertising requirements associated with verified for businesses.

If he has - and I think he has based on one particular tweet where he said someone 'deserved to be harassed' - then he should be banned or suspended. Not 'unverified'. Not given a link to the ToS without at least one specific incident.

Conversely, the person whose previously doxxed him - also violating the Twitter ToS - should be punished too.

Twitter just need to have a concrete set of rules (objective not subjective) and enforce it consistently regardless of politics or celebrity status.

> based on one particular tweet where he said someone 'deserved to be harassed'

Apparently that tweet was a joke to a friend (another conservative commentator).

Which just illustrates the problem: it's really really hard to regulate speech fairly

I don't agree with everything Milo spouts - but I don't dislike the guy, if only for his honesty (wears his biases openly on his sleeve) and doesn't-give-a-shit attitude.

If he broke their TOS he should be banned. Verification is saying "This person is the person they claim to be." Removing the verification is stupid and petty. Milo didn't stop being Milo.

It's a big deal once you can easily predict who is punished for ToS violations, and who gets to skate, by checking to see who has the right political views and/or friends at Twitter.
Yeah. Twitter needs to be more transparent on how they give those out. There's allegations that they require spending thousands on advertising unless you're a pop culture icon like a Kardashian or something. And what's the point if they can just take it away on a whim?
I think the only feasible way Twitter could stop abuse is if it charged $100 per signup, and then ban people on the slightest whim. I don't see how anything else would work. Of course the downsides of a plan like this are so large that it wouldn't ever be done.
The forum Something Awful does something like this: They charge $10 per signup. When you get banned you have to pay again to get back in.
Even $1 would remove a lot of harassment because a lot of people would be less abusive if thought it would be easier to find them and hold them legally responsible for their comments.
I expect there are plenty of abusive people on Twitter who could afford that $100 several times. There's no particular reason to believe that being abusive on Twitter is correlated with being poor.
I looked up a picture of her and I don't think I want to read it.
I am confused by this statement.
Hopefully nobody shoots the messenger (or in this case, translator):

She has dyed hair which is increasingly becoming a sign of narcissistic Tumblr types. The hair dye is seen as "pay ME attention, I'm a special snowflake!"

This is because the group of people often referred to as SJW's consist of a large majority of women with dyed hair (reds, pinks, blues).

In other words: it has become a stereotype.

Therefore, the other user is making a presumption that due to her dyed hair coupled with the title of her book she is an oversensitive Tumblr-type who isn't worth the time to read.

I tried to keep this explanation as neutral as possible, hope it clears up your confusion.

And also she's written for Vice, The Verge, Forbes, The Guardian, Slate, and WIRED (according to her website). Translation: I expect a very very biased book I'm not interesting in reading.
Well you mentioned her picture, not her history. :) I was just looping them in on why you might say that.

I can see where you're coming from about the extreme bias. Only two missing from that list are Salon and Jezebel, yeesh.

I admit I saw the blog list just when I posted it, it was enough for me to look at the pic to know what to expect ;P
Thank you for the explanation; that makes sense.

I confess that I am still confused why one would go and look up the appearance of an author before making a decision about whether their work is worthwhile (I believe neither of my links included a photo of the author, but did contain reviews). Outright discrimination on appearance has not been a mark of the hacker community as I understand it, and I worry that people who endorse it are outsiders without the cultural norms of the hacker community. So while I now understand what the judgment on her appearance is, I am still a little baffled why any judgment on an author's appearance is necessary.

I am also curious if anyone looked at my appearance (easily linked from my HN profile) before deciding whether to accept my endorsement of that book.

>I am still a little baffled why any judgment on an author's appearance is necessary.

It's being used as a proxy for zealous ideologues. A certain group of ideologues from a certain city all seem to have very similar style. Some people do not enjoy wasting their time reading the work of ideologues.

To illustrate, I'll throw myself under the bus.

If I can read a summary of a book and accurately guess "This came from an author based in San Francisco", I will disregard it entirely. I cannot speak for others, but I know I'm not the only one. There are a few other cities that come to mind, but SF is easily the worst offender. The most extreme and vehement bias festers in that place and it is not worth my time. The people who speak from that place are more similar to a cult-like mentality than individual or innovative thinkers. I don't bother with listening to cults and so I don't listen to people from SF.

Which is unfortunate because I am sure there are a few precious gems that don't tow the party line who may be worth the time to read. The unfortunate bit is I don't have the time to read everything. Part of my decision-making process for whether or not time should be allocated to read something involves assessing the likelihood that the author is so entrenched in their own biases as to make their work a waste of my time. Looking like an ideologue, talking an ideologue's talking point, and coming from a place known for its ideologues are tell-tale signs for me that the person is very likely an ideologue.

I will let others risk wasting their time reading the work. If it gets enough charitable mentions from "outsiders" (those outside of the cult) then I may give it the time of day. Until then I will dismiss it just as some people would dismiss anything from Alex Jones and his ilk.

As for your last statement - there are most likely people who do. And, for what it's worth, I didn't.

(Also take my throwing myself under a bus as a separate talking point than the book recommendation you made. She is not from SF, I'm just illustrating the point about dismissing ideologues based on some small amount of known criteria.)

Has this been downvoted? Why? It's a valid explanation. It's like punishing a nice person for explaining the concept of racism to you.
I don't understand about the scope of this problem, maybe someone can tell me but is it really that big of a deal? What horrible things are being typed out that can't possibly be ignored or dealt with in other ways?
If you're constantly receiving a barrage of horrible, hateful, violent threats, then it becomes really hard to ignore. Some people may have thicker skin than others, but really, no one should have to deal with that. And quite frankly, I see no reason why anyone should be entitled to say those kinds of things on someone else's platform.
I find that hard to believe. Trolls who make threats on the internet (and not simply having differing opinions) typically make up a very small minority so they should be manageable by a small ban list (and if they aren't - what kind of stuff are you spewing out that makes so many people waste their time getting angry with you?)

It sounds more to me like even after getting banned, the minority of trolls can just make new accounts and resume their harassment, so the solution here isn't human intervention but a technical solution to disincentivize trolls from making new accounts.

> and if they aren't - what kind of stuff are you spewing out that makes so many people waste their time getting angry with you?

The Bank of England phased out their £5 notes. English bank notes have portraits of famous people on them. The old note had a woman, the new note had a man. That meant that all English bank notes had portraits of men; there were no women on the notes.

Caroline Criado Perez the Bank of England to reconsider this decision, and asked for a woman to appear on at least one of the notes.

For that she was bombarded with messages. One man was sending about 50 an hour, for about 12 hours, across multiple accounts.

Other people sent fewer tweets, but those tweets were far more menacing.

Here's what the judge said about 2 people who sent threats of rape and murder:

https://www.judiciary.gov.uk/wp-content/uploads/JCO/Document...

> Here there were a series of communications (not just a single one as referred to in the guideline) where extreme language was used and substantial fear was caused.

> Indeed it is hard to imagine more extreme threats (death, rape, and worse [Sorley]) and rape [Nimmo]. The harm is, and (despite what is said on your behalf) must have been intended to be, very high.

> The fact that they were anonymous heightened the fear. The victims had no way of knowing how dangerous the people making the threats were, whether they had just come out of prison, or how to recognise and avoid them if they came across them in public.

And about blocking:

> The messages were posted on a number of different sites, and continued after being blocked and or warned

That is a problem, but that's not one that's solvable through human intervention or policy updates since its more a spam issue then simply harassment.

Services all the time like email have to work to combat spam, this is no different.

> Trolls who make threats on the internet

See this thread:

https://twitter.com/terraloire/status/686591765931921409

With the internet being as central to modern society as it is, instead of simply some USENET servers used by some college kids and bored sysadmins, there isn't really a distinction between "threats on the internet" and "threats" any more. (This is not to say that there's no longer a distinction between "idle threats" and "serious threats", of course, just that whether they're on the internet is not a determiner of them being idle.)

> (and if they aren't - what kind of stuff are you spewing out that makes so many people waste their time getting angry with you?)

"Normal" people get angry when they feel threatened. If you are challenging the status quo, it's not unusual for people who benefit from the status quo to get angry at you. This has been true for all of history, and arguing that you shouldn't upset the supporters of the status quo is quite literally arguing that Twitter should not be a platform for free speech.

It honestly sounds to me like you're approaching this from first principles / intuition, instead of any data (or analyses of data, which exist) about how internet harassment actually works.

> instead of simply some USENET servers used by some college kids and bored sysadmins, there isn't really a distinction between "threats on the internet" and "threats" any more.

The biggest thing that changed is instead of using anonymous handles, people got into the habit of using their personal information. From the link you included, that woman has what I assume is her name, her photo, her city, and her personal website - most of which is likely a gateway for googling more information. On her actual profile, her latest retweet is millennials mansplaining or something, one could say she's basically baiting a group of people she disagrees with, and further down she's calling Ricky Gervais a "whiny baby" (where does that fit under twitters rules?)

If I was spewing that kind of crap about people with my own name beside it, I guess I'd be worried about people finding where I live and harassing me too. It's mind boggling why people do this to themselves.

> It honestly sounds to me like you're approaching this from first principles / intuition, instead of any data (or analyses of data, which exist) about how internet harassment actually works.

It's why I asked. Maybe it's just that I think of the internet the same way I did 15 years ago where nobody online ever needs to know your name, age, sex, height, opinions, political affiliations, favorite food, etc unless you make it so, and when you want to start over with a clean slate, you can just remake internet accounts rather than having some dumb crap you said 10 years ago stick with you forever on google.

This is all legitimate. Unfortunately, we're in a culture -- one might almost call it a status quo, really -- where certain trolling and harassment is renamed "punching up" or "calling out" and is not only permitted but encouraged.

If we genuinely want harassment to stop, the very minimum that's necessary is for all people to be treated equally under the anti-harassment policies. Otherwise, why would those who are defined as valid targets have any investment in the smooth running of our systems? We'll create a permanent enemy and never have a day's peace until the end of time.

"I find that hard to believe."

You're probably not a woman in the tech field on the internet, then.

"and if they aren't - what kind of stuff are you spewing out that makes so many people waste their time getting angry with you?"

Stuff like women should simply be treated equally.

> You're probably not a woman in the tech field on the internet, then.

Can you be sure? You may have just invalidated my own experiences as a woman. Am I obligated to now tell you my gender so you know for sure if you're being misogynist or not? But I guess its okay because I'm an anonymous stranger on the internet and you didn't know I was a woman to give me special treatment? It's a lot to think about.

> Stuff like women should simply be treated equally.

Yes. Women are "stuff".

The biggest issue with the policy (and one which is not really mentioned here) is enforcement. Doesn't really matter what the policies are, if Twitter is very, very loose when it comes to actually enforcing them.

For example, I've seen a few people get banned or suspended because they said something that made a popular user (or in some cases, one a Twitter member of staff agrees with) uncomfortable, whereas someone who supports said staff member's political views or has more followers can get away with murder.

For example, there have been people who said something loosely associated with GamerGate who got suspended until they removed the tweet, whereas certain journalists and media figures could try and falsely accuse their enemies of serious crimes and get in no trouble whatsoever. It was also a certain Twitter employee who got Milo unverified for ridiculous reasons.

Twitter's policy reboot is already worrying, but what it really needs to do is be even handed with its punishments towards those that break the rule. It shouldn't matter if you're a nobody or a celebrity with millions of followers; break the rules, get suspended or banned. It shouldn't matter if your political views align with Twitter staff or not. Same deal.

Twitter needs to examine what it's policy on freedom of speech and stuff is, but then also enforce it equally, however unpopular that may be.

Twitter has also started censoring their search suggestions down the same political lines you mention. You no longer get auto-suggest for #gamergate or any Milo related topics.

Ironically they're also blocking #twittercensorship. You can see for yourself here: https://twitter.com/search-home

As far as I know this change wasn't announced (seems to have rolled out over the weekend in response to the Milo incident). It does not bode well for freedom of speech on Twitter.

Edit: to clarify the results are still there if you manually do the search, but the hashtags are no longer in the search suggestions.