“I was watching the content of deranged psychos in the woods somewhere who don’t have a conscience for the texture or feel of human connection,”
"...If the managers noticed a few minutes of inactivity, they would ping him on workplace messaging tool Slack to ask why he wasn’t working."
The texture of human connection is severely diminished when you are managing what is essentially a drip-fed trauma survivor remotely using a metric of trauma exposure per minute.
> Whisper no longer employs U.S.-based moderators. It uses a team in the Philippines along with machine-learning technology.
Great that they moved the problem to a place with even fewer protections for workers.
The underlying issue is seeing content moderation purely as cost that should be minimized. Taking YouTube Kids for example I'm sure you could sell parents products based around moderated content that educates their children, supports their morals and beliefs etc. i.e. find ways to generate enough income with moderated content to treat people fairly.
Toca Boca tried this with their Toca TV service, but it was discontinued because subscription rates were too low. If anyone could do it it should be them, having proven that it is possible to charge for kids' apps with no in app purchases.
https://tocaboca.com/press-post/toca-tv-update/
> Great that they moved the problem to a place with even fewer protections for workers.
Other big problem with this is the lack of cultural background for doing this.
Only if you belong to a given culture you can understand the subtleties and the cultural tolerance according to each culture.
This is one of the things that should make us think, about how bad is the situation of centralized social networks, when the values of one culture can be arbitrarily imposed into another.
People and cultures in general should have the right to organize according to their own cultural values. So the only right way to do this, at least if its a centrally managed network, is to have native people doing this for each country they have presence for.
If this is too expensive to do it in the beggining .. maybe hire not just cheaper labor, but from countries (cultures) that have good sensibility about foreign cultures, and select the people with talent to understand cultural nuances.
I feel particularlt outraged when according to a given foreign culture, one thing that locally is not a big deal, get censured, and then you think how close we are to the big brother (by the way theres a certain country already going through this path).
But in the western hemisphere, if nothing change, we are slowly consolidating a regime of digital feudalism were corporations are free to dictate rules for our lives.
This sort of stuff at one point was handled by hosting providers. It now seems that the internet is "facebook/google" so it is no wonder they are getting the brunt of this sot of work.
I can tell you back in the day when I worked for Rackshack I never envied the abuse department. They always looked stressed out.
8k post in a day is just too many for one person. Its not about how much work they are doing, its about the content they are subjected to look at and review. To do that you have to actually think about it and make a decision -- and that takes a toll on people -- you don't get to forget.
I am not one for regulation but if there is on place in tech that should be considered for regulation, then I think this is a good place to start.
These workers need paid more, access to therapy and much more time off. I also think there are technical solutions to help ease the work needed, but that cost, and nobody seems to want to pay with human workers left holding the bag. This would also include stricter rules to make filtering easier.
Good job, you guys can put a dancing hotdog on the screen why not use that talent to work and make back-end systems to automate this sort of horrid work away. I know it will be hard, but if NN and deep learning is all cracked up to what keeps being preached then it should be within the realm of possible.
Also, while with the when it comes to the law, I am for the notion that it is okay if 10 bad people get away if it means not falsely convicting 1 good person. However on the internet with regards to what normally amounts to pointless shit that people post on the internet. I am okay with 100 good post being automatically removed it if means 1 bad post is also removed.
If you support bad posts being removed from the internet, do you also support bad text being removed from people's hard drives? What about bad thoughts being removed from people's minds?
It's an enormous leap in logic to go from things removed from public forums to private hard drives, let alone one's mind. The fact that creating boundaries is a difficult and messy business does not mean they're not worth creating, even with the flaws.
You sound like things are in absolutes, black and white, it’s not.
Would you remove child porn off the internet? How about a rape victim’s photos and videos? If you could delete something that would cause people to commit suicide, would you?
Your bizarre, logical, absolutist view of the world is not one the majority of people share. There is a difference between removing the sort of terrible posts that show up on Facebook and thoughts in people's heads. Most people can see the difference. If you can't, I suggest you take some time to consider why other people might see a difference.
> However on the internet with regards to what normally amounts to pointless shit that people post on the internet. I am okay with 100 good post being automatically removed it if means 1 bad post is also removed.
If you don't like Internet then just get off it!
You probably never noticed, but some people have this thing called self-actualization. By removing good posts you step on it with your greasy foot. By removing controversial posts you also step on it. That's a lot of damage that you did to innocent people right here.
We've got to get off HTTP just that people like you never have the chance to step into other people's homes, decide what they can and can't post and view.
>By removing controversial posts you also step on it.
We're not talking about "controversial posts" here. It's perfectly legal to be a Nazi, even if Facebook might prefer you not be a Nazi on their platform.
This is about child abuse material. In no way is that being illegal "controversial".
> Facebook will have 7,500 content reviewers by the end of December, up from 4,500, and it plans to double the number of employees and contractors who handle safety and security issues to 20,000 by the end of 2018.
Seems like the bulk of these roles are contract. "$24/hour" was mentioned in the article. Probably no health benefits. Probably no counseling.
251 working days * 8 hours * $24 = $48,192. Less taxes. Less sick days. Safe to assume these workers aren't all going to work out of the main office in SF.
Seems like Facebook would have to set up some sort of work from home system, like people who transcribe medical records, or some sort of off-shore system, to make this work for workers. But... spreading out the people who do this work is likely to increase security risks that sensitive data will be shared, and reduce workers ability to find comfort with peers.
No way to look at this where automation isn't going to be better.
This definitely seems like a good place for either regulation or unionization.
Unionization would likely be difficult though due to the low barrier of entry for the job - artificial barriers would have to be created by the union and those break down pretty easily due to human factors (see Walmart).
I'm all for regulation in this case. Require that folks who review content for illegal posts be limited in the amount of content they review in a weekday, must have certain benefits like mental health counseling, and get some vacation / sabbatical from the work.
Risks might be reduced innovation in the field, but the big boys like Facebook and Google have already found excellent ways to snuff out their competition within the existing market.
Unionization doesn't work very well when you can trivially outsource the job/task. It'd be necessary to entirely remake the US economy, because you'd have to enable union powers that could directly control all actions by the parent corporation, including setting up overseas / outsourcing.
If those content reviewers are subcontracted out to vendors in the Philippines or India, they'll be earning a lot less than $50k/year. The average call center agent in Manila earns under US$4k.
I am optimistic about human in the middle. I imagine a large grid of small thumbnails and the Google Captcha style "Choose the pictures that are not gruesome" (i.e. differentiating between violence, a video game, and a red scarf). Many reports could be resolved quickly this way. I would be interested in a more proactive solution that is well documented publicly so that we can apply the tech to blogs/news.
>I can tell you back in the day when I worked for Rackshack I never envied the abuse department. They always looked stressed out.
The police normally rotate staff on and off the analyst post every few months.
I was speaking to a detective, saying I was interested in going into digital forensics, and he just plainly said "no, you don't want to do that". He said he knew he'd spent too long on the job when he was walking through a park, saw a father playing with his daughter, and instead of thinking "aww" thought "you sick fucker".
I have, in the course of my career, come across child abuse content. Personally it didn't really bother me - I just didn't think about it and got on with the job of notifying the police, but I can easily see how being exposed to that sort of thing day in day out would really mess with someone's head.
I still remember reading an interview years back with people working at the National Center for Missing and Exploited Children (I think; it was some time ago) whose job was to identify and track exploited children online. The part that's stuck with me was a remark about an infant whose photos kept popping up and didn't match any missing person reports. They gave the child a name at some point, and could only watch as this child literally grew up through child abuse images, year after year, because they didn't have anything to identify him by.
That interview was haunting. I can't imagine how hard it must be, or what kind of toll it takes on you, even if you're able to rotate through to something less stressful after a short period of time.
> Its not about how much work they are doing, its about the content they are subjected to look at and review.
If you'd like to experience this, you can make an experiment yourself. If you're a Twitter/Facebook user, look for a group/account you know will have unacceptable content (it's easy, search for white genocide or similar - there's always something available). Then try to find some things that are actually reportable without the need to explain the reason in more than a few words.
After you find 10, you'll likely find it's mentally exhausting to deal with it / look at that content anymore. On the up side, you'll likely report and remove some amounts.
That might be true. But remember we are talking about people posting in public places like Facebook. I can't imagine that being a smart move, so I am questioning their intelligence.
I'm not sure what you mean by "hpme" - do you mean "home"?
If so, I suspect you're just commenting without basis, and have no actual inkling what this content is really like.
I work for a large internet company, and have to deal with some of this as a tangential part of my role. Trust me, there is stuff that most normal people would never even want to go near. (No, I'm not talking some angry rants, or some naughty pictures).
I'm all for freedom of speech and all - but I have no qualms about this stuff being flagged as inappropriate and put behind a filter. If you really want to find this stuff, you can - there are communities and chat groups trading in it - you wouldn't have much trouble finding it. But I would posit that most people that want this stuff are actively looking for it, versus wanting to see it on their Facebook or Google+ feed.
Abuse departments make their respective platforms better places to be, largely because most people do not want to sift through a flood of angry pro-white propaganda and "jailbait". Just look at the horrendous quality of discourse on Voat. Or worse, 8chan.
So previously you all were talking about filtering child porn, but now you admit the desire to filter out political content you disagree with? That's, like, dramatic reversal.
Not all content. There is a considerable difference between disagreeing about the best policies to reduce healthcare costs and disagreeing about whether white people should violently expel nonwhites from society.
Why is discussing whether to heal a person or let them die is fundamentally different from discussing whether to let person settle or ask them to liberate the premises?
Have to admit I am also mildly offended by your racism.
I would expect that social media websites whose content is largely decided democratically (via votes, shares, or the like) would relegate the majority of this content to a place where it is not seen by many. I would argue that the best way to handle this issue is to let the sites mechanisms deal with the content accordingly and then focus efforts on developing processes that will be able to detect and remove it automatically.
The article implies that they are forcing moderators to view the content at a high clip. Why, so as to get false positives back online as quickly as possible? Maybe moderators should only review content that reaches a certain threshold of complaint, and other content is left as is?
Subreddits are pretty heavily moderated via the "report" buttons. Moderators are basically whatever community member created the community plus the other volunteer users that they picked, and if you have a problem with a subreddit's moderation the usual response is "It's my sub, you can leave."
Reddit recently deleted a whole bunch of subreddits because they decided that wasn’t good enough.
Anecdotally, I know someone who was interested in one of those topics (zoophilia), who thought the subreddit in question was “a dumpster fire” yet was still upset about it being banned.
If you have voting and subreddits you’d just end up with a community that only upvotes what they think is the best child porn (ie: Reddit’s jailbait subreddits)
Right, but that content doesn't seem to escape that specific subreddit (Or if it does, it is quickly voted down to oblivion). So in the context of moderators having to view objectionable content all day it is either content they don't mind viewing, or neatly packaged so it can be banned entirely if it is illegal.
Why are we surprised or shocked? Hasn't society always used servants, police, soldiers, miners, loggers, garbage men, wardens, and such to do tasks that the rest of us are loath to do, and to keep certain stuff away from 'civilised' society?
Why would online be different suddenly? Analogues of all the above are needed online too. And somebody who has no other option will be unfortunate enough to fill these roles.
Because you don't have to look at anything you don't want. Because it's not bounded by physical space limitations, so everyone can have as much "space" as they want. Because you can travel from any point to any other point almost instantaneously. Because you can be in as many different places simultaneously as you have the capacity to keep track of. Because you can come and go as you please without anyone else even knowing.
We are not surprised or shocked. This topic was also reported before, and the article is just about not adequate protections of those workers. Someone must do this work, until AI will be able to filter out everything, but those companies are rich enough to take better care of those workers. That's all.
The internet really is an incredible cesspool. It would be interesting to see how the public reacted if YouTube and Facebook turned off their content moderation for a week. It would make the goatse meme look like a Sunday school picnic.
Yes, but really, humanity is the incredible cesspool. Facebook is just mirror.
The interesting thing is that instead of trying to prosecute the criminals behind this content we would rather just censor it so we can pretend it doesn't exist.
South Park did an episode on this. Where everyone was so afraid of "reality" they elected someone to censor it all and keep their tweets only positive.
Butters had to see every depraved thing. And he ended up trying to kill himself.
And in the end, when he almost died, they blamed him for failing to be the perfect filter.
Facebook is a private company and it has the right to regulate speech in its digital properties (at least it seems the case in the US). You also are not bound to it, theoretically, so you can go elsewhere and say what you wanna say. I write theoretically because Facebook is so pervasive where I live that we cannot simply ignore it.
Social media platforms are owned by privately held companies. Their moderation is up to their discretion. Sure there's a larger conversation about their ubiquity and how social media posts relate to free speech, but as things work now in the US, Facebook isn't breaking any rules by censoring anything for the most part.
If you want to collect pictures of horrible crap and start a website, as long as it's not illegal you can host it on your own.
The real problem is not that such content exists, the problem is that Facebook makes it horrifically easy to distribute such content. Back when Facebook was more of interacting with people rather that liking and subscribing to whatever these content and joke pages shoved down these concerns where not present much. Clickbait, etc is just a natural progression of like and subscribing culture.
My Facebook feed about a year ago, when i last opened facebook was filled with the same memes and "inspirational messages" shoved down by a handful of pages being shared by dumb idiots. I had to search and go directly to a person's profile to see what they were up to.
The real problem is that Facebook started behaving like a TV channel that a social network.
If Facebook goes to only keeping profiles of real persons and removes any and all of these pages and blogs and news agencies and the lot, a lot of its woes with regard to content will be solved.
These pages give a sense of anonymity to the people behind them. Take that anonymity away. Once you know that your personal image will be directly tied to whatever you post and held responsible by everyone in your friend list, you will begin to curb your tendencies in public.
I believe that the "one account = one real person" policy actually makes things worse.
Regardless of what Zuckerberg claims to believe, in real life I have multiple "profiles". For example, I don't debate Java programming with my family members, I don't debate politics or religion (or generally any opinions, because no one knows what will become a hot political topic tomorrow) with my colleagues, etc.
Similarly, I have different rules for reading stuff. I hate memes, but if my cousins post some, I am not going to block them like I would most other people; I will just sigh and scroll down. More importantly, I do not want to read stuff from all my social circles at the same times; sometimes I am in a mood for family stuff, sometimes programming, sometimes other things.
Even better would be to have advanced tools (but with simple user interface) to specify what I want to read; e.g. "what my cousin wrote, but not what someone else wrote and my cousin shared"; to filter posts containing certain words, etc.
Merely removing anonymity will simply divide users into two groups: those who care about not getting fired tomorrow so they only post completely unobjectionable politically correct vanilla stuff, or those who are not very smart or young and inexperienced or too rich to care about what other people think, so they post anything that comes to their minds.
One of our team members used to do this job; luckily, she managed to do it with deep learning, so didn't have to spend too much time looking at unpleasant images.
This experience is one of the main drivers that pushes our team to develop an open, nonprofit conversation platform on which harrassment is difficult by design.
In the very early days of the internet being used at a very large corporation, I had the task of reviewing proxy logs to monitor what was euphemistically called "non-business use of the internet". I started by scanning for URLs with "XXX" in them, then pivoted to make a more extensive list.
I never looked at the content itself. Just the seeing the URLs was corrosive enough.
71 comments
[ 4.4 ms ] story [ 156 ms ] thread“I was watching the content of deranged psychos in the woods somewhere who don’t have a conscience for the texture or feel of human connection,”
"...If the managers noticed a few minutes of inactivity, they would ping him on workplace messaging tool Slack to ask why he wasn’t working."
The texture of human connection is severely diminished when you are managing what is essentially a drip-fed trauma survivor remotely using a metric of trauma exposure per minute.
> Whisper no longer employs U.S.-based moderators. It uses a team in the Philippines along with machine-learning technology.
Great that they moved the problem to a place with even fewer protections for workers.
The underlying issue is seeing content moderation purely as cost that should be minimized. Taking YouTube Kids for example I'm sure you could sell parents products based around moderated content that educates their children, supports their morals and beliefs etc. i.e. find ways to generate enough income with moderated content to treat people fairly.
Are you saying such workers are better off without these jobs?
Other big problem with this is the lack of cultural background for doing this.
Only if you belong to a given culture you can understand the subtleties and the cultural tolerance according to each culture.
This is one of the things that should make us think, about how bad is the situation of centralized social networks, when the values of one culture can be arbitrarily imposed into another.
People and cultures in general should have the right to organize according to their own cultural values. So the only right way to do this, at least if its a centrally managed network, is to have native people doing this for each country they have presence for.
If this is too expensive to do it in the beggining .. maybe hire not just cheaper labor, but from countries (cultures) that have good sensibility about foreign cultures, and select the people with talent to understand cultural nuances.
I feel particularlt outraged when according to a given foreign culture, one thing that locally is not a big deal, get censured, and then you think how close we are to the big brother (by the way theres a certain country already going through this path).
But in the western hemisphere, if nothing change, we are slowly consolidating a regime of digital feudalism were corporations are free to dictate rules for our lives.
I can tell you back in the day when I worked for Rackshack I never envied the abuse department. They always looked stressed out.
8k post in a day is just too many for one person. Its not about how much work they are doing, its about the content they are subjected to look at and review. To do that you have to actually think about it and make a decision -- and that takes a toll on people -- you don't get to forget.
I am not one for regulation but if there is on place in tech that should be considered for regulation, then I think this is a good place to start.
These workers need paid more, access to therapy and much more time off. I also think there are technical solutions to help ease the work needed, but that cost, and nobody seems to want to pay with human workers left holding the bag. This would also include stricter rules to make filtering easier.
Good job, you guys can put a dancing hotdog on the screen why not use that talent to work and make back-end systems to automate this sort of horrid work away. I know it will be hard, but if NN and deep learning is all cracked up to what keeps being preached then it should be within the realm of possible.
Also, while with the when it comes to the law, I am for the notion that it is okay if 10 bad people get away if it means not falsely convicting 1 good person. However on the internet with regards to what normally amounts to pointless shit that people post on the internet. I am okay with 100 good post being automatically removed it if means 1 bad post is also removed.
Why? Posts on the internet are pure data. I'm okay with no posts ever being removed.
IRL analogy: the dog shit that my neighbor throws onto the sidewalk is pure matter. Just atoms and molecules and such. Should it not be removed?
EDIT: Not that I agree with the 100 sacrificial removals for each good one. I don't. But the "pure data" argument doesn't work for me.
Would you remove child porn off the internet? How about a rape victim’s photos and videos? If you could delete something that would cause people to commit suicide, would you?
The platforms are in a tricky position, but I agree this job should pay more with perhaps some regulatory oversight.
If you don't like Internet then just get off it!
You probably never noticed, but some people have this thing called self-actualization. By removing good posts you step on it with your greasy foot. By removing controversial posts you also step on it. That's a lot of damage that you did to innocent people right here.
We've got to get off HTTP just that people like you never have the chance to step into other people's homes, decide what they can and can't post and view.
We're talkng about images of children being raped.
We're not talking about "controversial posts" here. It's perfectly legal to be a Nazi, even if Facebook might prefer you not be a Nazi on their platform.
This is about child abuse material. In no way is that being illegal "controversial".
Seems like the bulk of these roles are contract. "$24/hour" was mentioned in the article. Probably no health benefits. Probably no counseling.
251 working days * 8 hours * $24 = $48,192. Less taxes. Less sick days. Safe to assume these workers aren't all going to work out of the main office in SF.
Seems like Facebook would have to set up some sort of work from home system, like people who transcribe medical records, or some sort of off-shore system, to make this work for workers. But... spreading out the people who do this work is likely to increase security risks that sensitive data will be shared, and reduce workers ability to find comfort with peers.
No way to look at this where automation isn't going to be better.
Unionization would likely be difficult though due to the low barrier of entry for the job - artificial barriers would have to be created by the union and those break down pretty easily due to human factors (see Walmart).
I'm all for regulation in this case. Require that folks who review content for illegal posts be limited in the amount of content they review in a weekday, must have certain benefits like mental health counseling, and get some vacation / sabbatical from the work.
Risks might be reduced innovation in the field, but the big boys like Facebook and Google have already found excellent ways to snuff out their competition within the existing market.
The police normally rotate staff on and off the analyst post every few months.
I was speaking to a detective, saying I was interested in going into digital forensics, and he just plainly said "no, you don't want to do that". He said he knew he'd spent too long on the job when he was walking through a park, saw a father playing with his daughter, and instead of thinking "aww" thought "you sick fucker".
I have, in the course of my career, come across child abuse content. Personally it didn't really bother me - I just didn't think about it and got on with the job of notifying the police, but I can easily see how being exposed to that sort of thing day in day out would really mess with someone's head.
That interview was haunting. I can't imagine how hard it must be, or what kind of toll it takes on you, even if you're able to rotate through to something less stressful after a short period of time.
If you'd like to experience this, you can make an experiment yourself. If you're a Twitter/Facebook user, look for a group/account you know will have unacceptable content (it's easy, search for white genocide or similar - there's always something available). Then try to find some things that are actually reportable without the need to explain the reason in more than a few words.
After you find 10, you'll likely find it's mentally exhausting to deal with it / look at that content anymore. On the up side, you'll likely report and remove some amounts.
If so, I suspect you're just commenting without basis, and have no actual inkling what this content is really like.
I work for a large internet company, and have to deal with some of this as a tangential part of my role. Trust me, there is stuff that most normal people would never even want to go near. (No, I'm not talking some angry rants, or some naughty pictures).
I'm all for freedom of speech and all - but I have no qualms about this stuff being flagged as inappropriate and put behind a filter. If you really want to find this stuff, you can - there are communities and chat groups trading in it - you wouldn't have much trouble finding it. But I would posit that most people that want this stuff are actively looking for it, versus wanting to see it on their Facebook or Google+ feed.
Why is discussing whether to heal a person or let them die is fundamentally different from discussing whether to let person settle or ask them to liberate the premises?
Have to admit I am also mildly offended by your racism.
The article implies that they are forcing moderators to view the content at a high clip. Why, so as to get false positives back online as quickly as possible? Maybe moderators should only review content that reaches a certain threshold of complaint, and other content is left as is?
I'm not sure how that would work for facebook.
Anecdotally, I know someone who was interested in one of those topics (zoophilia), who thought the subreddit in question was “a dumpster fire” yet was still upset about it being banned.
Why would online be different suddenly? Analogues of all the above are needed online too. And somebody who has no other option will be unfortunate enough to fill these roles.
Because you don't have to look at anything you don't want. Because it's not bounded by physical space limitations, so everyone can have as much "space" as they want. Because you can travel from any point to any other point almost instantaneously. Because you can be in as many different places simultaneously as you have the capacity to keep track of. Because you can come and go as you please without anyone else even knowing.
The internet is nothing like the physical world.
The interesting thing is that instead of trying to prosecute the criminals behind this content we would rather just censor it so we can pretend it doesn't exist.
Butters had to see every depraved thing. And he ended up trying to kill himself.
And in the end, when he almost died, they blamed him for failing to be the perfect filter.
http://www.esquire.com/entertainment/tv/videos/a39070/south-...
Its 1984 all over.
Im not an anarchist however, if something is illegal then go ahead and cut it but, censoring without a legal cause is a crime.
If you want to collect pictures of horrible crap and start a website, as long as it's not illegal you can host it on your own.
My Facebook feed about a year ago, when i last opened facebook was filled with the same memes and "inspirational messages" shoved down by a handful of pages being shared by dumb idiots. I had to search and go directly to a person's profile to see what they were up to.
The real problem is that Facebook started behaving like a TV channel that a social network.
If Facebook goes to only keeping profiles of real persons and removes any and all of these pages and blogs and news agencies and the lot, a lot of its woes with regard to content will be solved.
These pages give a sense of anonymity to the people behind them. Take that anonymity away. Once you know that your personal image will be directly tied to whatever you post and held responsible by everyone in your friend list, you will begin to curb your tendencies in public.
Regardless of what Zuckerberg claims to believe, in real life I have multiple "profiles". For example, I don't debate Java programming with my family members, I don't debate politics or religion (or generally any opinions, because no one knows what will become a hot political topic tomorrow) with my colleagues, etc.
Similarly, I have different rules for reading stuff. I hate memes, but if my cousins post some, I am not going to block them like I would most other people; I will just sigh and scroll down. More importantly, I do not want to read stuff from all my social circles at the same times; sometimes I am in a mood for family stuff, sometimes programming, sometimes other things.
Even better would be to have advanced tools (but with simple user interface) to specify what I want to read; e.g. "what my cousin wrote, but not what someone else wrote and my cousin shared"; to filter posts containing certain words, etc.
Merely removing anonymity will simply divide users into two groups: those who care about not getting fired tomorrow so they only post completely unobjectionable politically correct vanilla stuff, or those who are not very smart or young and inexperienced or too rich to care about what other people think, so they post anything that comes to their minds.
This experience is one of the main drivers that pushes our team to develop an open, nonprofit conversation platform on which harrassment is difficult by design.
www.hellolyra.com/introduction
I never looked at the content itself. Just the seeing the URLs was corrosive enough.
Also interesting, they already have an API for doing this sort of classification: https://perspectiveapi.com/