> A step back to assert human control -- even if it cuts into the tech companies wide profit margins -- is overdue indeed.
The author seems to think these problems cannot be solved with technology. Maybe they think that, or else Facebook, Twitter, et. al., would have solved it already?
I think that it is far more likely that our society directly incentivizes the companies to not solve the problems. That is why they are not solved. Because we lavish them with money to leave them unsolved.
Legislate that political news must be regulated. Legislate that companies that exert social control over a population, like Facebook, must do so responsibly. Don't just tell them that humans must curate all content. That won't work. Humans are too expensive and corruptible anyway. The solution is structural in society just as the problem is. Take away the profit incentive for big tech firms to cheat and feed lies, and our society will improve directly in line with what the author probably wants.
> Legislate that political news must be regulated.
This is not as simple as it sounds, of course, because the regulators would also have plenty of incentives for bad behavior.
I actually think that government regulation can be tremendously useful in certain circumstances. But it's not a magic solution, and you have to be clever about it. In the particular case of political news, the potential downsides of giving too much power to regulators are at least as dangerous as giving too much power to Facebook or Google.
>Legislate that companies that exert social control over a population
So what you're saying in our current political climate is "Change the rule of web based business every 4 to 8 years dependant on who gets elected"?
In the US we already know this doesn't work out because "big tech firms" will just buy the lobbying they need to get what they want. At best we can put some bandaids on the internet, at worst we're making it some kind of authoritarian nightmare depending on whatever companies get to enforce contracts based on the law.
> Legislate that political news must be regulated.
In what way? Establishing fact-checking institutions or empowering the FCC to fine broadcasting of false political speech? Or with libel laws to allow people to sue for false allegations easier?
> Legislate that companies that exert social control over a population, like Facebook, must do so responsibly
In what way? Who what agency determines what is a responsible way to "exert social control over a population"?
Do we need to be reminded that these are opt-in services where you agree to a ream of terms before being allowed to use the service?
At which point does an online service go from being simply a place for people to interact to a company that needs regulating? Does HN qualify or do you need XXX million active users?
Legislation should be a last resort since it is so easily circumvented (see tax code) and unfairly applied (see criminal code, specifically the section on drugs).
Perhaps the author does not understand the logistical nightmare of having human moderators manually approve all content.
Further, the fact that YouTube, Facebook, et al. Have failed to police content to the author's satisfaction is not indicative of a failure in AI - especially when these corporations are effectively incentivized by view counts and advertisement not to remove these videos.
In short, YouTube's failure is not a valid indicator of the effecticeness of AI in general.
I don't think the author cares about the logistics of it, nor should he. If you offer me a service, it's up to you to figure out how to provide that service. If doing so is a logistical nightmare, then you're failing uphold your end of the bargain. No one is forcing YouTube to market a kid's channel.
As to whether today's AI is up to the task, I think it's fairly hard to say definitively. It seems certain that we haven't yet fielded a system that does it very well though.
> Perhaps the author does not understand the logistical nightmare of having human moderators manually approve all content.
Pretty sure he does, from the OP:
> A step back to assert human control -- even if it cuts into the tech companies wide profit margins -- is overdue indeed.
The tech companies use these algorithms because they're cheap and they're good-enough for their profit-making purposes. If Google's algorithms can't keep YouTube Kids kid-friendly, then they need to hire the human moderators to make up the difference or kill the product (because it's false advertising).
Your post history would suggest you're a troll, so I'm downvoting this comment, but additionally, you're mingling a bunch of complicated ideas and prescribing a broad generalization.
We live in a market-driven society, people are free to choose to consume what they want to consume (as you point out) but that doesn't give carte blanche to the producers in the marketplace to do whatever they want in the name of ad revenue. When it does reach a tipping point, as I think we're seeing with this Medium article, regulation will start to come to a niche industry that had previously operated under the radar. Especially when human health consequences are involved, the government steps in to ensure protection to its citizens (and its most vulnerable members, children).
If you really are upset that you won't be able to view algorithmically generated children's cartoon videos stuffed with tropes and keywords that exist for no other purpose than to make money, I'm concerned for your wellbeing.
I'd rather the elected government do it rather than an unaccountable multinational corporation. What do you think "relevance" algorithms are other than some company determining what is good for us and what is not?
Edit: P.S. Where was the personal responsibility of Facebook after they were caught peddling propaganda placed by foreign actors? As I recall it took a lot of arm twisting to get them to admit there was even an issue.
The difference is choice. Companies can offer whatever they want and it's up to me to decide whether I consume their products and services or not.
Government on the other hand makes the decision and forces it on everyone. Not just those who elected it, everyone.
Edit: as for the foreign propaganda, how many nations and what interests were/are they peddling? If it's already illegal then sure, it should be forbidden from the network. If it's not, then I'm fine with it.
> The difference is choice. Companies can offer whatever they want and it's up to me to decide whether I consume their products and services or not.
Please, tell me how I can escape Google? God knows I've tried - I have a Fastmail email account, I use DDG, and I stick to Apple hardware. That doesn't change the fact >90% of advertising I see on the open web is still "suggested" for me by Google's algorithms, that my employer uses Google Apps and Google Drive for just about everything, that many links I encounter on social networks are AMP, and that most of time I need to verify I'm not a bot I'm filling in a recaptcha.
Saying I have a choice not to use Google is only true in the academic sense. It's theoretically possible, but not without extreme effort and probably not without finding a career outside of the tech industry.
I'm fairly anti-authoritarian, but there's a difference between "The neighbor is making noise, so close your windows" and "The neighbor is making noise so close your windows and install double-framed exterior walls"
We have gotten to the point where even reasonably conscientious and responsible adults have trouble raising their children. When the advertisers make money by making it a harder world to raise children in, they are externalizing their costs and internalizing the profits.
Some amount of externalities we allow due to pragmatism (the cost of enforcing the regulation is greater than the benefits), but when the line is crossed, some sort of regulation is required.
It is a reasonable policy question to ask where the line is drawn, and what sort of regulation (on the extereme authoritarian side, it is drawn very close and uses criminal law, on the extreme libertarian side, it's drawn less close and might use tort law), but outside of pure anarchy, it's not reasonable to say the line need not be drawn.
Serious question: What kind of speech is being censored here? There is no conceivable message behind these videos, it's a cash grab, that is the point of the article.
The videos in question would still exist on YouTube, even if they would be banned from YouTube Kids. I don't see how that could possibly infringe on anyone's free speech. Free speech doesn't mean that you have the right to broadcast all of your creations to children without anyone stepping in.
Maybe the author is right - we can't rely on YouTube, Facebook, and AI to police these things, maybe it is the job of the parents to control what our kids see and hear.
There are thousands upon thousands of rendered, cartoon, and live-action videos featuring popular childrens characters like Spider-Man and Elsa that have extremely disturbing themes dealing with punishment, handcuffing/restraint, dismemberment, injections, bodily waste, etc. It seems like they get more and more unusual as autoplay goes on. As a parent they are extremely unnerving and I'll certainly never let young children watch youtube unattended and I warn every parent I know about them.
There are places for curated content and there are content bazaars. YouTube Autoplay is a bazaar. Facebook is a bazaar. Recognize where you are, the motivations of those putting things in front of you and your family, and act accordingly.
Yes, Youtube is a bazaar. But why is _Youtube Kids_ a bazaar? Its whole appeal is that it is (at first impression) a place for curated content, such that it's kid-friendly. But it doesn't work (eg https://www.nytimes.com/2017/11/04/business/media/youtube-ki...) because google is trying to create a curated content zone by algorithm.
The real question is: "Can an algorithm identify child-friendly content?" The answer is currently unknown. Families are basically the "beta testers" of the algorithms in question, but the downsides of that approach, like exposing kids to really disturbing content, are horrifying.
Marketing your product as kid-friendly and then demonstrably exposing children to abusive content, through “algorithmic negligence” or otherwise, should incur serious penalty.
It never ceases to amaze that the kind of psychological engineering these companies engage in is outside the bounds of any established ethics, but somehow they escape unscathed because money.
Child-friendly isn't even a well-defined objective category; different parents will disagree violently (sometimes, quite literally) over what is appropriate.
That's exactly it. The whole point of YTK was to protect our kids from the fire hose and provide a trusted safe space. About a year ago it was. Our son was watching Blippi and videos about banana slugs. We deleted the app once we saw the dark shit slipping in there and it was clear YouTube was not acting to address it.
I was surprised to read those posts re: YouTube Kids. My daughter has watched a few thousand hours of YT Kids over the last two years while she's been bed-ridden with leukemia. My wife or I have been within earshot for almost all of it. 99% of what she watched was human made content and the most risque thing she saw was a video where a "host" pretended to make some stuffed animal poop gumballs. A good chunk was actually educational—she went on a kick learning how to make healthy smoothies and learning about the solar system, state capitols, etc. Perhaps we've just been extraordinarily lucky, but the reporting re: TY Kids this week reminds me of the 1980s panic around Dungeons and Dragons.
Is there any reliable body of evidence about what happens to children if they watch content that their parents find unnerving? Do they become sociopaths? Drug addicts? Neurotics? Criminals? Is there any real need for controlling what a child can see and what he can not?
I don't think you are familiar with the content. As a parent, I am. We've reported them to YT and they don't act. These are videos that pretend to be about spiderman or peppa pig but involve blood, violence, sexual themes, dismemberment, etc. I understand what you are asking but it's irrelevant here, this isn't an intellectual exercise where we decide "hey, this isn't so bad after all."
Sounds like Robot Chicken. Fortunately Cartoon Network firewalls off Adult Swim with an hour or so of King of the Hill or other bland, boring material.
I typically only watch Cartoon Network when I'm traveling for work and I only wish it was King of the Hill. They use Family Guy as a firewall and it's fucking interminable, I keep flipping back hoping it's come around to Robot Chicken or whatever but it's always more goddamn Family Guy.
No, Robot Chicken is a show that's intended for an adult audience and intended to amuse adults.
This garbage on YouTube Kids is aimed at getting children to watch it and intended to be disturbing to children. The titles say things like "educational, learn numbers" and the channels are called stuff like "Kids TV."
How old are your kids? My daughter is four and for the last two years has watched a few thousand hours of YT Kids while battling cancer. We've had nothing but good experiences. The toy uboxing videos have created friction in so far as she wants to buy a lot of the toys she sees demonstrated, but beyond that the worst thing we've seen are a few scatalogical references surrounding diaper changes and other fairly normal toddler fare.
I've been confused reading all these stories about YT Kids, how do the kids even get to this stuff? The obvious search terms are banned by the app, but how deep down the rabbit hole does one have to go?
Shouldn't you be covering up your electrical outlets if you have small children anyway, and not counting on security through obscurity? Small children have a knack for sticking forks or other hazardous objects in electrical outlets whether or not they've seen someone else do it.
(Come to think of it, college is when you really have to worry about your kids frying themselves because they saw something cool on the Internet. At that point, you've let your guard down and assume you don't need to babyproof. But I distinctly remember being sad that I'd missed the exploding wires demonstration in physics class and deciding to replicate it myself with a frayed Ethernet cable in my dorm room...that could've gone very badly. And my friend electrocuted himself trying to get pirated satellite with a board he'd bought off the Internet and a dish we self-installed on the dorm roof.)
So, then, you'll be providing your children for testing, to be sorted into the <likely traumatizing content> group?
For some things, the potential hazards (in this case, lifelong desensitization to, or increased propensity to violence) so drastically exceed the potential benefits (in this case, a bit more profit and less work for Google), that we should proceed with the precautionary principle, rather than just saying "F-it, show em whatever, we don't yet have proof that it's bad".
Calm down, take a deep breath. There's no reason to get so bent out of shape over someone merely asking for a little evidence. The parent poster has already gotten plenty of replies like yours.
Nope, just observing a bunch of people making claims about "what content kids should watch" unconnected with facts or evidence, and then getting VERY defensive when this is pointed out.
When you join a conversation and nobody takes you seriously, maybe it is because everyone else in the conversation has a common understanding. In this case, everyone else in the conversation understands child development and the potential of these videos to cause trauma. It's not on us to prove it to you. Go do some research.
(the lead says the ad was banned; his section says it was voluntarily pulled. Either way it could have been banned: any system of media rating (eg advertising standards or BBFC) include imitatable violence.
Seeing some guy get folded in half in Disney's movie The Rocketeer was traumatic enough for me, and I was ~13. Not to mention melting the shoe in Who Framed Roger Rabbit.
It's hard to tell what will or won't deeply affect a child and even harder to gauge the specific ages where things might become appropriate. It's really per-child, and no matter how well a parent does gauging that, mistakes will be made.
There's no way this can be automated, as it's never going to be one-size-fits-all. The combination of generally sanitized media channel + parental supervision will (and should) endure, IMO.
That evidence would be nice. It would also be nice to know exactly how many kids have even been exposed to this stuff. The NYT story is one parent's anecdote. The Medium post linked to some videos that aren't actually in the YT kids app. Many of the questionable parts of the videos were 10+ minutes in, which doesn't excuse them, but knowing about the dropoff rate of online video, many hopefully dodged the worst content.
Well on the one hand, I saw the South Park film in fourth grade and grew up fairly vanilla about sex and violence. On the other hand, if I'd been able to watch livestreams of ISIS burning people to death when I was a kid, that would probably have traumatized me with raw fear.
I suppose that depends partially on how closely things that unnerve the parents are correlated with things that will traumatize the children, or influence them to emulate undesirable behaviors.
And I don't think a parent's discomfort is sufficient, either. There were things that I watched as a child, with my parents' knowledge, that I still consider to have caused me trauma.
In essence you have parents vs the best funded organizations in the world, packed with PhDs working full time to grab all our attention, children being the most susceptible. The only advantage parents is physical proximity. Disadvantages include lack of time, knowledge, awareness etc. I'm not betting on parents winning
I'm not sure why this was downvoted. This same debate has taken place with every medium so far and the same inane point - "it's up to the parents" - was raised for TV, video games, etc.
Yes, it's up to the parents. But unless you have time to pre-screen every minute of content your kids watch (hint: if you have a job, you don't have time to do this), at some point you have to trust a ratings agency like MPAA, ESRB, or a company like Google when they say - "this content here, it's safe for kids". The obvious problem is that YouTube Kids is utterly failing at this.
What's the realistic alternative? Watching hours upon hours of kids content on YouTube and creating your own playlists? How do you stop a child from going to a "recommended video" afterwards? What about ad content, how do you filter that?
Edit: The only realistic alternative is not letting kids watch YouTube. This is fine, but then maybe Google should not be advertising a section of YouTube as "for kids".
In Sweden we have some commercial free television channels that are run by the state. It also has play services for all content. One of the play services is "the children's channel" which has something like 100 curated kid's shows (from all over the world). No commercials. My kids can watch whatever shows they like there and it feels safe.
Is there anything similar in the US?
> But unless you have time to pre-screen every minute of content your kids watch (hint: if you have a job, you don't have time to do this)
...
> Watching hours upon hours of kids content on YouTube
I would argue that if your kids are watching so much of this stuff that you don't have time to monitor it, they're watching way too much of it. "Hours upon hours" is definitely way too much.
Your kids will survive even if they're not plugged in to streaming media 24/7/365. Really.
I noted elsewhere that Neal Stephenson wrote about this in Diamond Age, way back -- tech like this is not a substitute for parenting.
In the past few years, I've been learning intensely about communities and family: got married and learning to be a step-father. I am also involved in a legal-tech startup and got to hear how lawyers think about governance and law. I don't think social media is a substitute for community either, although it can be beneficial _if_ used within the context of community.
Here are some of the things I learned:
- There is a tension between global and local concerns. Neither alone can address everything. Local concerns -- communities -- have people living there. They have a stake in their local environment. There are issues when people outside of a community (people without stakes within the community, who are not residents) try to influence things. This could be anything from coordinating regional concerns (such as people building upscale neighborhoods in a flood control area built by the Army Corp of Engineers in Houston), or outside investors holding municipal bonds.
- I discovered Christopher Alexander's work on pattern languages and designs. I found his keynote to the OOPSLA '96 conference. His work inspired the design patterns of OOP as well as Human Interface Design, but I don't think his vision and philosophy was ever fully implemented. His life's work somehow addresses how to design for both global and local concerns. The idea is that architects develop pattern languages that will always result in cohesive, livable designs (global), and the actual users of that pattern language are the people who live within that community (local). Although this is primarily focused on building design, I think it has some overlap with governance. Physical environment will shape and influence how people interact with each other.
- There are people who are isolated because they don't fit with their local community's norm. Allowing them to connect with other people around the world is great. However, I think it is important for a person's psychological health to have some connection with their local neighbors.
- My wife and I tried allowing my step-daughter to have a smart phone, mainly so we can reach her in an emergency. She quickly found ways to become absorbed into it, neglecting her responsibilities to the family and our expectations for her as parents. We tried using more tech to restrict it. She got around them -- claims innocence (and to this day, I don't really know whether she was or not). In the end, we got her a flip phone. She called a "granny phone", and we blocked calls and texts at the carrier level. She doesn't have her own tablet or computer anymore: we have family devices that are kept in the family office and she is forbidden to take it in her room. (Where she still sometimes sneaks it to bed and stays up all night watching youtube videos).
- My wife told my daughter that she had to be at least 13 to get on social media, and she is forbidden from it. That was half a year ago. I had always wanted to get my daughter to _earn_ her smartphone (and by extension, social media) through some sort of modern-day rite of passage. But over the months, I am more and more inclined to forbid her from social media until she graduates high school.
This is a complex issue but I'm inclined to agree with you. Giving Facebook/Youtube the responsibility to censor content feels dangerous with the amount of influence they have.
I know it's the "think of the children" thing, but I hope Youtube sees the outrage about these spammy kids channels and does something so they aren't suggested and autoplayed. To me that's a special case. Grown adults who see fake news on Facebook and take it as the truth regularly.. Is that really on Facebook to fix that?
"Anyone who has ever given an iPad to a small kid knows the kind of thing children find on YouTube before they're able to type: Toy unboxing and nursery rhyme videos, official and pirated cartoons featuring popular characters like Peppa Pig. It's up to parents, of course, if they are okay with their child getting engrossed in these (we took the iPad away from our four-year-old daughter because we noticed consuming the content made her reluctant to learn to read and irritable when the tablet wasn't within reach). But the stuff Bridle found was arguably worse than what I'd seen before my wife and I made the decision."
Something Neal Stephenson remarked in Diamond Age: this kind of tech is not a substitute for parenting.
The assumption in all articles of this variety is that media consumers are either incapable of or not motivated to evaluate the veracity of content placed in front of them. This, rather than the ethics of 'media company X' seems to be the issue worth considering.
No, it's not. The author used the blog post as supplementary material, but like Steve Jobs the author also had the common sense to take away his child's access to electronic devices for reasons outside of the content. More generally, when somebody is too young to consent to something - the decision their rests with the parent. As the author alludes to, this is mostly done just to silence the kids up rather than enrich their development. I think the content here is far less concerning than this increasingly common 'tablet-babysitter' behavior.
>YouTube Kids has tons of fun and educational videos that are just right for kids. There’s also a whole bunch of parental controls that let you create an experience that’s just right for your family.
>CONTENT ON YOUTUBE KIDS
>Our app is designed to filter out inappropriate videos for kids, but no system is perfect. If a video that’s inappropriate shows up, you have the power to block it, flag it, and bring it to our attention for fast review.
So, it attempts to be "right for kids" and "filter out inappropriate videos". Is that working? I'm not quite sure.
This essay[1] by James Bridle points out that YouTube Kids' algorithmic filtering is failing. Thousands (millions maybe) of videos are uploaded containing violent and disturbing imagery and tailored to match the search inputs of children. The entire article is quite interesting.
The linked article and NYT report would really benefit from some statistical reinforcement. Some of the videos that the two posts show are indeed disturbing, but how many of these are there actually? Bridle's point was almost more aesthetic, pointing out the crudity of animation which is a widespread problem.
That said there is a MASSIVE difference in a poorly animated earworm like the "Finger Family Song" and Chase from Paw Patrol being decapitated in a strip club, which is a rarity.
It has also been repeatedly pointed out that the YTube reporting system to takedown inappropriate content consistently fails.
Plausible scenario is that it fails is that they assign a few human reviewers, and set the threshold of reports required so that those humans aren't overworked. Then they make the erroneous assumption that their staffing for the task is adequate and that items falling below the reporting threshold must be fine. Wrong.'
Sort of like complaining that romance novels provide an inaccurate model of human relationships...
Social media (even YouTube) is mostly intended to entertain. If it turns out to be bad at other stuff, well, that just means we have to create systems that are. Super popular web sites are not going to be any more socially constructive than the sort of magazines you find at the checkout aisle of a grocery store. Nothing has really changed here.
I’m repeating much of what I wrote on a previous thread about the same topic as I think it’s relevant here too.
I believe the discussion here about parenting is a diversion from the real issues at play.
This is not a ‘won’t somebody think of the children moral panic’. Instead, we’re feeling a foreshock of the problems we’re going to experience, caused by the unintended consequences of the systems we have built - and what that means for us as a society.
YouTube videos for kids is a lighthearted entry to the subject - we could be discussing news, porn, education, whatever, and the problems and implications would be broadly the same.
The key issues raised here are:
* The ‘delamination’ of content and author and how that affects the awareness and trust of its source. If, for example, a scientific paper and a bunch of woo is presented in the same way who can tell which is more legitimate? ‘Just teach critical thinking’, or ‘it’s called ‘parenting’’ are not acceptable solutions as by the time enough people have been taught to provide herd immunity we will have long since succumbed to this pandemic of bullshit.
* ‘...the impossibility of determining the degree of automation which is at work here’. If both humans and machines are creating content tailored for every possible niche, interest, fetish and keyword combination, and algorithmic personalisation makes it possible to exist entirely within our own personal tag clouds what does it mean for us as a society, which requires a basic set of shared values to function?
Junk content and the pandering to base instincts is not new, but our ability now to automate the creation and dissemination of such content to pander to every possible interest and combination of interests at vast scale is new - and we do not yet have the cultural toolkit to deal with it.
I wonder whether in a few years time, once we’ve really felt the impact of all this, people will look on today’s enthusiasm for putting ‘social’ in everything with the contempt and horror we do with last century’s enthusiasm for putting radium in everything.
I don’t understand the point of this article. I found Bridle’s original piece to be much ado about nothing. He basically complains about algorithmicly generated content being too “weird” for kids then does English lit style analysis looking for malicious undertones in said content. I didn’t agree with it at all but at least it was an original blog post that was trying to make a point.
This Bloomberg piece on the other hand simply links to Bridle’s blog and says “Yeah! What that guy said!”. Really thin “content” imo.
Regulating tech co's is one approach, another is trying to create new social norms around the use of these platforms. My Facebook feed is almost entirely pictures of friend's babies and announcements about local events. That's because I've curated my feed and deliberately not liked any news sources. Some friends and family share their opinions and stories, but even during the election, it was pretty limited. It's tempting to create a new federal apparatus to regulate these tools, but what's really lacking is the common sense found at a dinner table "No talk of politics or religion."
I wonder to what extent this YouTube Kids stuff represents a "moral panic" --- oh no, look at the depraved things our children are watching! And they are TEACHING an ALGORITHM to learn that LIVE CHILD ACTORS should be made to act out even more depraved versions of these things to get more page views!
Versus a real problem -- oh shit, we accidentally created a brand new Internet where there are no more editors, everyone is free to find their own content democratically, hooray, but some of the people we put in charge of creating that content are hyperactive amoral entities.
I know a bunch of Facebook employees have this view of the whole "filter bubble", "fake news" situation which is, more or less -- Deal With It. The news feed algorithm is here to stay, it's the new printing press, editors are obsolete, and everyone gets to decide their own truth now. That view is evinced ambivalently at e.g. https://www.wired.com/story/the-solution-to-facebook-overloa... .
But I'm not sure how that view copes with the YouTube monetization model which .... starts with children's videos ... goes to ad revenue ... and leads to children being videotaped apparently in real distress for money.
Here are 2 points of reference:
(1) YouTube channel "DaddyOfFive" had 750,000+ subscribers and featured what was fairly clearly child abuse ("pranks"). Somebody finally thought it might be a good idea to report this to authorities and the father lost custody of some of the children. https://www.washingtonpost.com/news/the-intersect/wp/2017/04...
> The feedback loop is so tight that many of the creators have converged on designing some of the most visceral (and disturbing) material that appeals to kids at a reptilian level. Think about how genuinely weird little kids are. Sometimes they do stuff that would be scary if it wasn't just a minute of innocent pretend and a toy. Stuff like kidnapping each other or performing surgery on each other. Well, now there are hundreds of thousands of YT videos illustrating that kind of material in fine detail. Many of them have millions of views.
And the sample videos' captions include:
> Many videos feature the girls screaming or crying their heart out. In this video, this girl has something in her mouth that tastes horrible … And she’s forced to keep it in her mouth … And she doesn’t seem to be acting.
> Here, a girl takes something from the toilet and force feeds it to the other girl. She doesn’t like this.
> In another video, a creepy dude with clown makeup barges into the girls’ house and starts grabbing them while the girls scream and attempt to resist him.
Is this wrong? Should this not be happening? Is this anything but a natural effect of the 2010-2011 "filter bubble" and the 2016 "fake news" phenomena?
I find it quite ironic that the author at one point complains of misleading tags being used in titles to generate clickbait (or 'searchbait') in an article that awkwardly shoe-horned in "self-driving" into a couple of sentences to artificially generate additional clicks. It's currently the "top story" on Google from Bloomberg for "self driving."
Actually ironic is not the most accurate word. It's telling. This is another article which is essentially a call to censorship. And what's to be censored? Well like most of these articles, that's not really discussed beyond whatever the author happens to disagree with. You see, jamming in misleading tags to produce hits isn't a problem when it benefits the author or their publication, but when others do it? Oh, it's time for a serious conversation now.
> we took the iPad away from our four-year-old daughter
Not referring to the person of the author, but people use tablets and phones as stand-by buttons for their kids. However much active the kid might be, they get parallised watching cartoons and whatnot. But in a recent interview with a local doctor from a working-class neighbourhood where I live, he was referring how excess use of this is causing kids to suffer from under-developed motor skills (Evrensel.net on the Esenyalı neighbourhood).
As of 2015, there were 576,000 hours of video uploaded to YouTube per day. As of 2014, Facebook users generated 4 petabytes of data per day - four billion gigabytes of photos, videos and text. Does anyone believe that it's feasible to manually review even a significant fraction of that content?
Social media is media, but it's also social. A lot of people are trying to apply the standards of traditional media to something that's fundamentally different. I'm not sure where on the spectrum social media lies between "private conversation" and "network TV", but I don't think that we can exactly apply the social norms of either.
The vast majority of people would agree that some degree of monitoring and censorship is necessary for the prevention of crime. Beyond that, I think we simply have to accept that some amount of content on social media might offend us.
Social media is created by people with a very diverse range of beliefs, opinions and standards of decency, so it's unlikely that we'll establish a universally agreeable set of standards. Social media companies have a limited ability to control the content on their sites reactively or via algorithms, but it's logistically impossible for them to consistently enforce their terms of use across all content.
Many voices in the traditional media would have us believe that occasional offence is a fundamental flaw in social media, but I think that's a bogus narrative.
It's interesting reading the comments to see how one proposed "humanly curated" alternative (PBS kids) has been discarded as "not being free" yet people are up in arms that Youtube Kids is not using humans to curate their videos. These 2 requirements are in contradiction. I don't know if it's even profitable to have a lot more humans reviewing Youtube Kids videos while keeping the service "free" (ad based) but even if we assume that may still be profitable it's pretty clear it will be significantly less profitable then it is now which means that Google (a company not known to be shy from shutting down services with tons of users) may simply shut it down and move to do something else where they can get higher profit.
If the market/technology does exist where someone else could do a better job then there would be many alternatives, it's not like Youtube Kids has some lock in mechanism.
PS: the self-driving moral decision comparison in the article seems baseless, I very much doubt anyone developing self-driving algorithms are considering "moral decisions", there is no moral decision to be made, the car will try to stop (in its lane) as fast as it can if it detects an obstacle, it won't try to swerve (after performing some imagined moral decision algorithm) because that would be illegal and it potentially increases liability of the software manufacturer.
90 comments
[ 5.0 ms ] story [ 175 ms ] thread> A step back to assert human control -- even if it cuts into the tech companies wide profit margins -- is overdue indeed.
The author seems to think these problems cannot be solved with technology. Maybe they think that, or else Facebook, Twitter, et. al., would have solved it already?
I think that it is far more likely that our society directly incentivizes the companies to not solve the problems. That is why they are not solved. Because we lavish them with money to leave them unsolved.
Legislate that political news must be regulated. Legislate that companies that exert social control over a population, like Facebook, must do so responsibly. Don't just tell them that humans must curate all content. That won't work. Humans are too expensive and corruptible anyway. The solution is structural in society just as the problem is. Take away the profit incentive for big tech firms to cheat and feed lies, and our society will improve directly in line with what the author probably wants.
This is not as simple as it sounds, of course, because the regulators would also have plenty of incentives for bad behavior.
I actually think that government regulation can be tremendously useful in certain circumstances. But it's not a magic solution, and you have to be clever about it. In the particular case of political news, the potential downsides of giving too much power to regulators are at least as dangerous as giving too much power to Facebook or Google.
So what you're saying in our current political climate is "Change the rule of web based business every 4 to 8 years dependant on who gets elected"?
In the US we already know this doesn't work out because "big tech firms" will just buy the lobbying they need to get what they want. At best we can put some bandaids on the internet, at worst we're making it some kind of authoritarian nightmare depending on whatever companies get to enforce contracts based on the law.
In what way? Establishing fact-checking institutions or empowering the FCC to fine broadcasting of false political speech? Or with libel laws to allow people to sue for false allegations easier?
> Legislate that companies that exert social control over a population, like Facebook, must do so responsibly
In what way? Who what agency determines what is a responsible way to "exert social control over a population"?
Do we need to be reminded that these are opt-in services where you agree to a ream of terms before being allowed to use the service?
At which point does an online service go from being simply a place for people to interact to a company that needs regulating? Does HN qualify or do you need XXX million active users?
Legislation should be a last resort since it is so easily circumvented (see tax code) and unfairly applied (see criminal code, specifically the section on drugs).
Not just no, but HELL NO!
You may be imagining that the regulators will censor the news in a manner that conforms to your opinions.
That's not a safe bet.
Further, the fact that YouTube, Facebook, et al. Have failed to police content to the author's satisfaction is not indicative of a failure in AI - especially when these corporations are effectively incentivized by view counts and advertisement not to remove these videos.
In short, YouTube's failure is not a valid indicator of the effecticeness of AI in general.
As to whether today's AI is up to the task, I think it's fairly hard to say definitively. It seems certain that we haven't yet fielded a system that does it very well though.
Pretty sure he does, from the OP:
> A step back to assert human control -- even if it cuts into the tech companies wide profit margins -- is overdue indeed.
The tech companies use these algorithms because they're cheap and they're good-enough for their profit-making purposes. If Google's algorithms can't keep YouTube Kids kid-friendly, then they need to hire the human moderators to make up the difference or kill the product (because it's false advertising).
Maybe people willfully choose fake news on Facebook because they're tired of the fake news the mass media broadcast.
"Oh but those are wrong choices and somebody needs to put a stop to it!"
This is just a push for autoritarianism. No thanks.
We live in a market-driven society, people are free to choose to consume what they want to consume (as you point out) but that doesn't give carte blanche to the producers in the marketplace to do whatever they want in the name of ad revenue. When it does reach a tipping point, as I think we're seeing with this Medium article, regulation will start to come to a niche industry that had previously operated under the radar. Especially when human health consequences are involved, the government steps in to ensure protection to its citizens (and its most vulnerable members, children).
If you really are upset that you won't be able to view algorithmically generated children's cartoon videos stuffed with tropes and keywords that exist for no other purpose than to make money, I'm concerned for your wellbeing.
Edit: P.S. Where was the personal responsibility of Facebook after they were caught peddling propaganda placed by foreign actors? As I recall it took a lot of arm twisting to get them to admit there was even an issue.
Government on the other hand makes the decision and forces it on everyone. Not just those who elected it, everyone.
Edit: as for the foreign propaganda, how many nations and what interests were/are they peddling? If it's already illegal then sure, it should be forbidden from the network. If it's not, then I'm fine with it.
Please, tell me how I can escape Google? God knows I've tried - I have a Fastmail email account, I use DDG, and I stick to Apple hardware. That doesn't change the fact >90% of advertising I see on the open web is still "suggested" for me by Google's algorithms, that my employer uses Google Apps and Google Drive for just about everything, that many links I encounter on social networks are AMP, and that most of time I need to verify I'm not a bot I'm filling in a recaptcha.
Saying I have a choice not to use Google is only true in the academic sense. It's theoretically possible, but not without extreme effort and probably not without finding a career outside of the tech industry.
What you don't have is the power to make others choose what you'd want them to.
We have gotten to the point where even reasonably conscientious and responsible adults have trouble raising their children. When the advertisers make money by making it a harder world to raise children in, they are externalizing their costs and internalizing the profits.
Some amount of externalities we allow due to pragmatism (the cost of enforcing the regulation is greater than the benefits), but when the line is crossed, some sort of regulation is required.
It is a reasonable policy question to ask where the line is drawn, and what sort of regulation (on the extereme authoritarian side, it is drawn very close and uses criminal law, on the extreme libertarian side, it's drawn less close and might use tort law), but outside of pure anarchy, it's not reasonable to say the line need not be drawn.
There are thousands upon thousands of rendered, cartoon, and live-action videos featuring popular childrens characters like Spider-Man and Elsa that have extremely disturbing themes dealing with punishment, handcuffing/restraint, dismemberment, injections, bodily waste, etc. It seems like they get more and more unusual as autoplay goes on. As a parent they are extremely unnerving and I'll certainly never let young children watch youtube unattended and I warn every parent I know about them.
There are places for curated content and there are content bazaars. YouTube Autoplay is a bazaar. Facebook is a bazaar. Recognize where you are, the motivations of those putting things in front of you and your family, and act accordingly.
It never ceases to amaze that the kind of psychological engineering these companies engage in is outside the bounds of any established ethics, but somehow they escape unscathed because money.
This garbage on YouTube Kids is aimed at getting children to watch it and intended to be disturbing to children. The titles say things like "educational, learn numbers" and the channels are called stuff like "Kids TV."
I've been confused reading all these stories about YT Kids, how do the kids even get to this stuff? The obvious search terms are banned by the app, but how deep down the rabbit hole does one have to go?
Yes, and any sane parent would agree. Physical safety is a prime consideration.
Here's a bunch of examples (query: fork in electrical outlet):
https://www.youtube.com/results?search_query=fork+in+electri...
(Come to think of it, college is when you really have to worry about your kids frying themselves because they saw something cool on the Internet. At that point, you've let your guard down and assume you don't need to babyproof. But I distinctly remember being sad that I'd missed the exploding wires demonstration in physics class and deciding to replicate it myself with a frayed Ethernet cable in my dorm room...that could've gone very badly. And my friend electrocuted himself trying to get pirated satellite with a board he'd bought off the Internet and a dish we self-installed on the dorm roof.)
For some things, the potential hazards (in this case, lifelong desensitization to, or increased propensity to violence) so drastically exceed the potential benefits (in this case, a bit more profit and less work for Google), that we should proceed with the precautionary principle, rather than just saying "F-it, show em whatever, we don't yet have proof that it's bad".
Learn a bit of perspective.
Yes. See the number of perforated ear drums after the "You've been tango'd" adverts.
https://en.wikipedia.org/wiki/Orange_Man_(advertisement)#Bro...
(the lead says the ad was banned; his section says it was voluntarily pulled. Either way it could have been banned: any system of media rating (eg advertising standards or BBFC) include imitatable violence.
PTSD from seeing horror movies at the age of 2.
Sexually precocious behavior at 6 due to having seen hardcore pornography at the age of 3.
It's hard to tell what will or won't deeply affect a child and even harder to gauge the specific ages where things might become appropriate. It's really per-child, and no matter how well a parent does gauging that, mistakes will be made.
There's no way this can be automated, as it's never going to be one-size-fits-all. The combination of generally sanitized media channel + parental supervision will (and should) endure, IMO.
And I don't think a parent's discomfort is sufficient, either. There were things that I watched as a child, with my parents' knowledge, that I still consider to have caused me trauma.
Today on HN there was an interesting discussion on addictive apps - https://news.ycombinator.com/item?id=15662004
In essence you have parents vs the best funded organizations in the world, packed with PhDs working full time to grab all our attention, children being the most susceptible. The only advantage parents is physical proximity. Disadvantages include lack of time, knowledge, awareness etc. I'm not betting on parents winning
Yes, it's up to the parents. But unless you have time to pre-screen every minute of content your kids watch (hint: if you have a job, you don't have time to do this), at some point you have to trust a ratings agency like MPAA, ESRB, or a company like Google when they say - "this content here, it's safe for kids". The obvious problem is that YouTube Kids is utterly failing at this.
What's the realistic alternative? Watching hours upon hours of kids content on YouTube and creating your own playlists? How do you stop a child from going to a "recommended video" afterwards? What about ad content, how do you filter that?
Edit: The only realistic alternative is not letting kids watch YouTube. This is fine, but then maybe Google should not be advertising a section of YouTube as "for kids".
And even then, things get pretty sexual.
I would argue that if your kids are watching so much of this stuff that you don't have time to monitor it, they're watching way too much of it. "Hours upon hours" is definitely way too much.
Your kids will survive even if they're not plugged in to streaming media 24/7/365. Really.
In the past few years, I've been learning intensely about communities and family: got married and learning to be a step-father. I am also involved in a legal-tech startup and got to hear how lawyers think about governance and law. I don't think social media is a substitute for community either, although it can be beneficial _if_ used within the context of community.
Here are some of the things I learned:
- There is a tension between global and local concerns. Neither alone can address everything. Local concerns -- communities -- have people living there. They have a stake in their local environment. There are issues when people outside of a community (people without stakes within the community, who are not residents) try to influence things. This could be anything from coordinating regional concerns (such as people building upscale neighborhoods in a flood control area built by the Army Corp of Engineers in Houston), or outside investors holding municipal bonds.
- I discovered Christopher Alexander's work on pattern languages and designs. I found his keynote to the OOPSLA '96 conference. His work inspired the design patterns of OOP as well as Human Interface Design, but I don't think his vision and philosophy was ever fully implemented. His life's work somehow addresses how to design for both global and local concerns. The idea is that architects develop pattern languages that will always result in cohesive, livable designs (global), and the actual users of that pattern language are the people who live within that community (local). Although this is primarily focused on building design, I think it has some overlap with governance. Physical environment will shape and influence how people interact with each other.
- There are people who are isolated because they don't fit with their local community's norm. Allowing them to connect with other people around the world is great. However, I think it is important for a person's psychological health to have some connection with their local neighbors.
- My wife and I tried allowing my step-daughter to have a smart phone, mainly so we can reach her in an emergency. She quickly found ways to become absorbed into it, neglecting her responsibilities to the family and our expectations for her as parents. We tried using more tech to restrict it. She got around them -- claims innocence (and to this day, I don't really know whether she was or not). In the end, we got her a flip phone. She called a "granny phone", and we blocked calls and texts at the carrier level. She doesn't have her own tablet or computer anymore: we have family devices that are kept in the family office and she is forbidden to take it in her room. (Where she still sometimes sneaks it to bed and stays up all night watching youtube videos).
- My wife told my daughter that she had to be at least 13 to get on social media, and she is forbidden from it. That was half a year ago. I had always wanted to get my daughter to _earn_ her smartphone (and by extension, social media) through some sort of modern-day rite of passage. But over the months, I am more and more inclined to forbid her from social media until she graduates high school.
I know it's the "think of the children" thing, but I hope Youtube sees the outrage about these spammy kids channels and does something so they aren't suggested and autoplayed. To me that's a special case. Grown adults who see fake news on Facebook and take it as the truth regularly.. Is that really on Facebook to fix that?
Something Neal Stephenson remarked in Diamond Age: this kind of tech is not a substitute for parenting.
It's extra work, of course, to put substance behind what you're saying, and that isn't always an option. But refraining from posting is.
>YouTube Kids has tons of fun and educational videos that are just right for kids. There’s also a whole bunch of parental controls that let you create an experience that’s just right for your family.
>CONTENT ON YOUTUBE KIDS
>Our app is designed to filter out inappropriate videos for kids, but no system is perfect. If a video that’s inappropriate shows up, you have the power to block it, flag it, and bring it to our attention for fast review.
So, it attempts to be "right for kids" and "filter out inappropriate videos". Is that working? I'm not quite sure.
[1]https://play.google.com/store/apps/details?id=com.google.and...
[1]: https://medium.com/@jamesbridle/something-is-wrong-on-the-in...
That said there is a MASSIVE difference in a poorly animated earworm like the "Finger Family Song" and Chase from Paw Patrol being decapitated in a strip club, which is a rarity.
Plausible scenario is that it fails is that they assign a few human reviewers, and set the threshold of reports required so that those humans aren't overworked. Then they make the erroneous assumption that their staffing for the task is adequate and that items falling below the reporting threshold must be fine. Wrong.'
Social media (even YouTube) is mostly intended to entertain. If it turns out to be bad at other stuff, well, that just means we have to create systems that are. Super popular web sites are not going to be any more socially constructive than the sort of magazines you find at the checkout aisle of a grocery store. Nothing has really changed here.
I believe the discussion here about parenting is a diversion from the real issues at play.
This is not a ‘won’t somebody think of the children moral panic’. Instead, we’re feeling a foreshock of the problems we’re going to experience, caused by the unintended consequences of the systems we have built - and what that means for us as a society.
YouTube videos for kids is a lighthearted entry to the subject - we could be discussing news, porn, education, whatever, and the problems and implications would be broadly the same.
The key issues raised here are: * The ‘delamination’ of content and author and how that affects the awareness and trust of its source. If, for example, a scientific paper and a bunch of woo is presented in the same way who can tell which is more legitimate? ‘Just teach critical thinking’, or ‘it’s called ‘parenting’’ are not acceptable solutions as by the time enough people have been taught to provide herd immunity we will have long since succumbed to this pandemic of bullshit.
* ‘...the impossibility of determining the degree of automation which is at work here’. If both humans and machines are creating content tailored for every possible niche, interest, fetish and keyword combination, and algorithmic personalisation makes it possible to exist entirely within our own personal tag clouds what does it mean for us as a society, which requires a basic set of shared values to function?
Junk content and the pandering to base instincts is not new, but our ability now to automate the creation and dissemination of such content to pander to every possible interest and combination of interests at vast scale is new - and we do not yet have the cultural toolkit to deal with it.
I wonder whether in a few years time, once we’ve really felt the impact of all this, people will look on today’s enthusiasm for putting ‘social’ in everything with the contempt and horror we do with last century’s enthusiasm for putting radium in everything.
This Bloomberg piece on the other hand simply links to Bridle’s blog and says “Yeah! What that guy said!”. Really thin “content” imo.
That said, there is a role for government regulation. Specifically, to break up monopolies such as Google.
Then, when there is proper competition, you have some freedom to choose the platform that’s policed by algorithms that you agree with.
Versus a real problem -- oh shit, we accidentally created a brand new Internet where there are no more editors, everyone is free to find their own content democratically, hooray, but some of the people we put in charge of creating that content are hyperactive amoral entities.
I know a bunch of Facebook employees have this view of the whole "filter bubble", "fake news" situation which is, more or less -- Deal With It. The news feed algorithm is here to stay, it's the new printing press, editors are obsolete, and everyone gets to decide their own truth now. That view is evinced ambivalently at e.g. https://www.wired.com/story/the-solution-to-facebook-overloa... .
But I'm not sure how that view copes with the YouTube monetization model which .... starts with children's videos ... goes to ad revenue ... and leads to children being videotaped apparently in real distress for money.
Here are 2 points of reference:
(1) YouTube channel "DaddyOfFive" had 750,000+ subscribers and featured what was fairly clearly child abuse ("pranks"). Somebody finally thought it might be a good idea to report this to authorities and the father lost custody of some of the children. https://www.washingtonpost.com/news/the-intersect/wp/2017/04...
(2) The comment at https://news.ycombinator.com/item?id=14910125 links to an article at https://vigilantcitizen.com/moviesandtv/something-is-terribl... which provides some evidence that toddlers' content preferences are influencing the creation of new content which involves, as part of making the content, putting children in distress. This seems to cause actual measurable harm to children.
The news.ycombinator comment said in part :
> The feedback loop is so tight that many of the creators have converged on designing some of the most visceral (and disturbing) material that appeals to kids at a reptilian level. Think about how genuinely weird little kids are. Sometimes they do stuff that would be scary if it wasn't just a minute of innocent pretend and a toy. Stuff like kidnapping each other or performing surgery on each other. Well, now there are hundreds of thousands of YT videos illustrating that kind of material in fine detail. Many of them have millions of views.
And the sample videos' captions include:
> Many videos feature the girls screaming or crying their heart out. In this video, this girl has something in her mouth that tastes horrible … And she’s forced to keep it in her mouth … And she doesn’t seem to be acting.
> Here, a girl takes something from the toilet and force feeds it to the other girl. She doesn’t like this.
> In another video, a creepy dude with clown makeup barges into the girls’ house and starts grabbing them while the girls scream and attempt to resist him.
Is this wrong? Should this not be happening? Is this anything but a natural effect of the 2010-2011 "filter bubble" and the 2016 "fake news" phenomena?
Actually ironic is not the most accurate word. It's telling. This is another article which is essentially a call to censorship. And what's to be censored? Well like most of these articles, that's not really discussed beyond whatever the author happens to disagree with. You see, jamming in misleading tags to produce hits isn't a problem when it benefits the author or their publication, but when others do it? Oh, it's time for a serious conversation now.
Not referring to the person of the author, but people use tablets and phones as stand-by buttons for their kids. However much active the kid might be, they get parallised watching cartoons and whatnot. But in a recent interview with a local doctor from a working-class neighbourhood where I live, he was referring how excess use of this is causing kids to suffer from under-developed motor skills (Evrensel.net on the Esenyalı neighbourhood).
Social media is media, but it's also social. A lot of people are trying to apply the standards of traditional media to something that's fundamentally different. I'm not sure where on the spectrum social media lies between "private conversation" and "network TV", but I don't think that we can exactly apply the social norms of either.
The vast majority of people would agree that some degree of monitoring and censorship is necessary for the prevention of crime. Beyond that, I think we simply have to accept that some amount of content on social media might offend us.
Social media is created by people with a very diverse range of beliefs, opinions and standards of decency, so it's unlikely that we'll establish a universally agreeable set of standards. Social media companies have a limited ability to control the content on their sites reactively or via algorithms, but it's logistically impossible for them to consistently enforce their terms of use across all content.
Many voices in the traditional media would have us believe that occasional offence is a fundamental flaw in social media, but I think that's a bogus narrative.
https://www.statista.com/statistics/259477/hours-of-video-up... https://research.fb.com/facebook-s-top-open-data-problems/
If the market/technology does exist where someone else could do a better job then there would be many alternatives, it's not like Youtube Kids has some lock in mechanism.
PS: the self-driving moral decision comparison in the article seems baseless, I very much doubt anyone developing self-driving algorithms are considering "moral decisions", there is no moral decision to be made, the car will try to stop (in its lane) as fast as it can if it detects an obstacle, it won't try to swerve (after performing some imagined moral decision algorithm) because that would be illegal and it potentially increases liability of the software manufacturer.