153 comments

[ 2.9 ms ] story [ 169 ms ] thread
I imagine that in the 2-3 years this contract run, Google shared most of what they needed to share with the Pentagon in order to catch-up to the company's current AI capabilities.
The project is ongoing.
I would actually lean into the belief that they're probably heavily pushing Google Cloud services (as Google does tend towards), and that there's a decent chance Google's work done on Maven won't operate at all if Google stops providing those services.
I doubt that. It's what, a $9 million contract? Assuming Google is making a profit or at least breaking even, I'd doubt there's more than 15 or so people working on this full time.
This $9m amount was a lie by Google management to the employees. The actual project revenue is much higher, and was planned to reach $250m.
Dystopia was hiding behind official lies, while already being in the works: "The emails also show that Google and its partners worked extensively to develop machine learning algorithms for the Pentagon, with the goal of creating a sophisticated system that could surveil entire cities. ... 'the wisdom and strength of our people will bring about multi-order-of-magnitude improvements in safety and security for the world' ... Google intended to build a 'Google-earth-like' surveillance system ... Google’s artificial intelligence would bring 'an exquisite capability' for 'near-real time analysis'" paired with drone-killing.

[added for the down-haters]

Examples of the lies:

- concerned employees were told that Google’s DoD contract was worth only $9 million

- "Google downplayed its work, saying it had merely provided its open-source TensorFlow software to the Pentagon"

In the name of building real-time, total surveillance in support of automated killing by drones.

Congrads google activists you have hurt your employer's business and business prospects and prevented your colleagues from working on really interesting AI applications relegating their life's work to sorting photo albums.

Oh, and none of that will make a difference because a competitor of yours will pick up the slack and be in a position to offer really interesting work to attract and retain researchers.

Google is, after all, a company famously hurting for business and business prospects.
Nor is Microsoft or Amazon. There aren't many clients out there the size of the DoD and the cloud business is all about locking in large clients.
No but they are infamous for missing opportunities
If we cannot find better applications for so-called AI than bullshit like sorting photo albums and military applications, maybe we should not do it at all?

I am still sure there are enough industrial, medical and civil applications for Google to work on, no need to resort to "photo albums" immediately.

That’s sort of an academic answer. Perhaps Google should go straight for creating the Singularity?

Business works by creating a product that someone will pay for. Then they reinvest those profits, grow the company, etc to improve that product.

Maybe we’ll eventually get the robotic butler that consumers will pay for, but in the meantime the Apple II robotic/AI revolution has been a little slow to materialize.

But as an employee why should I like what the management wants, I think is your duty to speak if you consider that management does something bad and resign if you don't want to participate. My goal is not to make money for my boss/company, I personally get satisfaction when our customers are happy. If Google management does not like developers with this kind of ideals they should say it in their recruitment announcement that you should be OK with working with the military and spy agencies.
Maybe those colleagues could just go work at the competitor if thats what interests them?

The fact that everyone doesn't feel like they'd like to work on AI military drones doesn't even mean that they are opposed to them in principle.

How is it not OK for a company to collectively decide that maybe, even though killing machines are going to exist, they would rather not be the ones working on them?

You do realize that most of the top-tier machine learning researchers are among the thousands protesting DoD work.

There is more than enough work, money, and intellecutalism in bringing AI to medicine, safety, transportation, supply chain optimization, law, art, music, and many other applications.

>really interesting AI applications The AI academics and talented developers probably would find other domains more interesting then satellite surveillance and droning people.
(comment deleted)
A clear statement that Google likes terrorism more than its investors.
Great. There will be plenty of people willing to take Google's place.
Willing, but capable? Who has the AI, Maps, signals intelligence, and everything else capability to replace Google?
If they give the project a new name, I vote for "Blackbriar".
That could be how they came up with "Maven" in the first place, and not the Java framework.
The thing I think everyone needs to remember for the future is that Google is only backing off on Maven because of the bad PR. They aren't suddenly growing a conscience, and you can be sure that given the chance to secretly get involved in a horribly unethical program for hundreds of millions of dollars is still definitely an option for them.
Companies don't have consciences. "Bad PR," talent drain and other happenings led to this and for PEOPLE (who do have consciences), these can continue to be considered as valid tactics for achieving a desired end.
this is so stupid. Meanwhile Chinese govt is going full steam head with AI. This will come back to bite Americans.
That may be a component, but IMHO, pronouncements and explanations haven't diminished employee objections to say the least.
Corporations have no ethics or morals, though. Google has no conscience of it's own. Employees can perhaps keep it in check, for a while. But the notion that people have held that Google is good for society is a myth, and people are increasingly realizing it.

Sure, employees may continue to protest actions like this in the future... if they find out about them. Bear in mind, a significant component of this incident involved Google lying and downplaying the importance of this project.

Shortly after yesterday's article containing leaked emails, a Googler expressed public shame of having promoted articles by one of the people in said emails, which explicitly talked about concealing Google's involvement with the military implementing AI, and shortly thereafter, announced intention to leave. This person had blocked me a mere couple months ago for saying that "Google is not worth saving", and today, perhaps they'd agree with me.

Eventually, Google will cross a line that everyone considers too far. For me, it was several years ago. For this individual, it was yesterday. How long will Google have people there who still object to the behavior the company engages in? Where's your line?

This is bigger than Google. Microsoft, Amazon, Facebook, Oracle, Palantir, et al, will take this contract next. Google isn't the only company that can run DNNs to do image classification, it's commodified now. The DoD is going to pay money to get this software, it's inevitable, just like they got the Hydrogen bomb, and ICBMs, and biological weapons. Enough people exist out there who are smart and willing to work on it for money, only it won't leak, and won't be public.

The public needs to take this event as a canary in the coal mine. Congress needs to limit AI use in the military. If it took Google to scare everyone into finally regulating this, than so be it, but there needs to be transparency and oversight and limits imposed by democracies on this, just like regulations on chemical and biological weapons.

Perhaps we need an "AI Weapons Proliferation treaty" or something. But the future of war is automated drone killing machines, they're just way cheaper to built and deploy and less risky. You can build hundreds of automated drones for the cost of one B-2 bomber, and mount a saturation offense against any defender.

People need to widen their gaze from fixation on Silicon Valley. The problem is in Washington, the problem is a $700 billion defense budget, a war on terror, and extrajudicial drone assassinations. Everyday people on HackerNews are complaining about ad tracking, navel gazing their industry, meanwhile, they silently accept their own governments tracking people and killing them with hellfire missiles. (I get that people feel helpless with respect to resisting the military industrial complex and feel they can have some say over an industry they're more closing associated with, but I'm pretty sure there's plenty of HN readers who actually favor the US military empire)

Presumably, a talented software engineer has literally hundreds of other options besides Google, Microsoft, Amazon, Facebook, Oracle, and Palantir though, right?

I agree we need strict regulations on the use of AI in the military. It carries the same risks as nuclear weapons and chemical and biological weapons for disproportionate harm, but without the extreme cost.

"I'm pretty sure there's plenty of HN readers who actually favor the US military empire"

From the comments of many of the people defending Google's involvement in Project Maven, I am quite confident, unfortunately, that you are correct there as well.

Talented engineers do have a choice but Google has been the most desired place to work for a very long time.

In the last 10 years they have been the #1 place to work 6 of the last 10 years.

http://fortune.com/best-companies/2017/

http://reviews.greatplacetowork.com/2016-fortune-100-best-co...

http://fortune.com/best-companies/2015/

http://fortune.com/best-companies/2014/

So in 2012, 2013, 2014, 2015, 2016 and 2017 it has been Google.

That does not just happen. Plus we have not had anyone else do it 2 years in a row let alone 6 straight years!

Plus a lot of engineers want to work someplace that is interested in the greater good.

So do things like what Google did in China with leaving instead of doing what was morally wrong for a buck.

Also a lot of the top engineers want to publish and share and Google allows their engineers to do this.

Google does tons of open source also which is attractive to engineers.

The younger people are much more into companies interested in the greater good then just to make a buck.

It is why you see Google on top of the list so often and a company like Microsoft way down on the list and do not think has ever been a top company?

Of course companies have ethics and morals. Companies are run by people.

Google more than most if we look at actions. The biggest was leaving China over principle and losing out on a ton of money versus Apple handing over their user data.

But there are so many more with Google. So many crazy ones.

Look at smartphones and Google continuing to give away Android for free. Even in China where there is not Google services and Google even lets Amazon use it for all their hardware.

Google doing this makes phones available to people that would not have the means otherwise. If just Apple they would be stuck.

But a huge one that is close to home is what Google has done for K12 in the US. Our school use to be all Apple but has now replaced the Apple with using Google for pretty much everything.

Our school is relatively wealthy but many are not has blessed as ours and Google offering ChromeOS for free and all the software makes it possible for these kids to have access to computer technology that without Google they would not.

But the big one for us is the analytics. Matching kids up to teachers is so,so,so important and can make a huge difference in a kids life. Previous it had been done by gut. Our school has moved to using the Google ecocystem and our school is a Google K12 showcase school. I forget what they call it. So they are working with our school to use analytics to match kid to teacher.

That just would never have happened or not for a long time without Google.

Also think about the schools that were using Microsoft before replacing with Google. We were lucky we had the money to buy Apple but some were not as lucky and the improvement will be far greater for the schools that were previously using Microsoft. Teachers have limited class time and Windows would cause them to lose a lot more class time dealing with silliness. Or more likely the laptops left in the corner has full of viruses and malware.

I can give countless other examples. Where would we be with data scientice without the Map/Reduce and GFS papers?

Why did Google give it away?

How about Borg and now we have K8s? Why did they give that away?

Or the source code to so many different systems. Or why on earth when you own the front and back end and come up with SPDY did you give it away? Then the standard group changes it and you still spend the money to make sure you are standard.

Probably one of the biggest is VP8 and VP9. The MPEG-LA was trying to exort us for license fees. Google not only gives away VP8 for free but then on top tells people they will protect them from patent infringement.

Google even gave it away to competitors.

Do you realize even though Google has tons and tons of IP they have not sued another company for infringement? I mean never! That helps all of us.

Waymo did go after Uber but that was not Google. I suspect Waymo will be handled differently as they are not giving everything away like Google.

The other case was a suit started by Moto before Google purchase that they let go.

Then we have Shellshock, Meltdown, Spectre, Heartbleed, Cloudbleed among others all found from Google.

Heck Google found the Cloudbleed bug and shared with Cloudflare for free including the mitigation even though they are freaking competitors!! Google spent money to help them. Now how on earth is that not morals? Doing the right thing? But what drives your posts?

Google shared the Meltdown mitigation with MS and Amazon so they could save money

I can not think of any tech company that has given back nearly as much as Google. So many times deciding to do what is right versus what would have made them a buck.

Can you name any company in history that has given back as much as Google? Look at the papers they have shared with things like Wavenet, and AlphaGo and BigTable and a big new one Google Beyond Corp and literally 100s of others?

Parc gave back a lot as well as Bell labs but if we look at the benefit to the industry I would say Google has given more. Part of it is the indus...

You've gotten involved in way too many flamewars about Google and your comments are lowering the quality of this site. That's a moderation issue. Here you crossed into outright personal attack. We ban users that do that, so please don't do it again, and would you please stop commenting so much, and so exclusively, about Google? This sort of agenda is boring, and not what HN is for.

Please see https://news.ycombinator.com/item?id=17216633 also.

The issue is there is a poster that goes by "ocdtrekkie" for some reason has post a number of times things that are not true and pretty much only posts things that are not true around Google in a negative light. Not sure what drives it but it is not based on facts.

Am I allowed to refute when things said are not true? I will post with facts to support?

Perfect example is him posting all over that Google removed "do not be evil" from employee code of conduct.

Here is a link to the actual agreement. Please read the last line and what employees are left with.

https://abc.xyz/investor/other/google-code-of-conduct.html

"And remember… don’t be evil, and if you see something that you think isn’t right – speak up!"

Now this is a factual matter. Not an opinion. So him posting something that is blatantly untrue I am not allowed to refute with facts?

He does this same thing constantly.

Just looking for help how to handle someone that does this over and over again.

Thanks in advance!

Arguments like this are not as 'factual' as they feel to the people arguing, but are driven by conflicting preferences and emotions. If I like X strongly enough and you despise X strongly enough, then every time we meet we're going to tangle about X. Such arguments are repetitive, tedious to everyone else, and devolve into incivility. The impulse to do this needs to be resisted. So the answer to your question "how to handle someone that does this" is that you don't have to "handle" them, and we need you to let it go because your attempts to "handle" them are damaging the site.

Occasionally it happens that a user fees so strongly about a company that they have to comment about it every which way. For or against, this is a problem: it's repetitive and provokes worse. As I've tried to explain to you elsewhere, you've crossed the line with this Google stuff where you're not having a curiosity-driven conversation, but rather prosecuting an agenda and inundating the threads. Other users have been complaining about your comments for some time now. Lest you think we're favoring one side, I've said similar things to ocdtrekkie.

In the past, we've had to ban people who couldn't or wouldn't stop doing this. If you want to participate on HN, please remember the site's purpose: the gratification of intellectual curiosity. That's not an emotion that gets fixed on any single thing, and it flourishes with variety, not repetition.

Saying that Google removed "do not be evil" in a employee code of conduct document that we can clearly see is in the document is not a fact?

Here is the agreement.

The very last statement is

"And remember… don’t be evil, and if you see something that you think isn’t right – speak up!"

https://abc.xyz/investor/other/google-code-of-conduct.html

How is that not a fact?

My issue is just things that a clearly, factually, untrue like the example above. NOT things that are opinion.

I love HN and it is a great source because we do NOT have people doing what ocdtrekkie does. But I feel things that are very, very black and white like the example I gave above should be allowed to be countered. Or better yet just NOT allowed.

Can you please roll back the Google agenda in your comments? We've had this discussion before. At a certain point it starts to affect the quality of this site by making things more predictable and flamewar-prone, triggering accusations of astroturf, and all the rest of internet disease. You appear to have passed that point again recently, as more than one moderator has noticed. It's not what HN is for, and it's tedious, so please don't.

(It doesn't matter that it's about Google—the same is true for any X. X just happens to be Google in this case, as it is with https://news.ycombinator.com/item?id=17214242. And when two of these get going on each other...hoo boy.)

Think if we look at actual actions of Google we can see they already had a conscious. I assume what "conscience" was intended?

Perfect example is China. The government was trying to hack in Gmail account and Google decided to leave China even though a ton of money to be made.

Versus Apple handed over all their user data to the government with a complete disregard for privacy to make a buck.

"Campaign targets Apple over privacy betrayal for Chinese iCloud users"

https://www.amnesty.org/en/latest/news/2018/03/apple-privacy...

But I am not surprised by your post having half truths. I tend to be a super curious person by nature and I see almost every post of yours consistently doing this specifically around Google.

I would love to hear the back story? Why? Do you work for a competitor of Google? Why do you make up stuff around Google and always something negative?

BTW, I have ZERO problem with posts that are truthful on companies. Nothing wrong with that. But in an age of the Internet it is so easy to look up something posted and see that what is posted is not true. I also understand mistakes are made. But basically every post? Now there must be more to it.

Why?

I think there's a large difference between Google leaving china due to hacking vs working as a U.S. defense contractor.

A lot of people look at Google as something more than just a U.S based company and is considered as more of an international company in this regard. So, when Google's parent company decides to align heavily with U.S military, then of course people working in Google, who come from all parts of the globe and cultures, will have a problem.

It would be interesting to see the demographics (age, culture & religious views) of those who openly protested.

I am sure I'd rather distance myself from Google if it continues to support U.S military contracts and the perfection of killing others.

All comes down to doing what is right or what makes you more money.

Google staying in China would have made them a ton more money but giving up user data to the government was not acceptable for them.

It was for Apple and making a buck.

This will really hurt their enterprise cloud business. Google has shown to have a bunch of employees who will leak confidential discussions to the press and try to PR damage their employer. If you are a large company looking for a home, that is exactly the kind of environment you want to avoid.

In addition, many of the large US companies have a military component. Examples are GE, Boeing, United Technologies. How many of those companies want something like what happened with Maven to happen to them.

Finally, the success of this project will further embolden Google employees to use these same tactics of leaking and hurting Google's image in the future. Given how things progress, the next protest is likely to be about something that is even more gray area than Maven.

You're correct that a corporation's biggest enemies are the workers who do all the work and create all the wealth of that corporation.

You're also correct that this is a victory for those workers and a defeat for the corporation.

In "moral crusades" like this, it is often a very vocal minority that dominates the discussion. I seriously doubt that it was a majority of Google employees who objected to this.
Democracy is not a proxy for morality.

Not to mention that historically, moral progress tends to happen because of the unreasonableness of small groups of people. Demanding that people sit on their hands until they get 51% support for their cause, is asking that nothing ever get done.

Whomever started this project certainly did not poll the employee base, and establish 51% support of it.

That is a great opinion and I can do that too!!

I seriously doubt the majority of Google Employees would support defense contracting.

>it is often a very vocal minority that dominates the discussion

do you suppose the decision to support a military project was made by a large majority before? Committed minorities almost always steer decision-making within business ventures.

By framing this as a 'moral crusade' you're suggesting that there is an asymmetry here while there is not, participating in projects that can be used for purposes of war is no amoral default position. The stronger minority simply won.

Or framing it in another way, suppose Google would hold an employee vote tomorrow, do you think this would change the outcome?

I think this was different then regular military projects because of drones, drones have a terrible reputation.
And it's not just the reputation of drones, it's taking another step towards autonomous killing machines.

Robots probably wouldn't be as bad, but the other autonomous killing machines we have are pathogens, and all countries have pretty much decided it's counterproductive to develop pathogens for warfare at this point

Not all countries. Iraq has a bioweapons program: https://en.wikipedia.org/wiki/Iraqi_biological_weapons_progr... at least in 80's, and probably into 90's, and there's no indication they ever decided it to be "counterproductive", even though they abandoned it out of fear for repercussions for BWC violation. USSR had bioweapons program which it never declared "counterproductive", and even though Russian as USSR successor did, it is not really confirmed the program was effectively dismantled. There are pretty credible suspicions that Iran has an advanced stage bioweapons program, and same is suspected for North Korea. In fact, check out this list by PBS: http://www.pbs.org/wgbh/nova/bioterror/glob_nf.html - may be a bit out of date, but enough to realize "all countries have pretty much decided" is unfortunately an exaggeration.
We already have something very close to automated killing machines: anti-aircraft missiles. Couples with radar systems they can identify hostile and go and destroy them pretty much without human guidance
The chilling aspect of drone assassinations in terms of automation is that people and subsequently devalued collateral damage is detected, ranked and classified with statistical techniques, as if regression to the mean will bring back that wedding party that just got turned into a pile of limbs with a hellfire missile.

https://www.theguardian.com/us-news/2014/nov/24/-sp-us-drone...

https://www.reuters.com/article/us-yemen-security-attacks/tw...

Better in this context means more bombs on foreheads.

My understanding was that pathogens are frowned upon because of their mutability. There is a high risk that you end up killing people you weren't targeting...namely your own citizens after your bioweapon mutates into something you don't possess a cure for.

This is not the same problem posed by AI sorting of imagery (Maven) or armed UAVs in general.

It's a lower risk but it could still happen. There's been plenty of embarrassing occasions in the last few years where automation has failed to account for black people -- facial detection and automatic door openers are two off the top of my head

Also, with automated offense, a lot of people may die in short order if you encounter a systemic failure in your targeting + execution

I fail to see the problem here. Do you understand why people would want a motto like "Don't be evil"?
They don't have it anymore. Now it's "do the right thing". What is "the right thing" of course is up to the management to decide.
”still: “And remember… don’t be evil, and if you see something that you think isn’t right – speak up!”

Last line of google company motto. They moved it but “don’t be evil” is still in the motto.

That's not motto, that's code of conduct.
Not true. Here is the agreement which was updated in April 2018.

https://abc.xyz/investor/other/google-code-of-conduct.html

Google wanted to emphasize so they put it on the last line that you read with the document.

The alt right was who made up the story that Google removed it and then picked up by conservative media and then all media was misreporting it.

Typical Google they do not defend themselves and just let it go.

> Google wanted to emphasize so they put it on the last line

That's an odd way to emphasize something. I don't remember any time that I wanted to emphasize something so I put it in the last line of the document.

Pretty long document and what you read last is what you will remember the most.

It is what you are left with. Brains are closer to LIFO than FIFO.

It is why it is easier, usually, to remember things that were more recent than longer ago.

But there are exceptions. I have an incredible memory for things from a very long time ago and not so good at more recent. But I am unusual as my siblings can't remember the same things I can when we were kids and I am younger.

Who cares about Google? What Alphabet does, matters. A new subsidiary with strict confidentiality? They can play with optimizing company structure depending on the area of business as they like.
The contract in question was, in fact, with a totally separate company ("ECS Federal") with confidentiality agreements. The Google execs, in contemporaneous emails, knew from the beginning that it would be opposed and did their utmost to conceal it while acknowledging it would probably leak and suggesting they try to spin it in advance.

https://theintercept.com/2018/05/31/google-leaked-emails-dro...

That doesn't help when Googlers intend on sabotaging Google when Alphabet goes against progressive supremacist Googler ethos. You cannot separate them through secrecy or through force.

The fate of Google is the fate of Alphabet.

This must be quite terrifying for Google the corporation, which is now sandwiched between its own employees and its own government.

The story that has been spun this year has been that Google tacitly accepts politics in the workplace. They might come to regret that.

The corporation has no feelings. Please don't anthropomorphize. Did you mean the people who run the organization like Pichai or Alphabets leadership (Page)?

Why would it terrify them?

In a surprising move, the stock price disagrees with you.
> If you are a large company looking for a home, that is exactly the kind of environment you want to avoid.

You are green either created the account to shield your normal one, or you don't post here.

This is actually excellent news for companies with nothing to hide. And for companies with something resembling a moral compass.

Your comment is extrapolation hyperbole and paints a dichotomy that either the corp is control or the employees are in control when in actuality, it is a vast collection of individuals and groups.

On the other hand, you could think of it as a moral-compass-as-a-service thing. If you are running on Google cloud, it would be a strong signal that you don't do questionable work for military.

That may seem as something that's not worth too much, but on the other hand there's a lot of popular opposition to this kind of thing and companies are starting to notice. Consider this: https://www.dontbankonthebomb.com/new-deutsche-bank-policy-e...

You hurt the credibility and strength of your statements by hiding behind a throwaway account. Doing so also brings into question if you have any ulterior motives.
While there are good intentions here, what happens if China and Russia military get ahead of US military in this technology due to us limiting ourselves
That's where I am too. I mean, war stuff is bad, it kills people, and the US certainly isn't 100% trustworthy.

At the same time... there's a real don't-rock-the-boat problem here. The last 3/4 of a century of US military dominance has been notable for a decrease in military/para-military violence on an order that humanity literally has never seen. It's not zero for sure, it's not always just, we may not always be the good guys, but seriously: if you are a random person anywhere in the world, you are vastly less likely to be killed by someone's bullet than you were pre-WW2. And that's important.

A world without a dominant US military is a world with fewer US-driven injustices. That doesn't seem like a good bet to be a "better world", though.

> the US certainly isn't 100% trustworthy.

The US is the most wildly insane, two-faced and upside-down country in the world right now in terms of military. The commander-in-chief routinely makes nuclear threats, actively hurts his own citizens in times of need, and seeks to decrease military stability by accelerating climate change and isolating his country from the world. The commander-in-chief lies about every single thing in his day-to-day life, as well as his political life; he is mentally unstable and not fit to serve.

The US military is 100% untrustworthy as its direct leader has shown himself to be literally insane.

> there's a real don't-rock-the-boat problem here

The US is the one rocking the boat. It has already happened and it happens daily.

> A world without a dominant US military is a world with fewer US-driven injustices. That doesn't seem like a good bet to be a "better world", though.

I disagree. That seems like a very incredibly great bet, to me. The time of US military leadership is over. That happened the day our Military Commander In Chief stood on his inauguration day and lied about the number of people in front of him.

Perhaps the US will return to a positive leading role one day, but it is not there now and it has not been for years.

All this aside, I do not agree that Google is the right place to develop US Military technology.

Edit: Additionally, the commander-in-chief of the US military also stated point blank that we may not have presidential elections any more in the future. This is not a time to champion US democracy, military might, etc.

Instead of downvoting cryptoz, I encourage people to counter what he said with their own replies. The majority of his statements in this post are verifiable facts. (I do not know this person, fwiw).
I don't down vote him but I understand that some people want to keep political discussions out of this forum, especially when this is not directly related to the original submission.
I agree. I’d guess that the downvoters are thinking along the lines of:

- Sure it’s bad now, but the US military is made up of far more than just the president... many of which may be good, rational actors.

- Just because it’s bad now doesn’t mean it won’t get better quickly (there has been a lot of pushback on the president’s agenda)

- The US may still be comparatively better/benevolent than any other dominant superpower

Note that these aren’t necessarily my views (I’d need more time to think and consider). But I think they point out some decent possible counter arguments to OP

> Sure it’s bad now,

That's the thing though: it's not bad now!. Not by any historical standard, at least.

For most of our history and prehistory, right up to the past 70 years, stupid warfare has been the rule. Petty tribal disputes, armed insurrections, ethnic cleansing and suppression and random gang violence were absolutely routine for almost everyone even as recently as our great grandparent's lifetimes. Virtually everyone saw violence like this at some point. Now, in most of the world (no, not all of it, but yes: most), pretty much no one does.

And that's important. What we've been doing is working. Don't rock the boat.

I actually completely agree with you (Enlightenment Now by Pinker provides excellent data backing all of this up). Our collective pessimism is actually a major problem I think.

But to clarify, when I said “sure it’s bad now” I meant that in the context of the current military leadership.

Unfortunately I can’t really defend that argument much further given that I don’t necessarily agree with it (it was just speculation on potential counter-arguments).

There’s a lot of bad political rhetoric and scare mingering that is frankly not even worthy of my time to address. Like, for example, that Trump will eliminate presidential elections and by implication install himself as president for life, or that he even has the authority or capability to do so.
Of course he doesn't have the authority to do so. He still plans on doing it and that is clearly unstable and not a 'feature' of a solid military you want to have.

I'm not the one fear mongering. It is the US government doing all the fear mongering. The "stable genuis" leading the country is the one doing the fear mongering.

The individual facts are verifiable, but the overall conclusion that "the US is the most wildly insane, two-faced and upside-down country in the world right now in terms of military" is a borderline troll comment - I sense a strong possibility that it is meant to elicit a reaction rather than engage in a dialogue. Not to the point that I'd advocate its removal, but enough for me to downvote and not respond.

Seriously, the US is more insane than North Korea, a country that routinely launches ballistic missiles over countries that are essentially in a state of cold war with it? The United States' military position is more unstable than Venezuela, a county that is imprisoning it's own brass and experiencing large scale desertion[1] to the point that it's speculated that there may be a coup soon? I do not believe a reasonable person make either of these claims.

[1] http://www.miamiherald.com/news/nation-world/world/americas/...

I am not trolling. That's ridiculous. I'm merely speaking the truth.

And yes I would make both of those claims. And I am a reasonable person. If you think that my statements above make me an "unreasonable person" just for my comments of fact and opinion, then you are the one trolling and attempting to invalidate my entire existence as a person.

I stand by my points.

I live in Montenegro, which was a part of Yugoslavia. When Yugoslavia started to break apart the wars started. The wars lasted for almost 10 years, from 1991 to 1999.

American military intervention is the main reason why the wars stopped. For the last 18 years it’s now peace.

I’m an immigrant here so I did not participated in these wars. But I asked locals who did, “do you think the wars would stop unless Americans intervened?” The answer is usually “no, I think we would be still killing each other to this day.”

The US military of the 1990s was a very different organization than it is today. Pretending we have the same solid military leadership right now as we did then is dangerous.
James Mattis, the current Secretary of Defense, was an Military assistant to the Deputy Secretary of Defense during Kosovo. So literally the same person from the 90s is in a key leadership position now in the Military.
So we're just pretending that Trump doesn't exist? There's a big difference between then and today.
Yea basically.

Obviously the President is the final authority of the DoD, and the Chain of Command will obey legal orders, but as was made clear with the Transgender conflict between the SECDEF and POTUS it's not as clear cut as the POTUS saying "do as I say" and it just happening.

The Department of Defense isn't an overtly political organization and has a deep philosophy of operating largely the same irrespective of who the CINC is.

[1] https://www.military.com/daily-news/2018/02/22/mattis-recomm...

> Yea basically.

Pretending Trump doesn't exist is a really, really bad idea. It's extremely dangerous to the democracy that exists in the USA and the world to pretend that the insane President, self-declared dictator of the country simply does not exist.

Your example is a logical fallacy. Merely because the President's orders via tweet were not enacted does not mean you can simply ignore the current situation.

'I have the absolute right to PARDON myself' he said today. He is not a President, the US military is unstable presently due to his leadership, by definition.

For most of that time, the US had an adversary that was roughly on par militarily, ahead in some areas and behind in others. The post WWII peace isn’t built on American dominance, it’s built on MAD.
What is the post-Soviet era peace built on?
Still MAD, I think. The nukes are still there and still ready to go.
> if you are a random person anywhere in the world, you are vastly less likely to be killed by someone's bullet than you were pre-WW2.

You are spouting unsubstantiated nonsense.

Just google it. This isn't even a controversial position, LOTS of folks in academic history love to point this out. Here's a quick slide show about exactly this effect:

https://ourworldindata.org/slides/war-and-violence/#/title-s...

See page 6 for a charge that shows exactly the fact I was citing, though the data as a whole is much broader and worth reading.

So now I'm "substantiated", I guess. You have numbers showing the opposite effect?

Interesting.

I over reacted in the way I perceived how your statement was framed.

Likely, the cabal of employees will continue to feel smug that they took the moral high ground by refusing to contribute to the national defense.
If the Department of Defense primarily concerned itself with national defense, as opposed to political games on the other side of the world, that 'cabal' would probably have fewer members.

Two oceans, a navy, and thousands of nuclear weapons are the national defense of the United States. The rest is empire-building.

Two oceans, a navy, and thousands of nuclear weapons are the national defense of the United States

Don't forget "a rifle behind every blade of grass". [1]

Even if the quote is apocryphal, the overall point is valid.

[1]: https://en.wikiquote.org/wiki/Isoroku_Yamamoto

I don't think there's much of a problem with that. The thing is, the danger from AI weapons is that they will be dumb as bricks and cause unprecedented levels of collateral damage- not that they will somehow take over the world for their evil overlord owners.
Then we'll have fewer weapons at our disposal for fighting our many fruitless and stupid proxy wars around the world.
Then we catch up.

Or we don't, because autonomous killing machines are a big enough risk to all life they're not worth it. For example, you don't see an arms race to develop nastier strains of the flu or ebola, because that would be stupid for everyone.

It's very likely if there were a legitimate threat or need for the technology, employee opinion on helping the military would likely change. China and Russia are regularly highlighted as the bogeymen in these scenarios, but how many people realistically would suggest either is likely to say... invade or fire on the United States?
False Dilemma. Direct invasion is not the only option available to a sufficiently advanced, large scale AI attack. Think of how many ways you can mess with elections, opinions, security, etc. of a target nation without being detected.
You don't retaliate against election tampering with missile strikes.
So, unless the US is faced with imminent invasion, they should stick their heads in the sand?

China is in the process of forcibly taking over an enormous chunk of geography in the south china sea. They have fired on and intimidated their neighbors such as Vietnam and Philippines in connection with this. They continue to undermine and isolate Taiwan. They are a big part of why N Korea has nuclear weapons and ICBMs.

Russia is illegally occupying a big chunk of Ukraine, is involved in shooting down civilian airliners, and assassinating people they don't like with chemical weapons.

At what point would it be advisable to see a trend and try to do something about it?

My personal view is that neither China's interest in the South China Sea nor Russia's interest in the Ukraine constitute an interest in attacking the United States. Both represent territory close to them and far from us.
1 Do you think China will send drones and attack US citizens?

2 Google was claiming they were doing open source work, so China would have access to it anyway

3 If there are enough money in this there will be people going to work on the project, so I am sure the US will have good droning software

4 US brought this on itself with the way they used the drones , like you have the verb "droning"

> 1 Do you think China will send drones and attack US citizens?

It's not unthinkable, especially if they feel confident that they have a technological advantage that would shield them from detection or in-kind retaliation. They also have somewhat different notions of citizenship/nationality than Western countries, and they have a few diasporas they'd like to control.

> 3 If there are enough money in this there will be people going to work on the project, so I am sure the US will have good droning software

What makes you so sure of this, or that those people will have the necessary talent? Lower quality software could lead to more collateral deaths.

> 4 US brought this on itself with the way they used the drones , like you have the verb "droning"

Contemporary drone-strikes are literally just regular airstrikes: for instance, the weapons the drones use were actually developed for other military aircraft [1] [2] and adapted to drones.

[1] https://en.wikipedia.org/wiki/AGM-114_Hellfire

[2] https://en.wikipedia.org/wiki/Joint_Direct_Attack_Munition

The only real difference is that there's no pilot in the plane, so less risk he dies in a crash. And I say crash because most of the drone-strikes happened in places where there were few hostile anti-aircraft weapons to actually shoot anything down. Most of the pilot risk would have been from mechanical problems and human error.

No, the primary difference is that we deploy drones in areas we are not engaged in warfare, and to assassinate various individuals in foreign countries where we are not at war. We could not and would not deploy manned aircraft to do these jobs.

We do not deploy F-35s to assassinate people in Pakistan. But we've been deploying drones there since 2004. Note that a key issue here is that the drone strikes aren't even military actions: They're controlled by the CIA.

There is no technical difference with drones, the issue is entirely in how they are used. This is what makes your arguments about the weaponry being the same mostly irrelevant.

> No, the primary difference is that we deploy drones in areas we are not engaged in warfare, and to assassinate various individuals in foreign countries where we are not at war.

The US hasn't been officialy "at war" in a long time. I think the last one was World War II.

> We do not deploy F-35s to assassinate people in Pakistan.

Of course not: F-35s are more expensive to operate and I'm not sure they've even attained the level of readiness to attempt such a mission.

The point is these aren't even military operations, I am fairly confident it'd be literally illegal for the Air Force to assassinate people in the manner we've been using our drone program.
> The point is these aren't even military operations

I disagree. I would call operations conducted with military equipment and with the participation of military personnel (e.g. USAF pilots) military operations.

https://en.wikipedia.org/wiki/Drone_strikes_in_Pakistan

"under the operational control of the Central Intelligence Agency's Special Activities Division". Feel free to click in and read what SAD does, these are assassinations, not military actions. Remember that military actions are something a government does officially, and assassinations are something denied and covered up for over a decade.

The same Wikipedia article states:

"The drones are flown by United States Air Force pilots located at an unnamed base in the United States. US Department of Defense armed drones, which also sometimes take part in strikes on terrorist targets, are flown by US Air Force pilots located at Creech Air Force Base and Holloman Air Force Base."

>The US hasn't been officialy "at war" in a long time. I think the last one was World War II.

If you believe that then how you call the military operations in recent years and present?

Also if there is no war then people that are killed are just murders/assassinations this murders makes the scientists not want to get involved

>>> No, the primary difference is that we deploy drones in areas we are not engaged in warfare, and to assassinate various individuals in foreign countries where we are not at war.

>> The US hasn't been officialy "at war" in a long time. I think the last one was World War II.

> If you believe that then how you call the military operations in recent years and present?

Wars, for the most part.

So you’re not really arguing the point at all. The drone program is an assassination program which is fundamentally different than somemething like the f-35.
> The drone program is an assassination program which is fundamentally different than somemething like the f-35.

My point is there's no meaningful difference between dropping a JDAM on a particular target with an F-35 or dropping a JDAM on the same target with a drone.

Either way, you dropped a JDAM on a target. Doing it with a drone doesn't magically make the result worse or different somehow.

So in your opinion developers and scientists are not "patriotic" enough, I disagree, if there were some threat many would try to help their country but there is no threat, this weapons are used on dubious external missions.
> So in your opinion developers and scientists are not "patriotic" enough, I disagree

Where, exactly did I say that? You're putting words in my mouth.

If we reduce everything to being ahead of a potential enemy, then we soon get to a point where the solution of all problems is a single deadly upfront attack.

Those technologies aren't for defense; every nation in the world throws loads of money to military expenses -including those countries who have zero chances of being ahead of any other- for a single reason: war is a very profitable business. Everything else is propaganda.

> If we reduce everything to being ahead of a potential enemy, then we soon get to a point where the solution of all problems is a single deadly upfront attack.

> Those technologies aren't for defense;

Have you ever heard of Mutually Assured Destruction? Basically the idea is having "credible deterrent" actually prevents the use of the weapons, because the side that makes a "single deadly upfront attack" will lose along with their opponent. The only winning move is not to play.

The problems happen when one side has capabilities the others lack, or when there are options for a "single deadly upfront attack" that aren't suicide.

In short, "offensive" technologies can be defensive.

https://en.wikipedia.org/wiki/Mutual_assured_destruction

Does this apply only to superpowers over a certain level of military strength? Otherwise one could wonder why Mexico or Canada which have no comparable military power to the US hasn't been invaded yet. I agree in principle that mutual assure destruction can be indeed a valid deterrent, though I hardly believe there aren't others in a civilized world.

To me also there's not that much difference between mutual assured destruction and severe damage. Let's say the US has 100 nukes and Russia only 20 (random numbers just to make an example), all of same power, and let's assume that most of them will be neutralized before hitting the targets so that in case of mutual attack Russia would be hit by say 30 nukes and the US by just 4. History 100 years from now would surely regard it as an epic victory for the US, but today anyone ruling over there would have to explain their citizens how on earth they couldn't take a step back and spare millions of lives.

It's probably much simpler than that. The US, Russia, China, North Korea, etc. have zero intentions to go at war with each other, but is in everyone's interest to keep fueling the weapons industry, so they keep playing the plot: citizens are hooked using nationalist arguments to make them supporting their rulers etc. Weapons keep being amassed until the day they become obsolete and can be sold to less rich countries for their smaller wars, new more advanced weapons take their spot and the business continues. It's a win-win scenario for everyone but common people.

> Otherwise one could wonder why Mexico or Canada which have no comparable military power to the US hasn't been invaded yet.

The USA would never permit them to be invaded. We'd go to an all out war before we'd let a next-door neighbor fall to another country, and every nation knows this.

> though I hardly believe there aren't others in a civilized world.

Where is this civilized World of which you speak? I, sadly, see that the Globe is on fire.

https://en.wikipedia.org/wiki/List_of_ongoing_armed_conflict...

Of course war is a business, no question about that; however the world is a dangerous place, and humans are arguably the most unpredictable mammals alive.

The inverse of this: if USA gets far ahead in this technology, China and Russia will be forced to double down on AI weapons as well, just to keep up. The only country that can cool down an arms race, is the one that's currently leading the pack.
I wonder if Google will conduct a thorough internal investigation on the leak and on the internal opposition to this project? I would hate not to know if it indeed was fueled by non-US citizens from China, Russia and other countries with potentially nefarious intentions to raise the already left leaning 'general population' of their employee base to oppose our national interests (which Google as a US company rightfully should support).

Throwaway account (don't want my meager karma to be down voted to oblivion for speaking my mind).

They are building real-time, total surveillance in support of automated killing by drones, supported by almost all of Google's existing commercial projects (Earth-wide mapping, detailed street maps, business directories, phone-tracked location...).

The NSA programs disclosed by Snowden seem childish by comparison.

Looks like Google is going to wound itself greatly for letting leftists take over their hiring and internal culture. Shunning real diversity of opinion and ability to reason while trying to have diversity of skin color and genitalia.

It appears that the management is starting to realize the danger and fight back hopefully not too late. https://gizmodo.com/alphabet-shareholders-and-employees-want...

When you make a really specific statement, why use the super broad term "leftists"? This american pseudo-dichotomy is not helping the discussion and is just fueling partisanship...
(comment deleted)
Anyone else have a problem with this? Someone else will be doing this work in place of Google, as it is inevitable that AI and defense will merge. So for those reasons, IMO, it is childish to quit and try to not assert some ethical control over something while you can.

Maybe the next co. who fills the contract will be the one where the AI engineers who quit now work?

TLDR: Get the program killed, or control it on your terms ethically. Don't pass it off on the next highest bidder.

Is there an ethical approach to making drones better at killing people?
Yes according to the Red Cross, and experts in International Human Law (aka The Rules of War) - there is an obligation for people to develop these systems (or not) responsibly and TO ALWAYS KEEP A HUMAN IN THE LOOP [1].

Note Nov 2017 was the first annual meeting: the law on this is literally being determined on the fly, so simply running from it rather than providing input and working to determine limits isn't very helpful.

https://www.icrc.org/en/document/expert-meeting-lethal-auton...

https://www.un.org/disarmament/publications/occasionalpapers...

That has nothing to do ML and the statistical targeting of people based on behavior.
Yes. Precision reduces deaths, overall. Do you know what happens when weapons are NOT precise? The military simply uses more of them, and a BUNCH of human beings end up "collateral damage" in the process. Applying AI to help sort "not a threat" from "threat" should result in the US dropping fewer Hellfires on wedding parties.

Operation Meetinghouse, 1945: ~100,000 killed in 2 days https://en.wikipedia.org/wiki/Bombing_of_Tokyo_(10_March_194...

Operation Rolling Thunder, 1965-68: 30,000-100,000 killed over 3 YEARS https://en.wikipedia.org/wiki/Operation_Rolling_Thunder

The numbers are all over the place for Pakistan drone strikes, but even the high-end estimates are <10,000 over the past 10 years. https://en.wikipedia.org/wiki/Drone_strikes_in_Pakistan https://en.wikipedia.org/wiki/Civilian_casualties_from_U.S._... https://theintercept.com/drone-papers/

Engineer's that were working on this should quit and form their own company to continue the work. Whether the drones can autonomously fire or not is a legislative issue. Cloud cert would be a big issue unless they can resell AWS which I believe already has it.
This sends a more powerful message than if the corporation had just avoided the work in the first place. I am hopeful and inspired by the employees stand.

Lights are shining through the cracks in the conflict dominated narrative of these times, and we have never had greater means to analyse and resolve our troubles with each other and with our environment.

Thankyou Googlers for showing up for resolution.

No it doesn't.

It still gives them between 6 months and 18 months (whenever the contract expires in 2019) to continue working on this project. They may even finish it during that timeframe. This is purely PR fluff.

Its not PR fluff that one of the worlds most prestigious workforces has publicly rejected this kind of work. Money cant buy that quality of publicity, it has come from the hearts and minds of the workforce.
If they had listened, they would pull out immediately. Not sure if you realize that they'll continue working on this for a few more months before they are out...
There is certainly going to be a special atmosphere while the few unlucky engineers finish up the existing contract for legalities sake.
Unlikely. Alphabet will spin off the division and sell it for blood$.
Agreed. I used to think google wasnt helping develop killer drones. Them deciding that eventually stopping their killer drone project for the military would be better for business doesn't impress me.
Read articles about the leaked emails. They clearly talk about segueing from this project into additional multi-hundred-million-dollar contracts. So yes, it's a huge win if the Pentagon contracts die with Maven.
The government has perpetual rights to the work products generated under this contract. How is that better?
(comment deleted)
(comment deleted)
Google drops another endeavor. Add it to the graveyard.
So is Google going to keep up this trend of self-criticism? Or have we finally found out how google defines "evil," and it's only things that involve literal killing?