Agreed, where do a I sign up. With the proliferation of license plate readers and other surveillance cameras in the last 5 years it's a matter of time before this creeps out to full algorithmic 'risk scores' for when you have encounters with enforcement. For some that may mean just getting shot [0], while they think someone risky might be in the vehicle, based on association. Or other harassment.
No! Because, for some reason that has no basis in reality, people think computers are less biased than humans! They trust computers OVER PEOPLE, even if the computer is racist, or just wrong.
Humans are accountable, changeable, cross-examinable. Computer systems are not. Please do not give enforcement systems over to computer systems, and have the bias calcified forever.
I fully agree; a neural network can be continuously trained. Software can continuously perform A/B testing and change its mind when its current procedure proves inefficient.
But it doesn't. Current systems do not do this, but people trust in them because machine learning is "more accurate", somehow. It's a huge problem managing expectations around a black box. Online training does not happen in any form at scale. These "fair" systems are, by and large, nonsense.
It really sounds preferable to me, even if the initial versions of these algorithms are biased. They will provide a concrete thing against which to test for bias and improve against. It is easily verifiable if your changes to an algorithm have removed the bias you are worried about. Conversely it is basically impossible to tell if your training on a human has changed their biases in the field, sort of just having them do their job again and see if they are biased.
> They will provide a concrete thing against which to test for bias and improve against.
The history of junk forensic science has pretty clearly demonstrated that nobody in law enforcement cares about testing their biases, or improving the processes.
Law enforcement is general is not good at self-accountability. That accountability has to be rigorously enforced from the outside.
With algorithms, I think it can be done... but given how subtle the negative effects can be, the process must be stringent and err on the side of caution. In other words, any algorithm should be assumed to be biased until proven otherwise, and with a relatively high bar at that. There should be clear technical standards for what constitutes a valid proof. The testing process should be reproducible by third parties. And there should be a straightforward way to challenge either the process itself, or its results in any particular case.
In practice, given how low our bar for law enforcement accountability is today in other cases - including those where people die or are badly hurt - I'd say that we need to fix those issues first before talking about face recognition and its regulation in this context. And until then, it should be off-limits, because the potential for abuse is so high.
> That accountability has to be rigorously enforced from the outside.
I agree. But the reason that we don't have that right now isn't related to whether or not computers are involved, and introducing algorithms won't solve that situation.
The reason that police accountability is weak is political.
Sure. But until we resolve the accountability, we shouldn't increase the power of law enforcement. The more unaccountable power they have, the more it will be abused, and the graver the abuses.
> Law enforcement is general is not good at self-accountability. That accountability has to be rigorously enforced from the outside.
Absolutely. One major positive outcome of the OJ Simpson trial was how Simpson's attorneys completely trashed the police handling of forensic evidence on a national stage, forcing law enforcement across the country to raise their game.
> Risk scores are computed for every traffic stop, wouldn't you want to take that process away from the office and give it to a computer?
What I want is this process to be cross-examinable. You can't cross-examine an algorithm in any meaningful way at a jury trial. You can't cross-examine a neural network at all.
You know all the bullshit about how police dogs are used to conduct illegal searches, and how you can't cross-examine a dog? It'll be like that, but much, much worse.
What we have today is institutional racism based on people’s gut reactions. An NN can be tested and shown that given all other factors it risks race, or any other protected class higher than it should.
> What we have today is institutional racism based on people’s gut reactions.
Institutional racism is not based on people's gut reactions. Institutional racism is based on flawed algorithms. Not computer algorithms in this case, but bureaucratic ones.
I don't see how a flawed computer algorithm would be any easier to correct than a flawed bureaucratic algorithm.
Testing the results of the algorithms doesn't address the problem of institutional racism, though. Any bureaucracy will simply use the results that the algorithm supplies in a way that maintains the behavior that the bureaucracy is already programmed to maintain.
To address things like institutional racism, you have to change the institution. That's a human problem for which there is no technological solution (although technology can certainly be one of the tools used to create a larger change).
We can black box test bureaucracies just as poorly as we can software. For both, all we can do is measure inputs, and outcomes.
Since we've not made much traction on blackbox testing bureaucracies, I'm going to go ahead and say that blackbox testing algorithms will be even worse. (For some dumb reason, people are inclined to trust algorithms.)
Yes, and it is well known that Tesla's self-driving program reproduces Elon Musk's reckless driving habits... /s
I'm just intervening to point out that what you're saying is not what the paper you linked implies. Its title is "Semantics derived automatically from language corpora contain human-like biases", and the general conclusion you could derive from it is that AI programs reflect the stereotypes ... of the data they are trained with. This is why they use the right word: stereotype, instead of the charged word you used: prejudice.
Basically, you punch in a plate and get alerts, nationwide. It's likely that facial recognition technology can associate some car passengers to a vehicle as well.
I don't know this, but I would guess that you'd attract attention if you started driving from South Florida and rolled through the wrong neighborhood in a place like Philly or DC on your way home to Boston.
Yes, unfortunately, in the US the corporations own the government, so such policies, even if very popular, have very little chance of passing if the large companies behind such tech oppose those policies.
This is why you have to go after the companies first and boycott them/cause PR nightmares for them.
We are moving towards minority report. These powerful tools are great, but in the hands of a Tyrant when that day comes (not if), it will come, it will be very difficult to unwind the grip of power with technology so advanced.
The rebels will still find a way, but it will take years and many lives.
The day is upon us.
I'm sure there are many HN readers here now who are actively working to build the open prison system that is America, because of money, power, NDAs, National Security, lies. Basically the only place I find "dissent" is in internet forums, which amounts to some high-falutin hot air being flung around, the same thing we've been doing for years. Most anyone who cares is too scared to do anything, because the government readily destroys any problematic individual or group. As an individual, you are powerless. If you group, they will know.
That it's now fashionable to install always-on microphones in people's homes, that we carry always-on cell phones broadcasting our information wherever we go, that the streets and skies are covered in cameras and sensors watching our every movement, yet we mill about with casual disregard for the implications, gives me little hope that, as citizens, we could ever collectively wake up or rise up. We are taught fear and hate and division. If we should ever forget, they'll remind us by writing messages with our blood. We point fingers at a bumbling scapegoat sitting in a temporary seat, while the real power lies off-camera.
Even a proposal "requesting a report on the impact of government use of certain technologies" lost 94k to 239k. Source in the same SEC filing mentioned in the article.
> The tech firm had said it was aware of civil rights concerns but had not received any reports of law enforcement clients misusing its Rekognition tool.
This really depends on their definition of "misuse", which can be molded to suit their financial goals. Eventually reports of questionable law enforcement use will come in, and I have serious doubts that any large corporation would willingly cut off sales to a large set of existing government clients. This area desperately needs regulation.
> I have serious doubts that any large corporation would willingly cut off sales to a large set of existing government clients.
Barret stopped selling to CA government agencies after CA banned "regular peasants" from owning Barret's flagship product.
That said, this situation is very different politically. People aren't going to stop using AWS en-masse because Amazon is helping enable the police state.
Same for New York now that we can't own them there either. Nice to have someone stand up for us at least, as opposed to all those that will still happily sell to law enforcement.
I’m not sure how I feel about facial recognition. On one hand, I think code is just information and no piece of information should be illegal to possess. I also think we need to protect our rights with math and code not laws.
But I’m not sure that would help against the very real and dystopian future that seems just around the corner. Facial recognition is probably the key cornerstone of said future and I’m not sure what we should do.
Banning facial recognition also feels wrong to me, and violates the aforementioned axiom about information.
Moreover, many cities are already blanketed in thousands of government cameras and facial recognition doesn’t seem like anymore an abridgement of our privacy than the cameras alone.
Maybe we should just ban police cameras on streets? But the ship has probably already sailed on that one.
Human rights are not a mathematical or computer science concept, they are in fact a law concept. I know it's tempting for computer people on hackernews to want to solve problems with the tools of their own domain - but law is exactly the place where rights need to be protected, not code.
But it would help a lot of developers didn't work on technologies that clearly lead to a dystopian future, or for companies that are working toward the direction. I know that would never happen, but it would sure help.
If you don't have axiomatic beliefs, then where do your beliefs come from? Some abstract feeling? Whatever "feels" right?
Clearly (to me at least), you need a system of axiomatic beliefs. If your axioms don't form a coherent system (i.e you can prove a contradiction), then you really don't believe anything at all.
It's surprising to me that very few people think about morality this way. Everyone has a different view of morality of course, but you should at the very least try and distill it into an elegant system that is a) consistent and b) has sufficient predictive power to be useful.
An example of a system that fulfills a) but not b) would be something like: There's no morality anyone can do anything they want. That's only one axiom and pretty elegant as systems go. The problem with it is that it's so trivial that it can't assign value judgements to anything at all, rendering it all but worthless.
The system that I tend to follow has three primary axioms:
1) There are two kinds of things in the world: people and property.
2) People own property and they can do anything they want with said property as long as it doesn't violate the rights of others to do the same. Moreover, the person himself is property and thus is solely owned by himself.
3) By violating the axioms above, one forfeits his right to the above axioms.
While not perfect, this system is internally consistent and also has sufficient predictive power:
If someone punches me, he's violating my property of myself (2), and therefore can be sent to jail (3). If I break into someones house, same thing: violates (2) and therefore can be punished by (3).
There are some things that the system can't assign judgements to, however: What are children? What rights do they have? What about abortion? What exactly violates someone else's property? Does air pollution can't as violation? What about the environment? What rights to animals have (the system says they're property, but some people might have a problem with others torturing animals, for example)? Where does the government get it's legitimacy? Can the government levy taxes? etc etc etc
In truth, the things it can't make judgements about are probably than the things it can. But I personally haven't found a better or more elegant system to frame the world in, so I generally stick with it while being aware of it's limitations.
> If you don't have axiomatic beliefs, then where do your beliefs come from? Some abstract feeling? Whatever "feels" right?
The answer to your first question is "oftentimes, yes" to the second two.
There is this pervasive myth held by people who tend to gravitate towards "functional" fields like ours--that is, technology, math, the logical sciences, and so on--that the human existence can be distilled into a series of logical statements that can be evaluated at different times and, given the same inputs, will always produce the same outputs. (It's the same origin as the myth of the "perfectly rational actor" in economic systems that makes a lot of assumptions that are invalid in the context of how people truly function.) This myth misses a key thing about humans: thinking animals are not computers.
What feels right or what beliefs someone holds can and usually do change over time as someone's existence progresses and new experiences are had. This is where some of our greatest benefits, like the ability to experience art in new and different ways depending on the context or situation or even just our mood, and some of our greatest tragedies, like holding one set of people to be negatively different based on an arbitrary criteria, originate. Saying that if someone's beliefs can't be reduced to "code" causes them to be invalid is against the human condition.
The problem with trying to get to a elegant set of moral axioms is that human morality is a product of multiple conflicting and contradictory goals compiled and obfuscated by evolution, a mother of all one-way optimization processes. Confound it with the fact that most of those goals are not of individuals but of genes and of gene groups. We are mere executors in that regard.
At best you could distill down to multiple separate self-consistent trees of moral rules and model individual humans as sets of weights for those.
> law is exactly the place where rights need to be protected, not code.
It is possible to do two things at once and provide overlapping protection. When something has both technical and legal defenses, that thing is safer than having only one or the other.
To what extent is there such a thing as a "right not to be recognized"? If there is such a right, can it not be exercised--against machine as well as man--simply by wearing a mask?
Due to some recent health issues, my Dad's driver license was temporarily revoked. He can't drive again until his doctor decides it's safe. So now my step mother is doing all the driving and anytime they go somewhere, they get pulled over by the police. This is a consequence of police cameras and software I had never thought of before and I have mixed feelings about it.
Can you elaborate? Are you saying the police in your area have facial recognition and pull over any car where the driver isn't who the car is registered to? I'm confused.
I think it's just an ALPR system. The car is registered in my Dad's name and since his license is suspended, the machine in the cruiser tells the officer to stop the car.
Dunno why you are downvoted (I assume that's what greyed text means, if not, mea culpa), but that's the world we live in I guess.
I'd say that the more general problem is that we all had privacy at one time due to the difficulties in gathering/parsing/storing. People used to be able to expect that their criminal record was somewhat private, that private conversations in public places were private, that their locations were private. 'Forgotten' can be interchanged for 'private' in these cases.
There was no real protection in terms of law, just in terms of practicality.
The great irony of modern times is that the sea change was schlepped in with the market for advertising, not your local Stasi. Of course, the cops are happy to use it if it exists.
> Moreover, many cities are already blanketed in thousands of government cameras and facial recognition doesn’t seem like anymore an abridgement of our privacy than the cameras alone.
SuperRecognizers plus facial recognition bans makes me think of Dune-style people as computers. Instead of a computer running the program we just have the guys in Room 901 do it.
Youre looking for the word "Mentat" (Dune human 'computers'. They were used after the AI war that turned computers against humans. When the humans won, they banned all forms of machine learning.)
And that's how facial recog is legal. Its legal to put people in public and write down who they are. So its legal for a computer to do it.
Is this really a valid test anymore with 50%+ of outstanding shares being held by index funds? Who actually controls the companies when shareholders don't really exist like they used to?
You're right - index funds voting really hurts the process, largely because index funds don't ask their investor base how they should vote. Instead, they default to following corporate recommendations and voting down any shareholder proposals.
So really, all those shares are voted according to what corporate management wants, not to what the original retail investors want. It's distorting the power balance in a really perverse way.
It's hard to say at the moment, because the data isn't available yet, but I bet index funds voted >95% against this proposal - that's the historical average.
We'll know for sure what the stats are once the fund providers disclose their voting, which happens yearly.
It seems like their duty to the index fund owners is to vote like other shareholders (which is most easily achieved by abstaining) and not like management.
It's interesting to think about index fund providers incentives:
(1) track the market
(2) do it very cheaply
Voting shares is a cost center with no benefit towards the business. Fund providers don't want to spend time and money to do research on individual proposals, that would be too expensive. So they do the cheapest thing possible and default to following corporate recs.
(That's actually a simplification, what happens in practice is, they use third party proxy voting advisors, but the end results is mostly the same, except that they vote down really egregious proposals, e.g. crazy CEO pay in the context of a free falling share price)
Suppose index funds collectively own 80% of the shares. If they don't vote or do something that causes their vote to equal the other shareholders, someone else can buy 10% of the shares and effectively have majority voting power, or even fewer than that since most likely some of the other non-index fund owners wouldn't vote either.
The problem is that you need somebody who is paying attention to be in control of the company. Putting that on management is problematic because they obviously have different interest than owners, e.g. on matters of executive compensation or whether to return profits to shareholders instead of using them to build a personal empire/reputation or funneling money to cronies through mergers and acquisitions.
Index funds are passive by design. In your scenario, allowing 10% ownership to exert control seems like it’s functioning as it should. The alternative is that control is held by the advisor that the index fund listens to.
> Suppose index funds collectively own 80% of the shares. If they don't vote or do something that causes their vote to equal the other shareholders, someone else can buy 10% of the shares and effectively have majority voting power, or even fewer than that since most likely some of the other non-index fund owners wouldn't vote either.
Instead, they vote the board recommendations, disenfranchise all the individual shareholders, and rubber stamp almost anything the board wants. I'm not sure that's any better.
So as a verified shareholder, you can signal your support for various issues, and the startup then arranges a meeting with the fund managers if enough people support the idea.
Unfortunately, what it probably means is "make as much money for shareholders as possible". At least, as determined by executives whose pay is going to ultimately be a fraction of that profit, and who thus have a vested interest in that interpretation as the sole interpretation.
With the rise of index funds also comes the rise of the idea of a 'universal owner' solving the tragedy of the commons.[0] If you own a piece of every company, like Vanguard or BlackRock, your funds benefit when the whole economy does well. Your incentive is to advance society, not to promote any one company at the expense of the others. In that way, you internalize externalities -- like climate change. Or in this case, getting industry-wide action on privacy/security.
That said, this idea hasn't sunk in with fund managers yet. They're beginning to talk about caring about 'social purpose'[1] but still voting against it[2].
So the retail investors will have to demonstrate they care in order for anything to change, and they don't even get a vote through mutual funds.
> If you own a piece of every company, like Vanguard or BlackRock, your funds benefit when the whole economy does well.
Index funds only target top companies. Externalities tend to b
eenefit those top companies while harming little companies as well as poor people, often not even in the same country.
Index funds are limited to public companies, which implies a certain size. That said, across a fund manager's assets are a lot of small cap and mid cap funds, which explicitly target smaller companies. In that sense, index funds do not only target the top companies.
If you mean top as in performance, that is also not the case. Index funds are based on the premise that they do not aggressively pick winners and losers within a sector, in contrast to active funds. This lets index funds hire fewer staff and charge fewer fees. Economists generally agree that over time, index funds outperform active funds on a risk-adjusted basis after accounting for fees.
Most surprising thing in that was that the request to generate a report on the management of food waste reached a support level of 25%! I am really surprised that this is an important issue to Amazon shareholders.
We are going to metric each other to death: I'll make you worry about food spoilage in the fridge at your work and you harp on water usage in the restrooms at my work until we are all enslaved by our own 401ks tied up in index funds!
Considering the hellscape that is working in an Amazon warehouse I'm amazed anyone thought it was going to pass. A company that makes its employees piss in bottles doesn't give a damn about the slow erosion of American privacy rights.
Americans haven’t had privacy rights in a while and while the technology is new and fancy, American citizens haven’t been as free as they think they are in a while considering PRISM, border control checks that include your fingerprints and have the right to demand access your personal devices...
I'm surprised to see content from such a high-profile site as the BBC with typographical errors: "The Bloomberg news agency and CNBC are bother reporting that"
I had used Amazon Rekognition in our dating product extensively for moderation till Aug 2018, it was in-accurate for people with darker skin often with wrong gender and age identification.
I had contacted them regarding these issues and was told that they are working with new models. I haven't tested it recently to see if the situation had improved.
I didn't use the Face Recognition API for privacy reasons, I assume that would be the most used API by law-enforcement; but if it is anything like my experience then I would be very worried for some innocent to be wrongly tagged by the system.
> I would be very worried for some innocent to be wrongly tagged by the system.
You should. Law enforcement in particular doesn't think that false positives are that big of a deal (after all, they argue, all that would cause is a cop to talk to the wrong person). They prefer to accept more false positives if that means fewer false negatives.
Won't work. You'll be matched on gait, the way you carry yourself. This scares the shit out of me, but what scares me more is that it doesn't also scare the shit out of everyone else.
93 comments
[ 3.2 ms ] story [ 158 ms ] threadWhile that's obviously challenging, targeting Amazon specifically doesn't actually improve the status quo in a lasting way.
[0] https://www.latimes.com/local/lanow/la-me-ln-no-charges-lapd...
Risk scores are computed for every traffic stop, wouldn't you want to take that process away from the office and give it to a computer?
Humans are accountable, changeable, cross-examinable. Computer systems are not. Please do not give enforcement systems over to computer systems, and have the bias calcified forever.
Computer systems are accountable, changeable, and cross-examinable. Arguably more so than humans.
I do stipulate that computer systems can be racist or otherwise biased and can be "just wrong".
The human mind tends to be set in its ways.
The history of junk forensic science has pretty clearly demonstrated that nobody in law enforcement cares about testing their biases, or improving the processes.
If it gets them results, they'll use it.
With algorithms, I think it can be done... but given how subtle the negative effects can be, the process must be stringent and err on the side of caution. In other words, any algorithm should be assumed to be biased until proven otherwise, and with a relatively high bar at that. There should be clear technical standards for what constitutes a valid proof. The testing process should be reproducible by third parties. And there should be a straightforward way to challenge either the process itself, or its results in any particular case.
In practice, given how low our bar for law enforcement accountability is today in other cases - including those where people die or are badly hurt - I'd say that we need to fix those issues first before talking about face recognition and its regulation in this context. And until then, it should be off-limits, because the potential for abuse is so high.
I agree. But the reason that we don't have that right now isn't related to whether or not computers are involved, and introducing algorithms won't solve that situation.
The reason that police accountability is weak is political.
Absolutely. One major positive outcome of the OJ Simpson trial was how Simpson's attorneys completely trashed the police handling of forensic evidence on a national stage, forcing law enforcement across the country to raise their game.
Please never enter politics.
What I want is this process to be cross-examinable. You can't cross-examine an algorithm in any meaningful way at a jury trial. You can't cross-examine a neural network at all.
You know all the bullshit about how police dogs are used to conduct illegal searches, and how you can't cross-examine a dog? It'll be like that, but much, much worse.
https://en.m.wikipedia.org/wiki/Bayesian_inference#Applicati...
What we have today is institutional racism based on people’s gut reactions. An NN can be tested and shown that given all other factors it risks race, or any other protected class higher than it should.
Institutional racism is not based on people's gut reactions. Institutional racism is based on flawed algorithms. Not computer algorithms in this case, but bureaucratic ones.
I don't see how a flawed computer algorithm would be any easier to correct than a flawed bureaucratic algorithm.
To address things like institutional racism, you have to change the institution. That's a human problem for which there is no technological solution (although technology can certainly be one of the tools used to create a larger change).
Since we've not made much traction on blackbox testing bureaucracies, I'm going to go ahead and say that blackbox testing algorithms will be even worse. (For some dumb reason, people are inclined to trust algorithms.)
https://science.sciencemag.org/content/356/6334/183.full
I'm just intervening to point out that what you're saying is not what the paper you linked implies. Its title is "Semantics derived automatically from language corpora contain human-like biases", and the general conclusion you could derive from it is that AI programs reflect the stereotypes ... of the data they are trained with. This is why they use the right word: stereotype, instead of the charged word you used: prejudice.
See: https://www.vigilantsolutions.com/products/license-plate-rec...
Basically, you punch in a plate and get alerts, nationwide. It's likely that facial recognition technology can associate some car passengers to a vehicle as well.
See: https://www.aclu.org/blog/free-future/license-plate-scanners...
I don't know this, but I would guess that you'd attract attention if you started driving from South Florida and rolled through the wrong neighborhood in a place like Philly or DC on your way home to Boston.
This is why you have to go after the companies first and boycott them/cause PR nightmares for them.
The rebels will still find a way, but it will take years and many lives.
That it's now fashionable to install always-on microphones in people's homes, that we carry always-on cell phones broadcasting our information wherever we go, that the streets and skies are covered in cameras and sensors watching our every movement, yet we mill about with casual disregard for the implications, gives me little hope that, as citizens, we could ever collectively wake up or rise up. We are taught fear and hate and division. If we should ever forget, they'll remind us by writing messages with our blood. We point fingers at a bumbling scapegoat sitting in a temporary seat, while the real power lies off-camera.
This really depends on their definition of "misuse", which can be molded to suit their financial goals. Eventually reports of questionable law enforcement use will come in, and I have serious doubts that any large corporation would willingly cut off sales to a large set of existing government clients. This area desperately needs regulation.
Barret stopped selling to CA government agencies after CA banned "regular peasants" from owning Barret's flagship product.
That said, this situation is very different politically. People aren't going to stop using AWS en-masse because Amazon is helping enable the police state.
But I’m not sure that would help against the very real and dystopian future that seems just around the corner. Facial recognition is probably the key cornerstone of said future and I’m not sure what we should do.
Banning facial recognition also feels wrong to me, and violates the aforementioned axiom about information.
Moreover, many cities are already blanketed in thousands of government cameras and facial recognition doesn’t seem like anymore an abridgement of our privacy than the cameras alone.
Maybe we should just ban police cameras on streets? But the ship has probably already sailed on that one.
Clearly (to me at least), you need a system of axiomatic beliefs. If your axioms don't form a coherent system (i.e you can prove a contradiction), then you really don't believe anything at all.
It's surprising to me that very few people think about morality this way. Everyone has a different view of morality of course, but you should at the very least try and distill it into an elegant system that is a) consistent and b) has sufficient predictive power to be useful.
An example of a system that fulfills a) but not b) would be something like: There's no morality anyone can do anything they want. That's only one axiom and pretty elegant as systems go. The problem with it is that it's so trivial that it can't assign value judgements to anything at all, rendering it all but worthless.
The system that I tend to follow has three primary axioms:
1) There are two kinds of things in the world: people and property.
2) People own property and they can do anything they want with said property as long as it doesn't violate the rights of others to do the same. Moreover, the person himself is property and thus is solely owned by himself.
3) By violating the axioms above, one forfeits his right to the above axioms.
While not perfect, this system is internally consistent and also has sufficient predictive power:
If someone punches me, he's violating my property of myself (2), and therefore can be sent to jail (3). If I break into someones house, same thing: violates (2) and therefore can be punished by (3).
There are some things that the system can't assign judgements to, however: What are children? What rights do they have? What about abortion? What exactly violates someone else's property? Does air pollution can't as violation? What about the environment? What rights to animals have (the system says they're property, but some people might have a problem with others torturing animals, for example)? Where does the government get it's legitimacy? Can the government levy taxes? etc etc etc
In truth, the things it can't make judgements about are probably than the things it can. But I personally haven't found a better or more elegant system to frame the world in, so I generally stick with it while being aware of it's limitations.
The answer to your first question is "oftentimes, yes" to the second two.
There is this pervasive myth held by people who tend to gravitate towards "functional" fields like ours--that is, technology, math, the logical sciences, and so on--that the human existence can be distilled into a series of logical statements that can be evaluated at different times and, given the same inputs, will always produce the same outputs. (It's the same origin as the myth of the "perfectly rational actor" in economic systems that makes a lot of assumptions that are invalid in the context of how people truly function.) This myth misses a key thing about humans: thinking animals are not computers.
What feels right or what beliefs someone holds can and usually do change over time as someone's existence progresses and new experiences are had. This is where some of our greatest benefits, like the ability to experience art in new and different ways depending on the context or situation or even just our mood, and some of our greatest tragedies, like holding one set of people to be negatively different based on an arbitrary criteria, originate. Saying that if someone's beliefs can't be reduced to "code" causes them to be invalid is against the human condition.
At best you could distill down to multiple separate self-consistent trees of moral rules and model individual humans as sets of weights for those.
It is possible to do two things at once and provide overlapping protection. When something has both technical and legal defenses, that thing is safer than having only one or the other.
I don't think there are any easy answers.
I'd say that the more general problem is that we all had privacy at one time due to the difficulties in gathering/parsing/storing. People used to be able to expect that their criminal record was somewhat private, that private conversations in public places were private, that their locations were private. 'Forgotten' can be interchanged for 'private' in these cases.
There was no real protection in terms of law, just in terms of practicality.
The great irony of modern times is that the sea change was schlepped in with the market for advertising, not your local Stasi. Of course, the cops are happy to use it if it exists.
It sure does to me.
And that's how facial recog is legal. Its legal to put people in public and write down who they are. So its legal for a computer to do it.
And I even wrote my own for a 2015 maker convention and deployed this. No GPU, no internet. CPU bound and worked very well: https://hackaday.com/2015/03/04/face-recognition-for-your-ne...
Aside lawmakers restricting law-upholders (hah), we've got a snowballs chance in hell in solving this.
FaceRec is here to stay. :(
What does shareholder primacy even mean anymore?
So really, all those shares are voted according to what corporate management wants, not to what the original retail investors want. It's distorting the power balance in a really perverse way.
It's hard to say at the moment, because the data isn't available yet, but I bet index funds voted >95% against this proposal - that's the historical average. We'll know for sure what the stats are once the fund providers disclose their voting, which happens yearly.
It seems like their duty to the index fund owners is to vote like other shareholders (which is most easily achieved by abstaining) and not like management.
Individuals are exempt for that.
It's interesting to think about index fund providers incentives:
(1) track the market (2) do it very cheaply
Voting shares is a cost center with no benefit towards the business. Fund providers don't want to spend time and money to do research on individual proposals, that would be too expensive. So they do the cheapest thing possible and default to following corporate recs.
(That's actually a simplification, what happens in practice is, they use third party proxy voting advisors, but the end results is mostly the same, except that they vote down really egregious proposals, e.g. crazy CEO pay in the context of a free falling share price)
I've building a startup for that -- you can support petitions like https://www.yourstake.org/ask/vanguard-demand-companies-disc...
Suppose index funds collectively own 80% of the shares. If they don't vote or do something that causes their vote to equal the other shareholders, someone else can buy 10% of the shares and effectively have majority voting power, or even fewer than that since most likely some of the other non-index fund owners wouldn't vote either.
The problem is that you need somebody who is paying attention to be in control of the company. Putting that on management is problematic because they obviously have different interest than owners, e.g. on matters of executive compensation or whether to return profits to shareholders instead of using them to build a personal empire/reputation or funneling money to cronies through mergers and acquisitions.
Instead, they vote the board recommendations, disenfranchise all the individual shareholders, and rubber stamp almost anything the board wants. I'm not sure that's any better.
This startup organizes retail shareholders to use their rights via petition, e.g. https://www.yourstake.org/ask/vanguard-demand-companies-disc... .
So as a verified shareholder, you can signal your support for various issues, and the startup then arranges a meeting with the fund managers if enough people support the idea.
With the rise of index funds also comes the rise of the idea of a 'universal owner' solving the tragedy of the commons.[0] If you own a piece of every company, like Vanguard or BlackRock, your funds benefit when the whole economy does well. Your incentive is to advance society, not to promote any one company at the expense of the others. In that way, you internalize externalities -- like climate change. Or in this case, getting industry-wide action on privacy/security.
That said, this idea hasn't sunk in with fund managers yet. They're beginning to talk about caring about 'social purpose'[1] but still voting against it[2].
So the retail investors will have to demonstrate they care in order for anything to change, and they don't even get a vote through mutual funds.
I built this website to organize verified retail investors around petitions, in order to do that. You can support petitions like this https://www.yourstake.org/ask/vanguard-demand-companies-disc... or this https://www.yourstake.org/ask/amazoncom-inc-facial-recogniti...
----
[0] https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3014952
[1] https://www.blackrock.com/corporate/investor-relations/larry...
[2] https://www.cnbc.com/2019/03/18/large-fund-firms-support-for...
Index funds only target top companies. Externalities tend to b eenefit those top companies while harming little companies as well as poor people, often not even in the same country.
If you mean top as in performance, that is also not the case. Index funds are based on the premise that they do not aggressively pick winners and losers within a sector, in contrast to active funds. This lets index funds hire fewer staff and charge fewer fees. Economists generally agree that over time, index funds outperform active funds on a risk-adjusted basis after accounting for fees.
Americans haven’t had privacy rights in a while and while the technology is new and fancy, American citizens haven’t been as free as they think they are in a while considering PRISM, border control checks that include your fingerprints and have the right to demand access your personal devices...
I had contacted them regarding these issues and was told that they are working with new models. I haven't tested it recently to see if the situation had improved.
I didn't use the Face Recognition API for privacy reasons, I assume that would be the most used API by law-enforcement; but if it is anything like my experience then I would be very worried for some innocent to be wrongly tagged by the system.
You should. Law enforcement in particular doesn't think that false positives are that big of a deal (after all, they argue, all that would cause is a cop to talk to the wrong person). They prefer to accept more false positives if that means fewer false negatives.
I disagree entirely with that.