All of the above, preferably. Government agencies for law enforcement may be exempt anyway.
Perhaps the only decent use is a biometric ID or passport and should be regulated as identification data on those documents, that is rigorously.
The dislike for facial recognition technology is another one of those hard to comprehend stances for me. The article is more like a moral call to action, it doesnt contain any facts or information or even arguments against it. All I can find is that it claims "costly errors, discrimination and privacy invasions" are the problem.
How can facial recognition software possibly cause all of that? Software operation basically free, discrimination is ridiculous - if anything it helps with less discrimination, it scans everybody after all. and then privacy invasion? You mean you walk around in public spaces and you think you have a right not to be recorded? How is this different from a police officer walking by and scanning your face?
No, in reality this debate is a weird sort of antitech sentiment. It's like a symptom of a deep dissatisfaction with how fast the world is developing and people want to go back to the good old times. Well sorry, but I actually like the fact that a criminal can get caught in minutes because his face is scanned.
> The researchers Joy Buolamwini at Massachusetts Institute of Technology in Cambridge and Timnit Gebru, then at Microsoft Research in New York City, showed that some of the most advanced facial-recognition software failed to accurately identify dark-skinned women 35% of the time, compared to a 1% error rate for white men. Separate work showed that these technologies mismatched 28 US members of Congress to a database of mugshots, with a nearly 40% error rate for members of colour. Researchers at the University of Essex in Colchester, UK, tested a facial-recognition technology used by London’s Metropolitan Police, and found it made just 8 correct matches out of a series of 42, an error rate they suspect would not be found lawful in court.
I dont see why it should be difficult to debug unless you think this is all some kind of conspiratorial plot by white people or the "white system" who are all secretely racist against black people and that's why the detection rate was purposefully kept low by these evil people.
And implying that we have to be irrational to be ethical is also pretty weird.
It's not a "conspiratorial plot", no. But time and again, research has shown that the implicit biases held by the people building these tools [0] are observable in the tool's results — and all people hold implicit biases.
It's not the tool we need to debug; it's us.
[0] Where, by "these tools", I mean machine learning writ large.
EDIT: I highly doubt your comment's parent was suggesting we had to be irrational in order to be ethical. Rather, I believe they meant we should be rational and ethical. Wouldn't you agree?
It was a long time ago, but have you read it? Because if I recall correctly, the surveillance happened inside your own home from your own TV. Other than that, the book '1984' wasnt really about surveillance, it's more about a system of lies and the transformation of speech into a political tool to control people.
I don't think you're recalling correctly: surveillance was a huge part of how people were controlled in 1984. It wasn't the only tool, but it certainly was a main one of them.
It was about totalitarianism. An inescapable State.
Public surveillance everywhere is a precursor to that.
The surveillance within your home is very much already a reality.
Now we have people welcoming this creeping totalitarianism with concerns of safety. Trading justice for individual crimes at the ever-growing risk of totalitarianism.
This is a very narrow view of potential applications of facial recognition. I take it for granted that this technology has enormous affordances for social control. "Criminality" may be an out-of date notion of the kinds of behaviors that governments and other institutions like those in workplaces (e.g. the academy, employers, corporations). Surveillance has major political implications and we should not treat the advancement of technology as independent from the society and the political economy.
Surveillance is the key concept in a major design of social control, Bentham's "Panopticon." When anyone may be watched, people must live expecting that they will be watched, and the will of those with the power to create sanctions will enacted. This will be a historical novelty if facial recognition systems become widespread. Historically, only limited public venues were subject to effective widespread surveillance (except in extreme authoritarian cases like East Germany). Increasingly, online spaces are subject to surveillance that is limited by browser instrumentation, with facial recognition it will be possible to track people offline as well, if you have access to the cameras.
Surveillance is the twin of transparency, which can be thought of as possible tool for democratic control. I do believe that transparency i.e. through freedom of information acts has some positive characteristics for democracy but has a weak empirical record compared to panoptic control. Facial recognition might have affordances for collective action, such as making it easy to produce evidence of excesses or corruption.
That said, maybe we should not give the authorities the power to implement technological changes without the consent of the governed? Technology moves faster than policies can adapt to them, but old laws and institutions like the police evolved in times when the tools of day could not have been imagined.
Edit:
Regulating technologies like facial recognition popularizes the control of social systems which counter acts authoritarianism and high concentration of power and resources.
Ok so outside of their own home people have to behave as if somebody watches them 24/7. No offense, but we already have data on what that kind of belief produces and that's the belief that God always watches you. Seems to be beneficial.
>> Technology moves faster than policies can adapt to them, but old laws and institutions like the police evolved in times when the tools of day could not have been imagined.
I would like to seriously ask you to consider a more nuanced stance on this subject, as you now seem either uninformed about the technology behind these systems or wilfully naive. Please consider the dangers that could spring from such capabilities, if not now, then in some time when another power has control of these capabilities.
How about 3rd parties collecting video feeds from a number of city locations, analyzing and face-recognizing people in them, cross-referencing that with other sources and building a database that they sell to private investigators and other interested parties. Combine that with license plate DBs and you can track movement of anyone both by car and on foot. Then you can get even more creative and cross-reference that data with marital status of people and find those who're seen walking the street or having a drink with someone who's not their partner (which we can find thanks to soc. networks). And boom, you've got yourself a mass-scale blackmailing tool that runs on auto-pilot. Possibilities are endless, and it's not even that hard to build something like that anymore.
Not intending to tow the libertarian line here, but I find it concerning when regulation is proposed for a technology in a vacuum. We should see how facial recognition develops and how the powers that be utilize it first. Only then can we see if it is being used in a way which offends societal values, and only then should we create laws and regulations to curb such behavior which are specific in nature and not overly broad. Right now this is somewhat speculative.
I think much of the fear around facial recognition is that it could be (or is being) used for mass surveillance. The Supreme Court has already deemed mass surveillance unconstitutional under the 4th amendment [1]. Perhaps the solution to curb the misuse of facial recognition is to ban mass surveillance itself, and not ban the tool.
Facebook/Youtube/Twitter et al uses mass surveillance to place ads. Netflix uses it to decide what movies and shows to make. Google uses it to rank info. Insurance companies use it to decide prices. The more data we have the more everything is going to look like mass surveillance. Agree with your first para. Let it play out. Allow people/orgs to fuck up as they will and then regulate.
Regulation proposal: all video data and derivatives (face recognition) of public areas must be publicly available. Sort of GPL-like. The resulting effects will force people to rethink and reevaluate current policies.
It was a reductio ad absurdum paraphrase of your own argument.
Imagine this law was passed. Joe of Joe's Garage doesn't read BoingBoing and has no issues complying with the new law which obliges him to pass the security tapes he used to delete because they were so uninteresting to an agency representing SpouseTracker.com, and is not at all interested in revising his views of the necessity of collecting data of possible crimes against his business in the unlikely event he reads a paper about aggregating camera data to track individuals or an article about a stalker who tracked the target of their obsession using public feeds of nearby CCTV cameras, even if he makes the connection. The proprietors of SpouseTracker.com and stalkers everywhere thank the privacy advocates for their support.
"To prevent cities being turned into panopticons, we should make sharing data with people trying to build them mandatory"
The reason why panopticons work is because the prisoners don't know what the guards can see. And due to this asymmetric power relation, it is very hard to revolt. There are two solutions: either prevent the information gathering, or make the information publicly available. The former solution is not possible if you don't know what information is being gathered, so we are left with the second solution (to start with).
Sure, but I have literally no interest in revolting and there is no possible world in which a revolt would succeed due to the Evil Dictatorship dutifully uploading all their information advantages to a public server.
Back in the real world, I don't have any issues with the supermarket videoing me self-scanning, but would have issues with them being compelled to share information on my shopping habits in real time with literally anybody that wanted to know where I was and what I was doing right now and who I was with...
A supermarket is not a public space. All I am saying is that all information gathered in the public space should be shared publicly. The idea being: anyone could have been there and recorded that information (since it is public). This will prevent those with deep pockets to create a panopticon of our public environment.
34 comments
[ 3.0 ms ] story [ 75.5 ms ] threadIt is important to apply ethics when developing technology, as rationality alone is not sufficient.
It's not the tool we need to debug; it's us.
[0] Where, by "these tools", I mean machine learning writ large.
EDIT: I highly doubt your comment's parent was suggesting we had to be irrational in order to be ethical. Rather, I believe they meant we should be rational and ethical. Wouldn't you agree?
The right? Maybe not. But I surely don’t want Big Brother always watching. I gotta ask, have you read 1984?
Public surveillance everywhere is a precursor to that.
The surveillance within your home is very much already a reality.
Now we have people welcoming this creeping totalitarianism with concerns of safety. Trading justice for individual crimes at the ever-growing risk of totalitarianism.
If facial recognition were widely deployed and the data matched up, it would be more like a police officer following around wherever you go, 24/7.
The fear is that you could use the tech to build ultra-detailed activity profiles of any person
Surveillance is the key concept in a major design of social control, Bentham's "Panopticon." When anyone may be watched, people must live expecting that they will be watched, and the will of those with the power to create sanctions will enacted. This will be a historical novelty if facial recognition systems become widespread. Historically, only limited public venues were subject to effective widespread surveillance (except in extreme authoritarian cases like East Germany). Increasingly, online spaces are subject to surveillance that is limited by browser instrumentation, with facial recognition it will be possible to track people offline as well, if you have access to the cameras.
Surveillance is the twin of transparency, which can be thought of as possible tool for democratic control. I do believe that transparency i.e. through freedom of information acts has some positive characteristics for democracy but has a weak empirical record compared to panoptic control. Facial recognition might have affordances for collective action, such as making it easy to produce evidence of excesses or corruption.
That said, maybe we should not give the authorities the power to implement technological changes without the consent of the governed? Technology moves faster than policies can adapt to them, but old laws and institutions like the police evolved in times when the tools of day could not have been imagined.
Edit: Regulating technologies like facial recognition popularizes the control of social systems which counter acts authoritarianism and high concentration of power and resources.
Very good point.
The problem isn't that there could be mistakes or bias in the technology, but that no one can be held accountable for them.
I think much of the fear around facial recognition is that it could be (or is being) used for mass surveillance. The Supreme Court has already deemed mass surveillance unconstitutional under the 4th amendment [1]. Perhaps the solution to curb the misuse of facial recognition is to ban mass surveillance itself, and not ban the tool.
[1] https://www.washingtonpost.com/opinions/the-supreme-court-ju...
Imagine this law was passed. Joe of Joe's Garage doesn't read BoingBoing and has no issues complying with the new law which obliges him to pass the security tapes he used to delete because they were so uninteresting to an agency representing SpouseTracker.com, and is not at all interested in revising his views of the necessity of collecting data of possible crimes against his business in the unlikely event he reads a paper about aggregating camera data to track individuals or an article about a stalker who tracked the target of their obsession using public feeds of nearby CCTV cameras, even if he makes the connection. The proprietors of SpouseTracker.com and stalkers everywhere thank the privacy advocates for their support.
"To prevent cities being turned into panopticons, we should make sharing data with people trying to build them mandatory"
The reason why panopticons work is because the prisoners don't know what the guards can see. And due to this asymmetric power relation, it is very hard to revolt. There are two solutions: either prevent the information gathering, or make the information publicly available. The former solution is not possible if you don't know what information is being gathered, so we are left with the second solution (to start with).
Back in the real world, I don't have any issues with the supermarket videoing me self-scanning, but would have issues with them being compelled to share information on my shopping habits in real time with literally anybody that wanted to know where I was and what I was doing right now and who I was with...