Innocent woman arrested in false-positive in facial recognition system in Brazil
This is the second day of operation of the system, according to the press. However, a restricted version of the same FRS was used for 15 days during the Carnaval festivities with no alarming failures and reportedly resulted in a few arrests.
It has now been deployed in 25 locations in Copacabana. (Anedoctally, I live here and can't tell you where they are - the equipment, cameras, etc. must be well hidden, or I'm terrible at spotting them).
Source, in Portuguese: "Facial recognition fails in its second day and innocent woman confused with criminal is arrested" https://oglobo.globo.com/rio/reconhecimento-facial-falha-em-segundo-dia-mulher-inocente-confundida-com-criminosa-ja-presa-23798913
Related previous submission (with zero comments): https://news.ycombinator.com/item?id=19074434
47 comments
[ 3.0 ms ] story [ 86.8 ms ] thread> She was detained and taken to the police station
What's that if it's not an arrest?
An arrest is when you're charged with a crime. It's a much more serious situation.
In many countries people can be held for significant amounts of time without being formally charged with any crime.
https://criminal-law.freeadvice.com/criminal-law/arrests_and...
This is what happened (detention): "I was working and the police arrived. They confounded me with someone else they were looking for and I had to go to the police station and prove I wasn't that person. What a day".
Not this (arrest): ""I was working and the police arrived. They confounded me with someone else they were looking for and I had to go to the police station and prove I wasn't that person. They still didn't believe me and I'm in a jail cell waiting for a judge to hear my case. I don't think I'll be home for a few days".
Good thing no one is ever harmed while being detained but not yet arrested. /s
The arresting officer still has the responsibility though to decide whether or not to use deadly force against the person should they resist the false arrest.
[1] https://californiainnocenceproject.org/issues-we-face/eyewit...
The first is one relates to this application of facial recognition targeting poor people. This woman had no documentation on her. I'd wager this is really common in Brazil. How could she possibly prove she is _NOT_ the person the software with 99.999..% accuracy says she is?
If the actual criminal wasn't already in jail, would she be set free in the same day she was arrested?
The second issue is perhaps more universal to other automations, but certainly potentializes the first one, dealing with _scale_. Human cops can't check every person they see against the entire database of wanted people.
25% of false-positives from every cop is a hell of a lot less than 0.00001% of an automated system when applied to every crowd, everywhere, all the time.
My understanding is that the automation is to verify people who are needed by law, right? They don't voluntarily hear a beep and go into the jail. There are police officers that still have to arrest them and check their documents.
The situation is so bad in Rio that society simply will have to deal with any deficiencies in the automated system. It will still be better than the current reality.
The fact that police officers are probably not giving people of color enough flexibility in situations like these is beyond the scope of the automation system.
EDIT: Carrying your documents is not a popular opinion among the US audience, I understand. Still, I find it very reasonable and I think the situation that happened to this woman is being blown out of proportion.
Who is "we"? Non-citizens of the USA are required to carry their immigration status documents with them, [1] and checkpoints within the 100-mile border zone (where 2/3 of the population lives [2]) are one place where they must be presented. If you are a US citizen without proof, and are stopped, and the official thinks you are lying, I believe you are going to have A Bad Day.
[1] https://www.aclu.org/blog/immigrants-rights/immigrants-right...
[2] https://www.aclu.org/other/constitution-100-mile-border-zone
e.g. US citizen Valeria Alvarado was shot and killed when she panicked and tried to get away from plainclothes CBP agents.
Coming from Eastern Europe originally, I carry my ID everywhere as a matter of habit in Canada; but in turn get very very very nervous and uncomfortable if it's taken from me (for example, at hotels in some countries, or at the border for a quick check).
She couldn't prove it any more of the source of the erroneous identification was a human looking at a wanted picture and matching her against it.
Any reasonable criminal justice system incorporates the fact that innocent people will be arrested because it's impractical to impose high proof requirements for arrest, but at the same time will provide due process and have high proof requirements for conviction.
If a justice system has a problem on either of those dimensions z they need urgently to be addressed independently of the use of facial recognition as an input to arrest decisions.
OK, so for a given facial profile, 0.001% of people passing in a crowd will be incorrectly identified as a match. That's 1 in 100,000 people who pass by will be incorrectly matched against a particular profile, correct? How many people walk past this camera? 1000 in a day? How many cameras are deployed in an area? How many facial profiles does it have in its database that it is checking against?
It seems to me that if you have a lot of faces you are looking for and a big crowd, or even a modest crowd, then you are going to get a lot of false positives. Now if the wanted person walks past the camera then it has a chance to get its identification correct. If they don't walk past that camera there's no chance to get its identification correct. A given streetcorner with a camera where 1000 people walk past in a day may be in a city with 5 million people, only one of whom is the wanted person, and who might never pass that streetcorner.
Given all this, if a match is triggered, what are the actual odds that the person is the right person? Is it more than 1 in 100? More than 1 in 1000? Does an officer have probable cause for an arrest if there is a 0.1% chance someone has done something? Do they have reasonable suspicion for a detention? Is the officer justified in shooting and killing the person who has had a facial match if they attempt to arrest the person and the person runs away?
A judge is not simply going "oh sorry, the system tells me it was you and I can't verify that. Gotta trust it".
But under the current authoritarian Brazilian president "human rights" has been demonized.
Rio de Janeiro's Governor has advocated for snipers to shoot-to-kill people identified as criminals in the favelas. It's horrible.