Facial recognition tech put his life at risk. Congress needs to act now.

Biased algorithms have very real consequences.
By Keith Wagstaff  on 
Facial recognition tech put his life at risk. Congress needs to act now.

Earlier this year, for the first time (that we know of), a false match by a facial recognition algorithm led to the arrest of an innocent man.

Now, members of Congress are finally taking action. On Thursday, Sens. Ed Markey and Jeff Merkley, and Reps. Pramila Jayapal and Ayanna Pressley, all Democrats, introduced the Facial Recognition and Biometric Technology Moratorium Act of 2020. It's the most aggressive move yet by Congress to limit the use of facial recognition by police, in this case, by banning federal law enforcement from using it and cutting off state and local police from federal grants if they fail to do the same.

That it was an innocent Black man who was falsely accused and arrested is not a surprise. A federal study published last year found that facial recognition technology misidentified Black and Asian faces 10 to 100 times more often than white faces.

The only “evidence” against Robert Julian-Borchak Williams, according to the New York Times, was an algorithm used by the Michigan State Police that matched his driver’s license photo with blurry surveillance footage. Police were sent to arrest a confused Williams on his front lawn, in front of his two young daughters and wife.

After spending $1,000 on bail and 30 hours in jail, Williams was released by the Detroit Police Department. When the cops realized their mistake, the Times reports, a police officer said: “I guess the computer got it wrong.”

Yeah, the computer got it wrong.

Mashable Top Stories
Stay connected with the hottest stories of the day and the latest entertainment news.
Sign up for Mashable's Top Stories newsletter
By signing up you agree to our Terms of Use and Privacy Policy.
Thanks for signing up!

George Floyd. Michael Brown. Eric Garner. The list of Black people killed by police is so long. Contrast that with the many incentives for people — tech CEOs hungry for lucrative contracts, politicians screaming "law and order," cops who want an easy fix — to push facial recognition technology. It's a terrifying and deadly combination.

Putting pressure on corporations alone won't fix the problem. Amazon's "moratorium" on selling its facial recognition tech to police departments is vague and only lasts a year. IBM said it won't sell facial recognition tech to police, while Microsoft said it would institute a similar ban until federal laws regulating it were in place.

And there are plenty of other players in the industry. DataWorks Plus, which built the software that led to Williams' arrest and uses an algorithm cited in the federal bias study, says it "provides solutions" to "more than 1,000 agencies, both large and small." It doesn't have a public-facing consumer business to worry about. Neither does Clearview AI — yes, that Clearview AI, the creepy company that scraped billions of photos from social media networks without asking permission. Public outrage doesn't matter to them. They never promised to not be evil.

That's why lawmakers need to take action. The Facial Recognition and Biometric Technology Moratorium Act of 2020 bans federal law enforcement from using facial recognition technology. It also prevents state and local law enforcement agencies from accepting federal grants if they use the technology.

The Electric Privacy Information Center (EPIC), a privacy and human rights non-profit, didn't think past bills, including the recently proposed Justice in Policing Act, went far enough to prohibit use of facial recognition technology. Jeramie D. Scott, senior counsel at EPIC, said they were "too limited in their reach" or had "wide-ranging exceptions." But it endorses the Facial Recognition and Biometric Technology Moratorium Act.

So does Fight for the Future. The digital rights non-profit said in a statement the bill "effectively bans law enforcement use of facial recognition in the United States," and that Congress should pass it "soon as possible." And the ACLU says the bill "should immediately pass."

Robert Williams survived his encounter with police. But the next facial recognition "match" might not.

Mashable Image
Keith Wagstaff

Keith Wagstaff is an assistant editor at Mashable and a terrible Settlers of Catan player. He has written for TIME, The Wall Street Journal Magazine, NBC News, The Village Voice, VICE, GQ and New York Magazine, among many other reputable and not-so-reputable publications. After nearly a decade in New York City, he now lives in his native Los Angeles.


Recommended For You
'Challengers' review: You're not ready for Zendaya's horny love-triangle drama
Mike Faist as Art, Zendaya as Tashi and Josh O’Connor as Patrick in "Challengers."


Summer Movie Preview: Every film you oughta know
A composite of movie stills from summer movies.

'Boy Kills World' review: Awesome action, but…
Bill Skarsgård readies for battle in in "Boy Kills World."

'The Feeling That the Time for Doing Something Has Passed' review: A minimalist sex comedy
Joanna Arnow stars in "The Feeling That the Time for Doing Something Has Passed."

Trending on Mashable
NYT Connections today: See hints and answers for April 26
A phone displaying the New York Times game 'Connections.'

Wordle today: Here's the answer and hints for April 26
a phone displaying Wordle

NYT's The Mini crossword answers for April 26
Closeup view of crossword puzzle clues

NYT Connections today: See hints and answers for April 25
A phone displaying the New York Times game 'Connections.'

The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use and Privacy Policy. You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!