Microsoft Turns Down Police Contract Over AI Bias Concerns

Microsoft has reportedly refused to install facial recognition technology for a US police force, due to concerns about artificial intelligence (AI) bias.

President Brad Smit said that the software giant recently rejected a California law enforcement agency’s request to install facial recognition technology in officers’ cars and body cameras due to human rights concerns.

It comes as governments and firms around the world increasingly grapple with the ethical use of AI.

Microsoft refusals

Microsoft took the decision according to Reuters, after it concluded it would lead to innocent women and minorities being disproportionately held for questioning. Microsoft took this stance because artificial intelligence has apparently been trained on mostly white and male pictures.
https://uk.reuters.com/article/uk-microsoft-ai/microsoft-turned-down-facial-recognition-sales-on-human-rights-concerns-idUKKCN1RS2FY

And multiple research projects have apparently found that AI has more cases of mistaken identity with women and minorities.

“Anytime they pulled anyone over, they wanted to run a face scan” against a database of suspects, Smith reportedly said. However he declined to name the police force involved.

After thinking through the uneven impact, “we said this technology is not your answer.”

Smith made the comments whilst speaking at a Stanford University conference on “human-centered artificial intelligence.”

Microsoft also refused a deal to install facial recognition on cameras in the capital city of an unnamed country. Redmond took the decision because the non-profit Freedom House had deemed the country in question was not free.

Smith said it would have suppressed freedom of assembly there.

But Microsoft did reportedly agree to provide the technology to an American prison, after it concluded that the environment would be limited and that it would improve safety inside the unnamed institution.

Corporate ethics

This display of corporate ethics comes amid an intense debate about machine-learning and artificial intelligence.

The British government for example has just launched an inquiry into the use of AI and potential bias in legal matters.

Smith also used the event to call for greater regulation of facial recognition and other uses of artificial intelligence, and he warned that without that, companies amassing the most data might win the race to develop the best AI in a “race to the bottom.”

Google for example has tied itself in knots over the issue.

Late last month Google created the ‘Advanced Technology External Advisory Council (ATEAC)’, to offer guidance on the ethical use of AI.

But only a week later it disbanded the council over concern of a couple of its female members.

And Google also caused deep anger among its employees (some of whom resigned) over its involvement in a Pentagon project codenamed Project Maven. The Pentagon drone project had utilised Google’s AI technology.

Following that, Alphabet CEO Sundar Pichai last year created new principles for AI use at Google, and pledged not to use AI for technology that causes injury to people.

Put your knowledge of artificial intelligence (AI) to the test. Try our quiz!

Tom Jowitt

Tom Jowitt is a leading British tech freelancer and long standing contributor to Silicon UK. He is also a bit of a Lord of the Rings nut...

Recent Posts

Google Invests $350m In India’s Flipkart

Google becomes minority shareholder in Walmart-owned Amazon competitor Flipkart as it progresses investment plans in…

12 hours ago

Boeing Starliner Set For 1 June Crewed Launch

Crewed flight of Boeing's Starliner planned to be final test to certify long-delayed vehicle for…

13 hours ago

Travel, Retail Firms Say EU Rules Slash Their Google Traffic

Airline, hotel, retail firms say their interests must be taken into account in Google's implementation…

13 hours ago

Elon Musk’s xAI In $6bn Funding Round Valuing It At $24bn

Elon Musk artificial intelligence start-up xAI concludes $6bn funding round valuing it at $24bn in…

14 hours ago

TikTok Cuts ‘Hundreds’ Of Jobs

TikTok to cut jobs from operations and marketing teams amidst broader ByteDance restructuring, as it…

14 hours ago

Google To Begin Manufacturing Pixel Smartphones In India

Google set to begin Pixel smartphone manufacturing in Indian state of Tamil Nadu as electronics…

15 hours ago