Share

Microsoft calls for laws to prevent bias in facial recognition AI

Microsoft called for new legislation to govern artificial intelligence software for recognising faces, advocating for human review and oversight of the technology in critical cases.

"This includes where decisions may create a risk of bodily or emotional harm to a consumer, where there may be implications on human or fundamental rights, or where a consumer’s personal freedom or privacy may be impinged," Microsoft President and chief legal officer Brad Smith wrote in a blog published in conjunction with a speech on the topic at the Brookings Institution think tank.

Sellers of the technology must "recognise that they are not absolved of their obligation to comply with laws prohibiting discrimination against individual consumers or groups of consumers," he added.

Smith also wants laws to require sellers of the products to explain what they do clearly and open up their services to testing by outside parties for accuracy and bias. Earlier on Thursday, advocacy group AI Now called for greater regulation and regular audits of AI tools used by governments.

There’s rising concern over the use of facial recognition software by law enforcement, border security, the military and beyond. Research has shown that some of the most popular products make mistakes and perform worse on people with darker skin.

Microsoft, Amazon.com and Alphabet’s Google have also faced protests from employees and advocacy groups over the the idea of selling AI software to government agencies or the police. Smith in July called on lawmakers to regulate facial recognition software without offering specific laws he’d like to see.

"The facial recognition genie, so to speak, is just emerging from the bottle," Smith said. "Unless we act, we risk waking up five years from now to find that facial recognition services have spread in ways that exacerbate societal issues. By that time, these challenges will be much more difficult to bottle back up."

Biased outcomes

Microsoft thinks current facial recognition technology increases the risk of biased outcomes, can lead to new intrusions into privacy and can encroach on democratic freedoms if used for mass government surveillance, the executive added.

He wants initial legislation, even if it doesn’t answer all questions, rather than waiting for more comprehensive legal approaches years from now. Smith said in an interview that he’s spoken to state and federal legislators and "there is strong interest." He hopes laws can be in place sometime next year.

Microsoft is also asking for laws that require companies that use facial recognition technology in public areas to place "conspicuous notice" to make customers and passersby aware, Smith said.

In calling for third-party audits of AI products, Smith took a swipe at rivals, without naming them. "When important advocacy organisations have tried to perform tests, they’ve almost immediately been met by rejections and criticism by some providers who claim that the testing is deficient," he said.

In July, Amazon responded to an ACLU critique of its Rekognition service by saying the advocacy group used incorrect settings for the test.

Microsoft plans to clearly document what its AI software can and cannot do, while explicitly prohibiting use of the products for unlawful discrimination. The company also will not provide the technology to customers that it believes could undermine democracies, Smith said.

"We must ensure that the year 2024 doesn’t look like a page from the novel 1984," Smith wrote.

* Sign up to Fin24's top news in your inbox: SUBSCRIBE TO FIN24 NEWSLETTER

We live in a world where facts and fiction get blurred
Who we choose to trust can have a profound impact on our lives. Join thousands of devoted South Africans who look to News24 to bring them news they can trust every day. As we celebrate 25 years, become a News24 subscriber as we strive to keep you informed, inspired and empowered.
Join News24 today
heading
description
username
Show Comments ()
Rand - Dollar
19.08
-0.9%
Rand - Pound
24.03
-0.6%
Rand - Euro
20.57
-0.5%
Rand - Aus dollar
12.38
-0.2%
Rand - Yen
0.13
-0.9%
Platinum
890.97
-0.7%
Palladium
988.99
-1.3%
Gold
2,195.56
+0.0%
Silver
24.43
-0.9%
Brent Crude
86.09
-0.2%
Top 40
67,885
+0.3%
All Share
74,077
+0.2%
Resource 10
56,208
+1.0%
Industrial 25
103,636
+0.4%
Financial 15
16,471
-0.3%
All JSE data delayed by at least 15 minutes Iress logo
Company Snapshot
Editorial feedback and complaints

Contact the public editor with feedback for our journalists, complaints, queries or suggestions about articles on News24.

LEARN MORE
Government tenders

Find public sector tender opportunities in South Africa here.

Government tenders
This portal provides access to information on all tenders made by all public sector organisations in all spheres of government.
Browse tenders