Amazon, Apple, Google, IBM, Microsoft speech-to-text AI systems can't understand black people as well as whites
- Reference: 1585083394
- News link: https://www.theregister.co.uk/2020/03/24/speech_to_text_ai_system/
- Source link:
The [1]study , led by academics at Stanford University and Georgetown University in America, probed five “state-of-the-art” automated speech recognition (ASR) systems from Amazon, Apple, Google, IBM, and Microsoft, which transcribe speech-to-text.
“We found that all five ASR systems exhibited substantial racial disparities, with an average word error rate (WER) of 0.35 for black speakers compared with 0.19 for white speakers,” the paper stated.
That means for every one hundred words blabbered, the machine-learning models failed to understand 35 words for black speakers compared to 19 words for white speakers, on average.
Apple was the worst: researchers reported a WER of 0.45 for black speakers compared to 0.23 for white speakers. Microsoft, however, was the best with WERs at 0.27 and 0.15 for both groups.
[2]
The word error rate (WER) for ASR systems developed by Apple, Amazon, Google, IBM, and Microsoft. The red dashed line is the average WER for black speakers and the blue dashed line is the average WER for white speakers. Image credit: Koenecke et al.
"We use the [speech-to-text] APIs provided by each of the service providers which are paid services generally for commercial use,” Allison Koenecke, first author of the paper and a PhD student at Stanford University’s Institute for Computational and Mathematical Engineering, told The Register .
“We do not use the firms' consumer-facing voice assistants because they do not provide a straightforward way to obtain batch transcriptions of about 40 hours of audio files, and could require playing audio out loud – adding an additional source of error – as opposed to directly obtaining audio from a .WAV file.”
Speech-to-text systems are broken into two parts: a language model trained on text and an acoustic model trained on sounds. Black speakers are more likely to use African American Vernacular English (AAVE), a style of English that has its own grammatical rules and vocabulary. The researchers believe the acoustic side of ASRs from all five companies were simply not trained on enough audio data from AAVE speakers to recognize what they were saying.
When the researchers fed audio snippets to all five ASR models of people from both groups uttering identical sentences, they still performed worse for black speakers. Here, the average WER was 0.13 compared to 0.07 for black and white people. Thus, the WER between black and white speakers isn’t necessarily due to slang words in AAVE: the acoustic detection in the models is fundamentally not up to scratch.
London's top cop dismisses 'highly inaccurate or ill informed' facial-recognition critics, possibly ironically [3]READ MORE
“These results suggest that racial disparities in ASR performance are related to differences in pronunciation and prosody – including rhythm, pitch, syllable accenting, vowel duration, and lenition – between white and black speakers,” the researchers reckoned.
Two datasets were used to test the ASR systems: Corpus of Regional African American Language (CORAAL) and Voices of California (VOC). Some 115 volunteers – 42 white people and 73 black people – from five different US cities were interviewed to collectively generate 19.8 hours of audio for both datasets.
CORAAL contains black speakers who use AAVE to various degrees, and hail from Princeville, a city known for its historic African American population, as well as Rochester, New York, and Washington DC.
VOC is made up of white speakers from Sacramento and Humboldt County, California. Although the researchers are confident that ASRs exhibit biases, they hope to test their conclusions by calculating WERs for white and black speakers from the same city.
“Our findings highlight the need for the speech recognition community—including makers of speech recognition systems, academic speech recognition researchers, and government sponsors of speech research—to invest resources into ensuring that systems are broadly inclusive,” they concluded.
“Such an effort, we believe, should entail not only better collection of data on AAVE speech but also better collection of data on other nonstandard varieties of English, whose speakers may similarly be burdened by poor ASR performance—including those with regional and nonnative-English accents.”
The team also called for developers in industry and researchers in academia to work together to test widely adopted ASR models regularly to assess progress over time. ®
[1] https://www.pnas.org/content/early/2020/03/17/1915768117
[2] https://regmedia.co.uk/2020/03/24/wer_speech_recognition.jpg
[3] https://www.theregister.co.uk/2020/02/25/uk_facial_recognition/
Re: Racist, really?
Indeed. Many intersectional feminists say these days (although obviously they are full of it) that racism is all about power. I'm not sure what kind of "power" a speech-to-text system can be said to have. It's just a program.
I can't understand a lot of Scots. Does that make me racist?
"I can't understand a lot of Scots. Does that make me racist?"
I can't understand most northern UK accents, I must admit. That doesn't make me a racist.
However, if I was training a speech-recognition AI and left out a load of accents because I don't care for nor understand them, didn't think about them, or thought it would just work without them, then you might well be able to call me biased.
C.
The study is flawed as it assumes race creates an accent and speech patterns.
The researchers should have directed their attention to the many hilarious videos in youtube, of mostly white people in the UK that do not have a BBC English accent, where they are pleading, shouting, screaming and swearing at Alexa, Siri or Google.
"it assumes race creates an accent and speech patterns"
Sure, there are plenty of people, millions, many, many millions, who are non-white, but due to their upbringing, speak and sound exactly the surrounding white population.
This study isn't about people like them. It's about AI not having enough training data to recognize a *range* of accents. And it happens to be that the accents lacking coverage are those from black communities. There's the bias.
C.
'I say, my good man, could you tell me where the bathroom is?'
On holiday in America a few years back I discovered that I got a better response from people if I used a phoney American accent when asking them a question
I'm not sure who was being racist.
Also: I have a voice controlled model Dalek and that only seems to understand me if I do my Captain Picard impersonation.
They forgot to load the Jive language pack.
Racist , really (part ii)
And what were the scores for other groups, dare i say the Browns, the Yellows, The Reds etc? NOT the Greens, they oft speak with plummy accents.
Asians, Latinos, Hispanics, real Africans etc.
Omitted completely.
> Black speakers are more likely to use African American Vernacular English (AAVE), a style of English that has its own grammatical rules and vocabulary.
So, erm not English then.
I'm sure if I used a lot of b*llshit words instead of well established and understood ones, it would have a hard time understanding me.
Based on my experience
I'm guessing that it would still do better with Black American english than with my Irish english.
Racist, really?
Not sure how a computer can be “racist” exactly. Maybe there were more white voices sampled than black voices, so it’s inherently more accurate with white voices. That sampling may just reflect the demographic of the population. It could be that someone writing the software specifically wrote or such that it wasn’t able to recognise black voices as well, but I think that is pretty unlikely.
Unfortunately with the current ridiculously over-PC atmosphere, if someone has the slightest opportunity call something or someone racist, they’ll take it.