AI assistants work perfectly in the UK – unless you're from Cardiff, Glasgow, Liverpool, Birmingham, Belfast...
- Reference: 1596120312
- News link: https://www.theregister.co.uk/2020/07/30/ai_assistants_uswitch_accents/
- Source link:
Such is the conclusion reached by comparison website Uswitch, which found that smart speakers from the likes of Google and Amazon have difficulty understanding more than 23 per cent of UK accents.
The firm's research homed in on accents in 30 Brit cities and recorded each asking the AI assistant 10 everyday questions or commands. The cities were then scored out of 10 on voice clarity; the higher the score, the more errors encountered.
Another pointer that helped was to look at how many times people from these cities searched: "Why doesn't Alexa/Google understand me?" Google's keyword planner was used to collect the data, which was then added to the above metrics to deliver an overall score.
The questions were simple stuff, preceded by the device's wake word: What is the weather like today?; What is the time?; Play the next song, please; Set an alarm for *time*; What is the date today?; Play *radio station or song*; Could you turn it down, please; How do you spell *word*?; Mute/unmute; Please can you turn off the lights?
Easy, right? Not if your received pronunciation needs work. The top five cities that AI assistants struggled to understand all have their own regional accents – Cardiff in Wales came first with a score of 82 followed by Glasgow in Scotland (77), Liverpool (70) and Birmingham (65), both in England, and Belfast in Northern Ireland (64).
At the other end of the scale, the English capital of London was the easiest to understand with a low score of 11 followed by Lincoln (15), Chester (16), Derby (21), and Cambridge (also 21).
The full report can be found [1]here and shows a clear north-south divide, suggesting that the training models used to inform the devices are biased towards a generic strain of English accent.
Essex named sexiest British accent followed closely by, um, Glaswegian [2]READ MORE
Nick Baker, broadband expert at Uswitch.com, commented: "Smart speakers are becoming an integral part of many modern-day homes. While most of us find them useful it's clear that more needs to be done to make voice recognition features smoother. The use of artificial intelligence in products is only going to increase, and as it grows in popularity it's important that features are accessible to all. The more we use virtual assistants the better they will get at understanding us. Some brands are already taking steps to allow assistants to learn about our accents which should avoid alienating customers and improve user experience."
Perhaps it would help if Americans realised that Brits don't all sound like Giles from Buffy The Vampire Slayer . ®
Get our [3]Tech Resources
[1] https://www.uswitch.com/broadband/smart-speakers-vs-accents/
[2] https://www.theregister.com/2019/05/10/essex_named_sexiest_british_accent_followed_closely_by_glaswegian/
[3] https://whitepapers.theregister.com/
Yet another reason
To not use them
Just in case the privacy issues were not sufficient
Re: Yet another reason
I suppose misunderstanding cancels out the privacy issues.
Re: Yet another reason
Might be a good reason to use them - incoherent data to jam up the algorithm.
Eleven!
https://www.youtube.com/watch?v=NMS2VnDveP8
Once they've sorted out Belfast they still have North Antrim to deal with.
Both my Amazon Echo's have been unplugged because a typical conversation went:
alexa: turn the front room lights down
There is no device called from room
alexa: turn the living room lights down
You wot m8?
alexa: .... nevermind
Smart assistants only need to understand one thing
Me: Alexa! Shut the f*$k up!
Alexa: [stops playing music or whatever it is saying]
Lego Movie anyone?
This gag was in a Lego Movie, I remember my son watching this part over and over. Can't get my google fu to find it either. I thought it was the unintelligible voice that did unlock it...
Re: Lego Movie anyone?
https://www.youtube.com/watch?v=JUM3uuAqBV0
Reminds me of trying to get to the operator from some hotel phone in New York some time in the 80s. "Say operator to connect to the operator." Any many attempts it was discovered that "ahparaeter" was the needed utterance.
Voice Calling on an Andriod Phone Anybody?
Frankly, do not bother with voice access things ever. Nokia had it working back in about 2008, Android/Google still cannot recognise a thing that is said to it in 2020.
Is non-operative voice features a design feature?
Yank Accents
I wonder how badly these systems fail with some very pronounced Southern drawls which can be hard for other Southerners to understand.
Re: Yank Accents
Or some inner city accents.
Rural Georgia - I can pick up most of it. Inner Atlanta? Not a chance.
And how did the Apple or Samsung solutions perform?
The article mentions Google & Alexa but no mention of how the Apple or Samsung solutions performed.
Would be interesting to know if they are equally as bad.
> people outside of London may as well not speak English
For many of us, people inside London do not speak English. For example the word button has two Ts in it. It is not pronounced "bu-un."
I once heard a Canadian comic perfectly describe his problem understanding Scots accents - we pronounce all the letters. The less Alexa, Siri, etc understand us the better imo.
Or indeed Gwendoline Post
I assure that the misunderstanding happens on an equal opportunities basis. Now where did I leave that glove?