Study shows people are not good at recognising voices

June 19, 2017 by Carolyn Mcgettigan And Nadine Lavan, The Conversation
Computers can pick up the specific acoustic features of each individual voice. Credit: Shutterstock

"Alexa, who am I?" Amazon Echo's voice-controlled virtual assistant, Alexa, doesn't have an answer to that – yet. However, for other applications of speech technology, computer algorithms are increasingly able to discriminate, recognise and identify individuals from voice recordings.

Of course, these algorithms are far from perfect, as was recently shown when a BBC journalist broke into his own voice-controlled bank account using his twin brother's voice. Is this a case of computers just failing at something humans can do perfectly? We decided to find out.

Each human being has a voice that is distinct and different from everyone else's. So it seems intuitive that we'd be able to identify someone from their voice fairly easily. But how well can you actually do this? When it comes to recognising your closest family and friends, you're probably quite good. But would you be able to recognise the voice of your first primary school teacher if you heard them again today? How about the guy on the train this morning who was shouting into his phone? What if you had to pick him out, not from his talking voice, but from samples of his laughter, or singing?

To date, research has only explored voice identity perception using a limited set of vocalisations, for example sentences that have been read aloud or snippets of conversational speech. These studies have found that we can actually recognise voices of familiar people's speech quite well. But they have also shown that there are problems: ear-witness testimonies are notoriously unreliable and inaccurate.

It's important to keep in mind that these studies have not captured much of the flexibility of the sounds we can make with our voices. This is bound to have an effect on how we process the identity of the person behind the voice we are listening to. Therefore, we are currently missing a very large and important piece of the puzzle.

Recognising voices requires two broad processes to operate together: we need to distinguish between the voices of different people (telling people apart) and we need to be able to attribute a single identity to all the different sounds (talking, laughing, shouting) that can come from the same person ("telling people together"). We set out to investigate the limits of these abilities in humans.

Voice experiment

Our recent study, published in the Journal of Experimental Psychology: General, confirms that voice identity perception can be extremely challenging. Capitalising on how variable a single person's voice can be, we presented 46 listeners with laughter and vowels produced by five people. Listeners were asked to make a very simple judgement about pairs of sounds: were they made by the same person, or by two different people? As long as they could compare vowels to vowels or laughter to laughter respectively, discriminating between speakers was relatively successful.

But when we asked our listeners to make this judgement based on a mixed pair of sounds, such as directly comparing vowels to laughter in a pair, they couldn't discriminate between speakers at all – especially if they were not familiar with the speaker. However, even though a sub-group of people who knew the speakers performed better overall, they still struggled significantly with the challenge of "telling people together".

Similar effects have been reported by studies showing, for example, that it is difficult to recognise a bilingual speaker across their two languages. What's surprising about these findings is how bad voice perception can be once listeners are exposed to natural variation in the sounds that a voice can produce. So, it's intriguing to consider that while we each have a unique voice, we don't yet know how useful that uniqueness is.

But why have we evolved to have unique voices if we can't even recognise them? That's really an open question so far. We don't actually know whether we have evolved to have unique voices – we also all have different and largely unique fingerprints, but there's no evolutionary advantage to that as far as we can tell. It just so happens that based on differences in anatomy and, probably most importantly, how we use our voice, that we all sound different to each other.

Luckily computer algorithms are still able to make the most of the individuality of the human voice. They have probably already outdone humans in some cases – and they will keep on improving. The way these recognise speakers is based on mathematical solutions to create "voice prints" – unique representations picking up the specific acoustic features of each individual voice.

In contrast to computers, humans might not know what they are listening out for, or how to separate out these acoustic features. So, the way that prints are created for the algorithms is not closely modelled on what human listeners appear to do – we're still working on this. In the long term, it will be interesting to see if there is any overlap in the way human listeners and machine-learning algorithms recognise voices. While human listeners are unlikely to glean any insights from how computers solve this problem, conversely we might be able to build machines that emulate effective aspects of human performance.

It is rumoured that Amazon is currently working on teaching Alexa how to identify specific users by their voice. If this works, it will be a truly impressive feat and may put a stop to further unwanted orders of dollhouses. But, do be patient if Alexa makes mistakes – you may not be able to do it any better yourself.

Explore further: Google Home's assistant can now recognize different voices

Related Stories

Google Home's assistant can now recognize different voices

April 20, 2017
Google's voice-activated assistant can now recognize who's talking to it on Google's Home speaker.

Starbucks launches voice ordering via app, Amazon's Alexa

January 30, 2017
Amazon's Alexa is now able to order up a latte.

Gadget makers offer voice controls through Amazon's Alexa

January 5, 2017
Amazon doesn't have an official presence at the CES gadget show in Las Vegas but its Alexa voice control software seems to be everywhere.

What makes your voice yours? Researchers take steps to characterize and quantify voice quality

December 2, 2016
What are the characteristics of the way you say, "hello," (or anything else for that matter) that makes you recognizable over the phone? Despite the increasing amount of literature on personal voice quality, very little is ...

Body size conveyed by voice determines vocal attractiveness

April 24, 2013
Deep male voices and high-pitched female voices are perceived as more attractive because listeners gauge the speaker's body size from the frequency of their voice, according to research published April 24 in the open access ...

Recommended for you

Gender 'nonconformity' takes mental toll on teens

September 25, 2018
(HealthDay)—American teens whose behavior, appearance or lifestyle do not conform to widely held views on what it is to be a "normal" male or female face a high risk for mental distress and drug abuse, new research warns.

To dispel myths, redirect the belief, study says

September 24, 2018
Beliefs can be hard to change, even if they are scientifically wrong. But those on the fence about an idea can be swayed after hearing facts related to the misinformation, according to a study led by Princeton University.

Children found capable of using the 'wisdom of crowds'

September 24, 2018
Children, like adults, can improve their response to difficult tasks by the power of group work, new research led by the University of Bristol has found.

Leading addiction experts call for more neuroscience research on long-term recovery

September 24, 2018
September is addiction recovery month, and, in the midst of the current opioid epidemic, it's an apt moment for addiction research experts to map the future path forward for a long-term recovery strategy for substance abuse. ...

Eye training to help children with dyspraxia

September 24, 2018
Children with a coordination disorder can improve skills like throwing and catching with new training videos developed by the University of Exeter.

Take a step back from yourself to better realize the benefits of awe

September 24, 2018
Religion and nature can both lead to awe, and turning to one or the other is a common coping strategy for the stress that might accompany an upcoming presentation, exam or performance.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.