Study shows people are not good at recognising voices

June 19, 2017 by Carolyn Mcgettigan And Nadine Lavan, The Conversation
Computers can pick up the specific acoustic features of each individual voice. Credit: Shutterstock

"Alexa, who am I?" Amazon Echo's voice-controlled virtual assistant, Alexa, doesn't have an answer to that – yet. However, for other applications of speech technology, computer algorithms are increasingly able to discriminate, recognise and identify individuals from voice recordings.

Of course, these algorithms are far from perfect, as was recently shown when a BBC journalist broke into his own voice-controlled bank account using his twin brother's voice. Is this a case of computers just failing at something humans can do perfectly? We decided to find out.

Each human being has a voice that is distinct and different from everyone else's. So it seems intuitive that we'd be able to identify someone from their voice fairly easily. But how well can you actually do this? When it comes to recognising your closest family and friends, you're probably quite good. But would you be able to recognise the voice of your first primary school teacher if you heard them again today? How about the guy on the train this morning who was shouting into his phone? What if you had to pick him out, not from his talking voice, but from samples of his laughter, or singing?

To date, research has only explored voice identity perception using a limited set of vocalisations, for example sentences that have been read aloud or snippets of conversational speech. These studies have found that we can actually recognise voices of familiar people's speech quite well. But they have also shown that there are problems: ear-witness testimonies are notoriously unreliable and inaccurate.

It's important to keep in mind that these studies have not captured much of the flexibility of the sounds we can make with our voices. This is bound to have an effect on how we process the identity of the person behind the voice we are listening to. Therefore, we are currently missing a very large and important piece of the puzzle.

Recognising voices requires two broad processes to operate together: we need to distinguish between the voices of different people (telling people apart) and we need to be able to attribute a single identity to all the different sounds (talking, laughing, shouting) that can come from the same person ("telling people together"). We set out to investigate the limits of these abilities in humans.

Voice experiment

Our recent study, published in the Journal of Experimental Psychology: General, confirms that voice identity perception can be extremely challenging. Capitalising on how variable a single person's voice can be, we presented 46 listeners with laughter and vowels produced by five people. Listeners were asked to make a very simple judgement about pairs of sounds: were they made by the same person, or by two different people? As long as they could compare vowels to vowels or laughter to laughter respectively, discriminating between speakers was relatively successful.

But when we asked our listeners to make this judgement based on a mixed pair of sounds, such as directly comparing vowels to laughter in a pair, they couldn't discriminate between speakers at all – especially if they were not familiar with the speaker. However, even though a sub-group of people who knew the speakers performed better overall, they still struggled significantly with the challenge of "telling people together".

Similar effects have been reported by studies showing, for example, that it is difficult to recognise a bilingual speaker across their two languages. What's surprising about these findings is how bad voice perception can be once listeners are exposed to natural variation in the sounds that a voice can produce. So, it's intriguing to consider that while we each have a unique voice, we don't yet know how useful that uniqueness is.

But why have we evolved to have unique voices if we can't even recognise them? That's really an open question so far. We don't actually know whether we have evolved to have unique voices – we also all have different and largely unique fingerprints, but there's no evolutionary advantage to that as far as we can tell. It just so happens that based on differences in anatomy and, probably most importantly, how we use our voice, that we all sound different to each other.

Luckily computer algorithms are still able to make the most of the individuality of the human voice. They have probably already outdone humans in some cases – and they will keep on improving. The way these recognise speakers is based on mathematical solutions to create "voice prints" – unique representations picking up the specific acoustic features of each individual voice.

In contrast to computers, humans might not know what they are listening out for, or how to separate out these acoustic features. So, the way that prints are created for the algorithms is not closely modelled on what human listeners appear to do – we're still working on this. In the long term, it will be interesting to see if there is any overlap in the way human listeners and machine-learning algorithms recognise voices. While human listeners are unlikely to glean any insights from how computers solve this problem, conversely we might be able to build machines that emulate effective aspects of human performance.

It is rumoured that Amazon is currently working on teaching Alexa how to identify specific users by their voice. If this works, it will be a truly impressive feat and may put a stop to further unwanted orders of dollhouses. But, do be patient if Alexa makes mistakes – you may not be able to do it any better yourself.

Explore further: Google Home's assistant can now recognize different voices

Related Stories

Google Home's assistant can now recognize different voices

April 20, 2017
Google's voice-activated assistant can now recognize who's talking to it on Google's Home speaker.

Starbucks launches voice ordering via app, Amazon's Alexa

January 30, 2017
Amazon's Alexa is now able to order up a latte.

Gadget makers offer voice controls through Amazon's Alexa

January 5, 2017
Amazon doesn't have an official presence at the CES gadget show in Las Vegas but its Alexa voice control software seems to be everywhere.

What makes your voice yours? Researchers take steps to characterize and quantify voice quality

December 2, 2016
What are the characteristics of the way you say, "hello," (or anything else for that matter) that makes you recognizable over the phone? Despite the increasing amount of literature on personal voice quality, very little is ...

Body size conveyed by voice determines vocal attractiveness

April 24, 2013
Deep male voices and high-pitched female voices are perceived as more attractive because listeners gauge the speaker's body size from the frequency of their voice, according to research published April 24 in the open access ...

Recommended for you

Probing how Americans think about mental life

October 20, 2017
When Stanford researchers asked people to think about the sensations and emotions of inanimate or non-human entities, they got a glimpse into how those people think about mental life.

Itsy bitsy spider: Fear of spiders and snakes is deeply embedded in us

October 19, 2017
Snakes and spiders evoke fear and disgust in many people, even in developed countries where hardly anybody comes into contact with them. Until now, there has been debate about whether this aversion is innate or learnt. Scientists ...

Inflamed support cells appear to contribute to some kinds of autism

October 18, 2017
Modeling the interplay between neurons and astrocytes derived from children with Autism Spectrum Disorder (ASD), researchers at University of California San Diego School of Medicine, with colleagues in Brazil, say innate ...

Study suggests psychedelic drugs could reduce criminal behavior

October 18, 2017
Classic psychedelics such as psilocybin (often called magic mushrooms), LSD and mescaline (found in peyote) are associated with a decreased likelihood of antisocial criminal behavior, according to new research from investigators ...

Taking probiotics may reduce postnatal depression

October 18, 2017
Researchers from the University of Auckland and Otago have found evidence that a probiotic given in pregnancy can help prevent or treat symptoms of postnatal depression and anxiety.

Schizophrenia disrupts the brain's entire communication system, researchers say

October 17, 2017
Some 40 years since CT scans first revealed abnormalities in the brains of schizophrenia patients, international scientists say the disorder is a systemic disruption to the brain's entire communication system.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.