Voice-only communication more accurate than visual cues for identifying others' feelings, study says

October 10, 2017, American Psychological Association
Credit: CC0 Public Domain

If you want to know how someone is feeling, it might be better to close your eyes and use your ears: People tend to read others' emotions more accurately when they listen and don't look, according to research published by the American Psychological Association.

"Social and over the years have demonstrated the profound desire of individuals to connect with others and the array of skills people possess to discern emotions or intentions. But, in the presence of both will and skill, people often inaccurately perceive others' emotions," said author Michael Kraus, PhD, of Yale University. "Our research suggests that relying on a combination of vocal and , or solely facial cues, may not be the best strategy for accurately recognizing the emotions or intentions of others."

In the study, which was published in APA's flagship journal, American Psychologist, Kraus describes a series of five experiments involving more than 1,800 participants from the United States. In each experiment, individuals were asked either to interact with another person or were presented with an interaction between two others. In some cases, participants were only able to listen and not look; in others, they were able to look but not listen; and some participants were allowed to both look and listen. In one case, participants listened to a computerized voice reading a transcript of an interaction - a condition without the usual emotional inflection of human communication.

Across all five experiments, individuals who only listened without observing were able, on average, to identify more accurately the emotions being experienced by others. The one exception was when subjects listened to the computerized voices, which resulted in the worst accuracy of all. (An audio sample of the computerized voices, which features two college-age women teasing each other, is here.)

Since much of the research on emotional recognition has focused on the role of facial cues, these findings open a new area for research, according to Kraus.

"I think when examining these findings relative to how psychologists have studied emotion, these results might be surprising. Many tests of intelligence rely on accurate perceptions of faces," he said. "What we find here is that perhaps people are paying too much attention to the face—the voice might have much of the content necessary to perceive others' internal states accurately. The findings suggest that we should be focusing more on studying vocalizations of emotion."

Kraus believes that there are two possible reasons why voice-only is superior to combined communication. One is that we have more practice using facial expressions to mask emotions. The other is that more information isn't always better for accuracy. In the world of cognitive psychology, engaging in two complex tasks simultaneously (i.e., watching and listening) hurts a person's performance on both tasks.

One implication of this is simple, according to Kraus.

"Listening matters," he said. "Actually considering what people are saying and the ways in which they say it can, I believe, lead to improved understanding of others at work or in your personal relationships."

Explore further: Brain damage can make sideways faces more memorable, and give us 'emotion blindness'

More information: "Voice-Only Communication Enhances Empathic Accuracy," by Michael Kraus, PhD, Yale University School of Management. American Psychologist, published online Oct. 10, 2017. dx.doi.org/10.1037/amp0000147

Related Stories

Brain damage can make sideways faces more memorable, and give us 'emotion blindness'

June 6, 2017
People with damage to a crucial part of the brain fail to recognise facial emotions, but they unexpectedly find faces looking sideways more memorable researchers have found.

Facial expression more important to conveying emotion in music than in speech

February 24, 2015
Regular concert-goers are used to seeing singers use expressive and often very dramatic facial expressions. Indeed, music and speech are alike in that they use both facial and acoustic cues to engage listeners in an emotional ...

Animal emotions stare us in the face—are our pets happy?

July 11, 2017
Scientists are starting to be able to accurately read animal facial expressions and understand what they communicate.

Study shows when people feel anxious they are less reliable at reading emotions in other faces

May 31, 2017
(Medical Xpress)—A team of researchers with the MRC Integrative Epidemiology Unit and the U.K. Centre for Tobacco and Alcohol Studies has found evidence of impaired emotional face reading by people when they are feeling ...

Eye expressions offer a glimpse into the evolution of emotion

April 17, 2017
New research by Adam Anderson, professor of human development at Cornell University's College of Human Ecology, reveals why the eyes offer a window into the soul.

Lack of facial expression leads to perceptions of unhappiness, study shows

September 17, 2014
People with facial paralysis are perceived as being less happy simply because they can't communicate in the universal language of facial expression, a new study from an Oregon State University psychology professor shows.

Recommended for you

Study: Tinder loving cheaters—dating app facilitates infidelity

February 23, 2018
The popular dating app Tinder is all about helping people form new relationships. But for many college-aged people, it's also helping those in relationships cheat on their romantic partners.

The 'loudness' of our thoughts affects how we judge external sounds

February 23, 2018
The "loudness" of our thoughts—or how we imagine saying something—influences how we judge the loudness of real, external sounds, a team of researchers from NYU Shanghai and NYU has found.

Looking for the origins of schizophrenia

February 23, 2018
Schizophrenia may be related to neurodevelopmental changes, including brain's inability to generate an appropriate vascular system, according to new study resulted from a partnership between the D"Or Institute for Research ...

Color of judo uniform has no effect on winning

February 22, 2018
New research on competitive judo data finds a winning bias for the athlete who is first called, regardless of the colour of their uniform. This unique study, published in Frontiers in Psychology, puts to rest the debate on ...

Infants are able to learn abstract rules visually

February 22, 2018
Three-month-old babies cannot sit up or roll over, yet they are already capable of learning patterns from simply looking at the world around them, according to a recent Northwestern University study published in PLOS One.

Antidepressants are more effective than placebo at treating acute depression in adults, concludes study

February 22, 2018
Meta-analysis of 522 trials includes the largest amount of unpublished data to date, and finds that antidepressants are more effective than placebo for short-term treatment of acute depression in adults.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.