Voice-only communication more accurate than visual cues for identifying others' feelings, study says

October 10, 2017, American Psychological Association
Credit: CC0 Public Domain

If you want to know how someone is feeling, it might be better to close your eyes and use your ears: People tend to read others' emotions more accurately when they listen and don't look, according to research published by the American Psychological Association.

"Social and over the years have demonstrated the profound desire of individuals to connect with others and the array of skills people possess to discern emotions or intentions. But, in the presence of both will and skill, people often inaccurately perceive others' emotions," said author Michael Kraus, PhD, of Yale University. "Our research suggests that relying on a combination of vocal and , or solely facial cues, may not be the best strategy for accurately recognizing the emotions or intentions of others."

In the study, which was published in APA's flagship journal, American Psychologist, Kraus describes a series of five experiments involving more than 1,800 participants from the United States. In each experiment, individuals were asked either to interact with another person or were presented with an interaction between two others. In some cases, participants were only able to listen and not look; in others, they were able to look but not listen; and some participants were allowed to both look and listen. In one case, participants listened to a computerized voice reading a transcript of an interaction - a condition without the usual emotional inflection of human communication.

Across all five experiments, individuals who only listened without observing were able, on average, to identify more accurately the emotions being experienced by others. The one exception was when subjects listened to the computerized voices, which resulted in the worst accuracy of all. (An audio sample of the computerized voices, which features two college-age women teasing each other, is here.)

Since much of the research on emotional recognition has focused on the role of facial cues, these findings open a new area for research, according to Kraus.

"I think when examining these findings relative to how psychologists have studied emotion, these results might be surprising. Many tests of intelligence rely on accurate perceptions of faces," he said. "What we find here is that perhaps people are paying too much attention to the face—the voice might have much of the content necessary to perceive others' internal states accurately. The findings suggest that we should be focusing more on studying vocalizations of emotion."

Kraus believes that there are two possible reasons why voice-only is superior to combined communication. One is that we have more practice using facial expressions to mask emotions. The other is that more information isn't always better for accuracy. In the world of cognitive psychology, engaging in two complex tasks simultaneously (i.e., watching and listening) hurts a person's performance on both tasks.

One implication of this is simple, according to Kraus.

"Listening matters," he said. "Actually considering what people are saying and the ways in which they say it can, I believe, lead to improved understanding of others at work or in your personal relationships."

Explore further: Brain damage can make sideways faces more memorable, and give us 'emotion blindness'

More information: "Voice-Only Communication Enhances Empathic Accuracy," by Michael Kraus, PhD, Yale University School of Management. American Psychologist, published online Oct. 10, 2017. dx.doi.org/10.1037/amp0000147

Related Stories

Brain damage can make sideways faces more memorable, and give us 'emotion blindness'

June 6, 2017
People with damage to a crucial part of the brain fail to recognise facial emotions, but they unexpectedly find faces looking sideways more memorable researchers have found.

Facial expression more important to conveying emotion in music than in speech

February 24, 2015
Regular concert-goers are used to seeing singers use expressive and often very dramatic facial expressions. Indeed, music and speech are alike in that they use both facial and acoustic cues to engage listeners in an emotional ...

Animal emotions stare us in the face—are our pets happy?

July 11, 2017
Scientists are starting to be able to accurately read animal facial expressions and understand what they communicate.

Study shows when people feel anxious they are less reliable at reading emotions in other faces

May 31, 2017
(Medical Xpress)—A team of researchers with the MRC Integrative Epidemiology Unit and the U.K. Centre for Tobacco and Alcohol Studies has found evidence of impaired emotional face reading by people when they are feeling ...

Eye expressions offer a glimpse into the evolution of emotion

April 17, 2017
New research by Adam Anderson, professor of human development at Cornell University's College of Human Ecology, reveals why the eyes offer a window into the soul.

Lack of facial expression leads to perceptions of unhappiness, study shows

September 17, 2014
People with facial paralysis are perceived as being less happy simply because they can't communicate in the universal language of facial expression, a new study from an Oregon State University psychology professor shows.

Recommended for you

Around the world, people have surprisingly modest notions of the 'ideal' life

June 20, 2018
It seems reasonable that people would want to maximize various aspects of life if they were given the opportunity to do so, whether it's the pleasure they feel, how intelligent they are, or how much personal freedom they ...

Say cheese! Why a toothy smile makes it easier for you to be identified

June 19, 2018
A fulsome smile in a photo makes it easier for people to identify the individual, say researchers at the University of York.

Mental health declining among disadvantaged American adults

June 19, 2018
American adults of low socioeconomic status report increasing mental distress and worsening well-being, according to a new study by Princeton University and Georgetown University.

Videogame loot boxes similar to gambling

June 19, 2018
Adolescents playing video games that offer randomised rewards to increase competitive advantage could possibly be exposed to mechanisms that are psychologically similar to gambling, according to new research just published ...

Genes associated with infantile forms of schizophrenia identified

June 19, 2018
Scientists at the Montreal Neurological Institute and Hospital (The Neuro) and McGill University have identified novel genes associated with a specific form of schizophrenia.

Kids grasp that you get what you pay for

June 19, 2018
From a young age, children have a nuanced understanding of fairness.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.