Don't read my lips! Body language trumps the face for conveying intense emotions

January 15, 2013 by Morgan Kelly, Princeton University

Be it triumph or crushing defeat, exhilaration or agony, body language more accurately conveys intense emotions, according to recent research that challenges the predominance of facial expressions as an indicator of how a person feels.

Princeton University researchers report in the journal Science that facial expressions can be ambiguous and subjective when viewed independently. The researchers asked to determine from photographs if people were experiencing feelings such as loss, victory or pain from facial expressions or body language alone, or from both. In some cases, a facial expression associated with one emotion was paired with a body experiencing the opposite emotion.

In four separate experiments, participants more accurately guessed the pictured emotion based on body language—alone or combined with facial expressions—than on facial context alone. Senior researcher and Princeton Professor of Psychology Alexander Todorov said that these results challenge the clinical—and conventional—presumption that the face best communicates feeling. Indeed, despite the findings, a majority of the study's participants sided with the face when asked how they gauge feelings, a the researchers referred to as "illusory facial affect."

"We find that extremely positive and extremely are maximally indistinctive," said Todorov, who worked with first author Hillel Aviezer, a psychology professor at Hebrew University of Jerusalem who conducted the work as a under Todorov, and Yaacov Trope, a psychology professor at New York University.

"People can't tell the difference, although they think they can," Todorov said. "Subjectively people think they can tell the difference, but objectively they are totally at [random] chance of determining correctly. The message of this research is that there is a lot of information in body language people aren't necessarily aware of."

The paper in Science counters popular theories holding that facial expressions are universally consistent indicators of emotion. The most prominent, Todorov said, have been developed by psychologist and University of California-San Francisco professor emeritus Paul Ekman, whose work was fictionalized in the television series "Lie to Me."

Instead, facial movements may be "much blurrier" than those theories account for, Todorov said. In particular, he and his colleagues suggest that when emotions reach a certain intensity, the intricacies of facial expressions become lost, similar to "increasing the volume on stereo speakers to the point that it becomes completely distorted," he said.

"There's much more ambiguity in the face than we assume there is," Todorov said. "We assume that the face conveys whatever is in the person's mind, that we can recognize their emotions. But that's not necessarily true. If we remove all the other contextual clues, we might not be so good at picking out emotional cues."

Jamin Halberstadt, a psychology professor at the University of Otago in New Zealand, said that the work demonstrates in a new way that the physical cues of emotion are more varied and dependent on the emotion felt than predominating theories suggest. Halberstadt is familiar with the Princeton research but had no role it.

Based on theories of facial expression, one would intuit that intense emotions would be even easier to interpret from the face than subtle emotions, said Halberstadt, who studies cognitive-emotion interactions. Yet the research by Todorov, Aviezer and Trope demonstrates that facial movements at some point become secondary to the body.

"Before I read this paper, I would have thought that the body only provides contextual clues," Halberstadt said. "This is not saying that bodily context helps interpret an expression of emotion—it is saying that bodily context is the expression of emotion. And the face reveals a general intensity of feeling but doesn't communicate what the person is feeling exactly. The body is where the valid information comes from during intense feelings."

The Princeton research introduces an additional element to interpreting emotions that scientists "have to account for," Halberstadt said. In particular, interrogation and security-screening techniques—such as the U.S. Transportation Security Administration's Screening of Passengers by Observation Techniques (SPOT) program—have been developed based on facial expression research. The work by Todorov and his colleagues, however, suggests that a crucial bodily element may have been overlooked.

"This study really questions the primacy of the face in emotion," Halberstadt said. "Real emotional expressions are much more ambiguous, subtle and malleable than you would think from the research. Any application of emotion theory that relies on or assumes that emotional expressions reside primarily in the face should be under reconsideration from this kind of study."

For their study, the Princeton researchers used stock photos of people at six emotional "peaks": pain, pleasure, victory, defeat, grief and joy. In the first experiment, three groups of 15 people were shown only the facial expression, the body position or the face and body together, respectively. Participants who saw the face only had a 50-50 chance of being correct, whereas those who only saw a body or the face and body together were far more accurate.

Yet, these respondents also exhibited a high degree of illusory facial affect: 53 percent of people who saw the body-and-face photos said they relied on the face. Of a group for whom the pictures were described but not shown, 80 percent said they would rely solely on the face when determining the emotion pictured, while 20 percent they would look to the face and the body together. No one indicated they would judge by body language alone.

In the second experiment, photos were manipulated so that faces from one emotional peak such as victory were spliced onto a body from an opposing peak such as defeat. In those cases, participants more often determined the emotion to be that associated with the body.

For the third experiment, participants rated a variety of faces that fell with in the six emotional categories with ambiguous results. In fact, the authors report, respondents interpreted the positive faces as negative more than they did the negative faces. Those were then randomly put upon bodies in a situation of victory or pain, and victory or defeat. Again, study participants typically guessed the situation in accordance with what they gleaned from the body rather than the face.

The final experiment asked participants to mimic the in the photos for victory and defeat. Those images were put onto corresponding or opposing body images of victory or defeat. A separate group of people then had to determine the feeling being shown in each image. As in the previous experiments, the more often influenced respondents, who labeled a feeling negative when a winning face was on a of defeat, and vice versa.

If anything, Todorov said, the findings promote a more holistic view of understanding how people physically communicate feelings.

"This research involved very clear cases of positive and negative experiences, and yet people cannot tell them apart from the face," Todorov said.

"There are lots of cues that help us in the social environment, but we often think the face has this special status, that we can tell so much from it," he said. "In reality it tells us much less than we think."

Explore further: Body language, not facial expressions, broadcasts what's happening to us

More information: The paper, "Body Cues, Not Facial Expressions, Discriminate Between Intense Positive and Negative Emotions," was published in Science Nov. 30. www.sciencemag.org/content/338/6111/1225.abstract

Related Stories

Body language, not facial expressions, broadcasts what's happening to us

November 29, 2012
If you think that you can judge by examining someone's facial expressions if he has just hit the jackpot in the lottery or lost everything in the stock market—think again. Researchers at the Hebrew University of Jerusalem ...

Perception of facial expressions differs across cultures

September 1, 2011
Facial expressions have been called the "universal language of emotion," but people from different cultures perceive happy, sad or angry facial expressions in unique ways, according to new research published by the American ...

In reading facial emotion, context is everything

October 3, 2011
In a close-up headshot, Serena Williams' eyes are pressed tensely closed; her mouth is wide open, teeth bared. Her face looks enraged. Now zoom out: The tennis star is on the court, racket in hand, fist clenched in victory. ...

Recommended for you

Suicide risk in abused teen girls linked to mother-daughter conflict

October 18, 2018
Teenage girls who were maltreated as children are more likely to entertain suicidal thoughts if the relationship with their mother is poor and the degree of conflict between the two of them high.

Study shows how bias can influence people estimating the ages of other people

October 17, 2018
A trio of researchers from the University of New South Wales and Western Sydney University has discovered some of the factors involved when people make errors in estimating the ages of other people. In their paper published ...

Infants are more likely to learn when with a peer

October 16, 2018
Infants are more likely to learn from on-screen instruction when paired with another infant as opposed to viewing the lesson alone, according to a new study.

Researchers use brain cells in a dish to study genetic origins of schizophrenia

October 16, 2018
A study in Biological Psychiatry has established a new analytical method for investigating the complex genetic origins of mental illnesses using brain cells that are grown in a dish from human embryonic stem cells. Researchers ...

Income and wealth affect the mental health of Australians, study shows

October 16, 2018
Australians who have higher incomes and greater wealth are more likely to experience better mental health throughout their lives, new research led by the Bankwest Curtin Economics Centre has found.

Study suggests biological basis for depression, anxiety, sleep disturbances in older adults

October 15, 2018
UC San Francisco researchers, in collaboration with the unique Brazilian Biobank for Aging Studies (BBAS) at the University of São Paulo, have shown that the earliest stages of the brain degeneration associated with Alzheimer's ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.