Body language, not facial expressions, broadcasts what's happening to us

Expressions numbered 1,4,6 show tennis player's face on losing a point; expressions numbered 2,3,5 show a player after winning a point). Tests show that those looking at facial expressions alone cannot determine what the true emotion is. Credit: Reuters: Used with permission

If you think that you can judge by examining someone's facial expressions if he has just hit the jackpot in the lottery or lost everything in the stock market—think again. Researchers at the Hebrew University of Jerusalem and at New York University and Princeton University have discovered that—despite what leading theoretical models and conventional wisdom might indicate—it just doesn't work that way.

Rather, they found that language provides a better cue in trying to judge whether an observed subject has undergone strong positive or .

In a study published this week in the journal Science, the researchers present data showing that viewers in test groups were baffled when shown photographs of people who were undergoing real-life, highly intense positive and negative experiences. When the viewers were asked to judge the emotional valences of the faces they were shown (that is, the positivity or negativity of the faces), their guesses fell within the realm of chance.

The study was led by Dr. Hillel Aviezer of the Psychology Department of the Hebrew University, together with Dr. Yaacov Trope of New York University and Dr. Alexander Todorov of Princeton University.

In setting out to test the perception of highly intense faces, the researchers presented test groups with photos of dozens of highly intense in a variety of real-life emotional situations. For example, in one study they compared of professional tennis players winning or losing a point. These pictures are ideal because the stakes in such games are extremely high from an economic and prestige perspective.

To pinpoint how people recognize such images, Aviezer and his colleagues showed different versions of the pictures to three groups of participants: 1) the full picture with the face and body; 2) the body with the face removed; and 3) the face with the body removed. Remarkably, participants could easily tell apart the losers from winners when they rated the full picture or the body alone, but they were at chance level when rating the face alone.

Ironically, the participants who viewed the full image (face and body) were convinced that it was the face that revealed the emotional impact, not the body. The authors named this effect "illusory valence," reflecting the fact that participants said they saw clear valence (that is, either positive or negative emotion) in what was objectively a non-diagnostic face.

In an additional study, Aviezer and his collaborators asked viewers to examine a more broad range of real-life intense faces. These included intense positive situations, such as joy (seeing one's house after a lavish makeover), pleasure (experiencing an orgasm), and victory (winning a critical tennis point), as well as negative situations, such as grief (reacting at a funeral), pain (undergoing a nipple/naval piercing), and defeat (losing a critical tennis point).

Again, viewers were unable to tell apart the faces occurring in positive vs. negative situations. To further demonstrate how ambiguous these intense faces are, the researchers "planted" faces on bodies expressing positive or negative emotion. Sure enough, the emotional valence of the same face on different bodies was determined by the body, flipping from positive to negative depending on the body with which they appeared.

"These results show that when emotions become extremely intense, the difference between positive and negative facial expression blurs," says Aviezer. "The findings, challenge classic behavioral models in neuroscience, social psychology and economics, in which the distinct poles of positive and negative valence do not converge."

Aviezer adds: "From a practical-clinical perspective, the results may help researchers understand how body/face expressions interact during emotional situations. For example, individuals with autism may fail to recognize facial expressions, but perhaps if trained to process important body cues, their performance may significantly improve."

Related Stories

Your left side is your best side

Apr 20, 2012

Your best side may be your left cheek, according to a new study by Kelsey Blackburn and James Schirillo from Wake Forest University in the US. Their work shows that images of the left side of the face are perceived and rated ...

Reading a face is tricky business

Jul 31, 2007

Reading the face of a person who is trying to conceal fear or other emotions is tricky business, according to a new Northwestern University study of electrical activity in the brain.

Why is late-life depression harder to treat?

May 04, 2010

Scientists have found an important clue in the quest to understand why people who suffer from depression in later life are harder to treat and keep well in the long term.

Recommended for you

Job stress not the only cause of burnouts at work

1 hour ago

Impossible deadlines, demanding bosses, abusive colleagues, unpaid overtime—all these factors can lead to a burnout. When it comes to mental health in the workplace, we often forget to consider the influence of home life.

Web technology offers mental health support

5 hours ago

A web based application connecting people with potential mental health issues to clinical advice and support networks has been created by researchers at Aston and Warwick universities.

User comments

Adjust slider to filter visible comments by rank

Display comments: newest first

Tausch
not rated yet Nov 29, 2012
Still, the participants saw an 'intensity' (of the 'impact' of emotion') reflecting a fact of what they saw.

Tears are a sign of 'intensity' of 'impact'.
Sometimes begging the question of source:
Joy, pain, anger, sadness, fear etc.

Sometimes you don't know whether to laugh, cry, or to do both.
Tears are a cue too.

Also important are the 'adapted' cues - your conversation partner mirrors the position of your body without awareness until told.

A_Paradox
not rated yet Nov 30, 2012
Well, I am most impressed! I was one of the majority who naively thought it was facial expression which conveyed the most information about a person's emotional state. [Note: #6 looks to me like the actor Jack Nicholson, who I can't stand, being his normal, horrible, on screen self! ]
A_Paradox
not rated yet Dec 01, 2012
As someone in Facebook Consciousness group just pointed out, all these faces have their eyes shut! If they only used pictures of faces with eyes shut, that makes their conclusions somewhat gratuitous and, well, not so useful by a long shot.