Our head movements convey emotions

October 27, 2015, McGill University
Credit: McGill University

When people talk or sing, they often nod, tilt or bow their heads to reinforce verbal messages. But how effective are these head gestures at conveying emotions?

Very effective, according to researchers from McGill University in Montreal. Steven R. Livingstone and Caroline Palmer, from McGill's Department of Psychology, found that people were highly accurate at judging emotions based on head movements alone, even in the absence of sound or facial expressions.

This finding suggests that visual information about available in head movements could aid in the development of automated emotion recognition systems or human-interaction robots, the researchers say. Expressive robots could potentially serve a range of functions, particularly where face-to-face communication is important, such as at hotel reception desks and as interactive care robots for the elderly.

Tracking movement, not sound

Using motion-capture equipment to track people's head movements in three dimensions, Livingstone and Palmer recorded vocalists while they spoke or sang with a variety of emotions. The researchers then presented these video clips to viewers without any sound, with the of vocalists hidden so that only their head movements were visible. Viewers were then asked to identify the emotions that the vocalists intended to convey.

"We found that when people talk, the ways in which they move their head reveal the emotions that they're expressing. We also found that people are remarkably accurate at identifying a speaker's emotion, just by seeing their head movements," says Palmer, who holds the Canada Research Chair in Cognitive Neuroscience of Performance.

Research idea emerged from a noisy pub

"While the head movements for happy and sad emotions differed, they were highly similar across speech and song, despite differences in vocal acoustics", says Livingstone, a former postdoctoral fellow in the Palmer lab and now a postdoctoral fellow at McMaster University. "Although the research was based on North American English speakers, the focus on head movements creates the possibility for studying emotional communication in contexts where different languages are spoken".

The idea for the study emerged from a noisy pub. "One night in Montreal I was in a bar with my lab mates", explains Livingstone, "It was a lively evening, with lots of people, dim lights, and some very loud music. At one point my friend started to talk me; I knew he was excited though I couldn't make out what he was saying or see his face clearly. Suddenly I realized it was the animated way that he was bobbing his head that told me what he was trying to say".

Adds Palmer, "Our discovery may lead to new applications in situations where sound is not available, such as automated recognition of states in crowd behavior or in hearing impairments, by making use of head movements when watching someone talk. It also has applications in computing and robotics, where the addition of expressive head movements may help make humanoid robots more lifelike and approachable."

Explore further: Facial expression more important to conveying emotion in music than in speech

More information: Steven R. Livingstone et al. Head Movements Encode Emotions During Speech and Song., Emotion (2015). DOI: 10.1037/emo0000106

Related Stories

Facial expression more important to conveying emotion in music than in speech

February 24, 2015
Regular concert-goers are used to seeing singers use expressive and often very dramatic facial expressions. Indeed, music and speech are alike in that they use both facial and acoustic cues to engage listeners in an emotional ...

Why the long face? Horses and humans share facial expressions

August 5, 2015
Horses share some surprisingly similar facial expressions to humans and chimps, according to new University of Sussex research.

Clear vision despite a heavy head: Model explains the choice of simple movements

November 9, 2011
The brain likes stereotypes - at least for movements. Simple actions are most often performed in the same manner. A mathematical model explains why this is the case and could be used to generate more natural robot movements ...

Research reveals robot flaws are key to interacting with humans

October 14, 2015
Humans are less likely to form successful working relationships with interactive robots if they are programmed to be too perfect, new research reveals.

Realistic robot faces aren't enough – we need emotion to put us at ease with androids

June 19, 2015
When the first guests arrive at Nagasaki's Hotel Henn Na in July this year, they will be greeted and served by robots. In a similar approach, Toshiba's android Aiko recently held a short-term role greeting customers at a ...

Making robots more human

April 29, 2015
Most people are naturally adept at reading facial expressions—from smiling and frowning to brow-furrowing and eye-rolling—to tell what others are feeling. Now scientists have developed ultra-sensitive, wearable sensors ...

Recommended for you

College students choose smartphones over food

November 16, 2018
University at Buffalo researchers have found that college students prefer food deprivation over smartphone deprivation, according to results from a paper in Addictive Behaviors.

Study finds mindfulness apps can improve mental health

November 15, 2018
A University of Otago study has found that using mindfulness meditation applications (apps) on phones is associated with improvements in people's mental health.

Social media is affecting the way we view our bodies—and not in a good way

November 15, 2018
Young women who actively engage with social media images of friends who they think are more attractive than themselves report feeling worse about their own appearance afterward, a York University study shows.

New research has revealed we are actually better at remembering names than faces

November 14, 2018
With the Christmas party season fast approaching, there will be plenty of opportunity to re-live the familiar, and excruciatingly-awkward, social situation of not being able to remember an acquaintance's name.

Older adults' abstract reasoning ability predicts depressive symptoms over time

November 14, 2018
Age-related declines in abstract reasoning ability predict increasing depressive symptoms in subsequent years, according to data from a longitudinal study of older adults in Scotland. The research is published in Psychological ...

The illusion of multitasking boosts performance

November 13, 2018
Our ability to do things well suffers when we try to complete several tasks at once, but a series of experiments suggests that merely believing that we're multitasking may boost our performance by making us more engaged in ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.