We read emotions based on how the eye sees

February 22, 2017
Credit: Association for Psychological Science

We use others' eyes - whether they're widened or narrowed - to infer emotional states, and the inferences we make align with the optical function of those expressions, according to new research published in Psychological Science, a journal of the Association for Psychological Science. The research reveals, for example, that people consistently associate narrowed eyes - which can enhance visual discrimination - with discrimination-related emotions including disgust and suspicion.

"Our findings show that how we see directly relates to how others see us, through our ," says psychological scientist Daniel H. Lee of the University of Colorado Boulder. "This is a clear demonstration of emotional embodiment, from sender to receiver."

"For example, if you're watching 'Curb Your Enthusiasm' and wonder why when Larry David squints his eyes that conveys scrutiny, our work offers a theory that explains it," Lee explains. "Narrowing the eyes for visual scrutiny also communicates scrutiny."

The idea that our facial expressions communicate emotion isn't new - but Lee and co-author Adam K. Anderson of Cornell University wanted to understand how our expressions came to communicate so many complex emotions and .

"We went back to Darwin," says Lee. "His theories on how expression appearance evolved to have a sensory function for the sender showed how it also co-evolved to have communication function for the receiver."

Opening our eyes wide boosts visual sensitivity by allowing more light in, helping us to see any threats that might lurk nearby. Narrowing our eyes to a squint, on the other hand, can increase visual acuity, helping us to discriminate fine details. Lee and Anderson hypothesized that these opposing types of expressions, which originated for optical purposes, may have been co-opted for social purposes, operating as signals of conceptually related mental states.

Using photos of faces included in widely-used databases, the researchers created average exemplars of six expressions (i.e., sadness, disgust, anger, joy, fear, surprise). On each trial, participants saw a pair of eyes (one of the six exemplars) and a word representing a specific mental state, and they rated the extent to which the mental-state term described the eye expression. Each participant completed a total of 600 trials. The researchers then analyzed how these mental state perceptions related to specific eye features: the openness of the eye; the distance from the eyebrow to the eye; the slope and curve of the eyebrow; and wrinkles around the nose, the temple, and below the eye.

Combined ratings from the 28 participants showed that the eyes really do provide a strong signal of emotional state. People consistently matched the eye expressions with the corresponding basic emotion, rating "fear" as a strong match for the fear eye expression, for example. And these ratings were reliably higher than those for other mental states paired with the same eye expression.

Additional analyses examining the relationship between specific eye features and mental states revealed four distinct clusters, two of which aligned with eye-narrowing and eye-widening features. The eye-narrowing cluster was associated with mental states related to social discrimination, including hate, suspicion, aggressiveness, and contempt. The eye-widening cluster was associated with mental states related to information sensitivity, including awe, anticipation, cowardice, and interest.

The fact that these two clusters associated so strongly around eye widening and narrowing surprised the researchers:

"Human expressions are highly complex - when enumerating our facial muscles, we computed that there are at least 3.7 x 1016 different expression combinations, which is about the same probabilistic space as two Powerball jackpots," says Lee. "We looked at a subset of this space—just the eye region—and found that one simple physical dimension (widening vs. narrowing) explained a majority of this complex space in social communication."

Two additional clusters included eye features associated with joy, which aligned with positive mental states like admiration, and sadness, which aligned with negative mental states like uneasiness.

Findings from a second study showed that the eyes provide equally strong emotional signals when they're embedded in the context of a whole face, even when the features in the lower face don't indicate the same expression as the eyes do.

Thus, relative to the rest of our facial features, the eyes seem to have it when it comes to conveying complex mental states.

"This finding underscores how the origins of reading mental states from the eyes relate in part to how the eyes see," the researchers write.

Explore further: Eyes are windows to the soul—and evolution

More information: Daniel H. Lee et al, Reading What the Mind Thinks From How the Eye Sees, Psychological Science (2017). DOI: 10.1177/0956797616687364

Related Stories

Eyes are windows to the soul—and evolution

March 20, 2014
Why do we become saucer-eyed from fear and squint from disgust?

Wide-eyed fear expressions may help us—and others—to locate threats

May 1, 2013
Wide-eyed expressions that typically signal fear may enlarge our visual field and mutually enhance others' ability to locate threats, according to new research published in Psychological Science, a journal of the Association ...

Is the human brain capable of identifying a fake smile?

October 7, 2013
Human beings follows others' state of mind From their facial expressions. "Fear, anger, sadness, and surprise are quickly displeasure inferred in this way," David Beltran Guerrero, researcher at the University of La Laguna, ...

Group finds facial expressions not as universal as thought

April 17, 2012
(Medical Xpress) -- For most of history, people have assumed that facial expressions are generally universal; a smile by someone of any cultural group generally is an expression of happiness or pleasure, for example. This ...

Recommended for you

Study provides hope that schizophrenia isn't as deep-rooted in affected individuals as previously believed

December 8, 2017
A schizophrenia patient's own perceptions of their experiences—and confidence in their judgments—may be factors that can help them overcome challenges to get the life they wish, suggests a new paper published in Clinical ...

The evolutionary advantage of the teenage brain

December 7, 2017
The mood swings, the fiery emotions, the delusions of immortality, all the things that make a teenager a teenager might just seem like a phase we all have to put up with. However, research increasingly shows that the behaviors ...

Study reveals gap in life expectancy for people with mental illness

December 7, 2017
New research from The Australian National University (ANU) has found that men who are diagnosed with a mental health condition in their lifetime can expect to live 10.2 years less than those who aren't, and women 7.3 years.

Reading on electronic devices may interfere with science reading comprehension

December 6, 2017
People who often read on electronic devices may have a difficult time understanding scientific concepts, according to a team of researchers. They suggest that this finding, among others in the study, could also offer insights ...

Study suggests giving kids too many toys stifles their creativity

December 6, 2017
(Medical Xpress)—A team of researchers at the University of Toledo in the U.S. has found that children are more creative when they have fewer toys to play with at one time. In their paper published in the journal Infant ...

Psychosis incidence highly variable internationally

December 6, 2017
Rates of psychosis can be close to eight times higher in some regions compared to others, finds a new study led by researchers at UCL, King's College London and the University of Cambridge.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.