We read emotions based on how the eye sees

February 22, 2017
Credit: Association for Psychological Science

We use others' eyes - whether they're widened or narrowed - to infer emotional states, and the inferences we make align with the optical function of those expressions, according to new research published in Psychological Science, a journal of the Association for Psychological Science. The research reveals, for example, that people consistently associate narrowed eyes - which can enhance visual discrimination - with discrimination-related emotions including disgust and suspicion.

"Our findings show that how we see directly relates to how others see us, through our ," says psychological scientist Daniel H. Lee of the University of Colorado Boulder. "This is a clear demonstration of emotional embodiment, from sender to receiver."

"For example, if you're watching 'Curb Your Enthusiasm' and wonder why when Larry David squints his eyes that conveys scrutiny, our work offers a theory that explains it," Lee explains. "Narrowing the eyes for visual scrutiny also communicates scrutiny."

The idea that our facial expressions communicate emotion isn't new - but Lee and co-author Adam K. Anderson of Cornell University wanted to understand how our expressions came to communicate so many complex emotions and .

"We went back to Darwin," says Lee. "His theories on how expression appearance evolved to have a sensory function for the sender showed how it also co-evolved to have communication function for the receiver."

Opening our eyes wide boosts visual sensitivity by allowing more light in, helping us to see any threats that might lurk nearby. Narrowing our eyes to a squint, on the other hand, can increase visual acuity, helping us to discriminate fine details. Lee and Anderson hypothesized that these opposing types of expressions, which originated for optical purposes, may have been co-opted for social purposes, operating as signals of conceptually related mental states.

Using photos of faces included in widely-used databases, the researchers created average exemplars of six expressions (i.e., sadness, disgust, anger, joy, fear, surprise). On each trial, participants saw a pair of eyes (one of the six exemplars) and a word representing a specific mental state, and they rated the extent to which the mental-state term described the eye expression. Each participant completed a total of 600 trials. The researchers then analyzed how these mental state perceptions related to specific eye features: the openness of the eye; the distance from the eyebrow to the eye; the slope and curve of the eyebrow; and wrinkles around the nose, the temple, and below the eye.

Combined ratings from the 28 participants showed that the eyes really do provide a strong signal of emotional state. People consistently matched the eye expressions with the corresponding basic emotion, rating "fear" as a strong match for the fear eye expression, for example. And these ratings were reliably higher than those for other mental states paired with the same eye expression.

Additional analyses examining the relationship between specific eye features and mental states revealed four distinct clusters, two of which aligned with eye-narrowing and eye-widening features. The eye-narrowing cluster was associated with mental states related to social discrimination, including hate, suspicion, aggressiveness, and contempt. The eye-widening cluster was associated with mental states related to information sensitivity, including awe, anticipation, cowardice, and interest.

The fact that these two clusters associated so strongly around eye widening and narrowing surprised the researchers:

"Human expressions are highly complex - when enumerating our facial muscles, we computed that there are at least 3.7 x 1016 different expression combinations, which is about the same probabilistic space as two Powerball jackpots," says Lee. "We looked at a subset of this space—just the eye region—and found that one simple physical dimension (widening vs. narrowing) explained a majority of this complex space in social communication."

Two additional clusters included eye features associated with joy, which aligned with positive mental states like admiration, and sadness, which aligned with negative mental states like uneasiness.

Findings from a second study showed that the eyes provide equally strong emotional signals when they're embedded in the context of a whole face, even when the features in the lower face don't indicate the same expression as the eyes do.

Thus, relative to the rest of our facial features, the eyes seem to have it when it comes to conveying complex mental states.

"This finding underscores how the origins of reading mental states from the eyes relate in part to how the eyes see," the researchers write.

Explore further: Eyes are windows to the soul—and evolution

More information: Daniel H. Lee et al, Reading What the Mind Thinks From How the Eye Sees, Psychological Science (2017). DOI: 10.1177/0956797616687364

Related Stories

Eyes are windows to the soul—and evolution

March 20, 2014
Why do we become saucer-eyed from fear and squint from disgust?

Wide-eyed fear expressions may help us—and others—to locate threats

May 1, 2013
Wide-eyed expressions that typically signal fear may enlarge our visual field and mutually enhance others' ability to locate threats, according to new research published in Psychological Science, a journal of the Association ...

Is the human brain capable of identifying a fake smile?

October 7, 2013
Human beings follows others' state of mind From their facial expressions. "Fear, anger, sadness, and surprise are quickly displeasure inferred in this way," David Beltran Guerrero, researcher at the University of La Laguna, ...

Group finds facial expressions not as universal as thought

April 17, 2012
(Medical Xpress) -- For most of history, people have assumed that facial expressions are generally universal; a smile by someone of any cultural group generally is an expression of happiness or pleasure, for example. This ...

Recommended for you

Before assigning responsibility, our minds simulate alternative outcomes, study shows

October 17, 2017
How do people assign a cause to events they witness? Some philosophers have suggested that people determine responsibility for a particular outcome by imagining what would have happened if a suspected cause had not intervened.

Schizophrenia disrupts the brain's entire communication system, researchers say

October 17, 2017
Some 40 years since CT scans first revealed abnormalities in the brains of schizophrenia patients, international scientists say the disorder is a systemic disruption to the brain's entire communication system.

For older adults, volunteering could improve brain function

October 17, 2017
Older adults worried about losing their cognitive functions could consider volunteering as a potential boost, according to a University of Missouri researcher. While volunteering and its associations with physical health ...

Magic mushrooms may 'reset' the brains of depressed patients

October 13, 2017
Patients taking psilocybin to treat depression show reduced symptoms weeks after treatment following a 'reset' of their brain activity.

Living near a forest keeps your amygdala healthier

October 13, 2017
A study conducted at the Max Planck Institute for Human Development has investigated the relationship between the availability of nature near city dwellers' homes and their brain health. Its findings are relevant for urban ...

Scientists researching drugs that could improve brain function in people with schizophrenia

October 12, 2017
Virginia Commonwealth University researchers are testing if drugs known as HDAC inhibitors improve cognition in patients with schizophrenia who have been treated with the antipsychotic drug clozapine.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.