Smiley like you mean it: How emoticons get in your head

January 16, 2014 by Owen Churches, The Conversation
How do three little punctuation marks convey emotion? Credit: Veronica Belmont

We may not spend a lot of time thinking about the emoticons we insert into our emails and text messages, but it turns out that they reveal something interesting about the way we perceive facial expressions.

In a new paper published today in Social Neuroscience, me and my colleagues at Flinders University and the University of South Australia investigated the neural processes involved in turning three punctuation points into a smiling face.

This shorthand form of expressing emotional states is, of course, a relatively recent invention. In the past, communicating such things sometimes required a little more complexity.

From Proust to instant messaging

In 1913, Marcel Proust started publishing what would become In Search of Lost Time. By the time the last volume was published in 1927, the work spanned 4,211 pages of text. A century later, Proust's prose is regarded as a one of the greatest examples of writing about human emotion. Yet who, in 2014, has that kind of time?

In the 21st century, writing on the screen places an emphasis on efficiency over accuracy. One example of this is the creation and mainstream acceptance of the emoticon ":-)" to indicate a happy or smiling demeanour.

The smiley face emoticon was first placed in a post to the Carnegie Mellon University computer science general board by Professor Scott E. Fahlman in 1982.

Fahlman initially intended the symbol to alert readers to the fact that the preceding statement should induce a smile rather than be taken seriously (it seems that satire already had a ubiquitous presence on the pre-internet). The emoticon, and variations on it, have since become commonplace in screen-based writing.

Reading emoticons

The frequency with which emoticons are used suggests that they are readily and accurately perceived as a smiling face by their creators and recipients, but the process through which this recognition takes place is unclear.

Credit: Wesley Santos

The physiognomic features that are used to create the impression of a face are actually typographic symbols—on their own, they carry no meaning as a pair of eyes, a nose or a mouth. Indeed, removed from their configuration as a face, each of the symbols reverts to its specific meaning for the punctuation of the surrounding text.

In our study, we recorded the electrical activity in brains of young adults while they watched images of emoticons and actual smiling faces.

Much work has been done previously to investigate the neural systems involved in the perception of faces, and one of the most reliable findings is that faces are processed differently when they are presented upside down.

Faces ain't faces

Upright, faces are perceived primarily due to their configuration—that is, the canonical arrangement of two eyes above a nose which is above a mouth—which is driven by regions of the brain in the occipito-temporal cortex.

But when faces are turned upside down, this arrangement is disrupted—and the perception of the face is driven by the processing of the individual features of eyes, nose and mouth. Neurobiologically speaking, this relies on more lateral brain regions in the posterior upper bank of the occipito-temporal sulcus and in the inferior temporal gyrus.

This difference in processing creates a characteristic "inversion effect" on the recorded from the brain.

Our experiment replicated this effect for faces. However, emoticons did not produce this change in electrical potential due to inversion, suggesting that the feature processing regions in the inferior temporal gyrus were not activated when upside-down emoticons were presented.

Brain diagram with inferior temporal gyrus highlighted in yellow. Credit: Was a bee

This shows that emoticons are perceived as faces only through configural processes in the occipito-temporal cortex. When that configuration is disrupted (through a process such as inversion), the emoticon no longer carries its meaning as a face. Since the features of are not eyes and noses and mouths, the feature processing regions of the brain do not act to pull the figure into the precept of a face.

Phonograms and logographs

Written English is based on phonograms, so the semantic meaning associated with the symbol must be decoded through an understanding of the speech sounds indicated by the characters.

However, some of the characters used to write in logosyllabic languages, such as Chinese, readily suggest their semantic meaning through their visual form. Therefore, it is understandable that in people familiar with such scripts, logographs evoke a similar—though not identical—brain electrical potential to faces.

Emoticons, like logographs, are readily understandable through their visual form, and so represent a new way of communicating in written English.

Proust's attempt to convey the specifics of emotional experience was an amazing achievement. This is at least in part due to his insistence on finding original ways of describing familiar feelings.

Indeed, one of Proust's greatest current proselytisers, Alain de Botton, points out that cliché is always absent from Proust's work. Proust knew that one moment of happiness was different to another. And, he knew that it would take time to understand the unique characters of happiness across our lives.

The emoticon is quick to write and, it seems, quick to perceive as a smiling face. Perhaps, though, it is worth our time to occasionally write more.

Explore further: Is the human brain capable of identifying a fake smile?

More information: "Emoticons in mind: An event-related potential study." Owen Churches, Mike Nicholls, Myra Thiessen, Mark Kohler, Hannah Keage Social Neuroscience. DOI: 10.1080/17470919.2013.873737

Related Stories

Is the human brain capable of identifying a fake smile?

October 7, 2013
Human beings follows others' state of mind From their facial expressions. "Fear, anger, sadness, and surprise are quickly displeasure inferred in this way," David Beltran Guerrero, researcher at the University of La Laguna, ...

'Seeing' faces through touch

September 4, 2013
Our sense of touch can contribute to our ability to perceive faces, according to new research published in Psychological Science, a journal of the Association for Psychological Science.

Study finds context is key in helping us to recognize a face

November 13, 2013
Why does it take longer to recognise a familiar face when seen in an unfamiliar setting, like seeing a work colleague when on holiday? A new study published today in Nature Communications has found that part of the reason ...

Recommended for you

Short-course treatment for combat-related PTSD offers expedited path to recovery

January 23, 2018
Symptoms of Post-Traumatic Stress Disorder (PTSD) can be debilitating and standard treatment can take months, often leaving those affected unable to work or care for their families. But, a new study demonstrated that many ...

Social and emotional skills linked to better student learning

January 23, 2018
Students with well-developed and adaptive social and emotional behaviours are most likely to excel in school, according to UNSW researchers in educational psychology.

Priming can negate stressful aspects of negative sporting environments, study finds

January 23, 2018
The scene is ubiquitous in sports: A coach yells at players, creating an environment where winning is the sole focus and mistakes are punished. New research from the University of Kansas shows that when participants find ...

Study of learning and memory problems in OCD helps young people unlock potential at school

January 22, 2018
Adolescents with obsessive-compulsive disorder (OCD) have widespread learning and memory problems, according to research published today. The findings have already been used to assist adolescents with OCD obtain the help ...

People with prosthetic arms less affected by common illusion

January 22, 2018
People with prosthetic arms or hands do not experience the "size-weight illusion" as strongly as other people, new research shows.

Intensive behavior therapy no better than conventional support in treating teenagers with antisocial behavior

January 19, 2018
Research led by UCL has found that intensive and costly multisystemic therapy is no better than conventional therapy in treating teenagers with moderate to severe antisocial behaviour.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.