Gestures that speak: Gesticulating while speaking is not just a 'colorful' habit

June 23, 2014, International School of Advanced Studies (SISSA)

Have you ever found yourself gesticulating – and felt a bit stupid for it – while talking on the phone? You're not alone: it happens very often that people accompany their speech with hand gestures, sometimes even when no one can see them. Why can't we keep still while speaking? "Because gestures and words very probably form a single "communication system", which ultimately serves to enhance expression intended as the ability to make oneself understood", explains Marina Nespor, a neuroscientist at the International School for Advanced Studies (SISSA) of Trieste. Nespor, together with Alan Langus, a SISSA research fellow, and Bahia Guellai from the Université Paris Ouest Nanterre La Défence, who conducted the investigation at SISSA, has just published a study in Frontiers in Psychology which demonstrates the role of gestures in speech "prosody".

Linguists define prosody as the intonation and rhythm of spoken language, features that help to highlight sentence structure and therefore make the message easier to understand. For example, without prosody, nothing would distinguish the declarative statement "this is an apple" from the surprise question "this is an apple?" (in this case the difference lies in the intonation).

According to Nespor and colleagues, even hand gestures are part of prosody: "the prosody that accompanies speech is not 'modality specific'" explains Langus. "Prosodic information, for the person receiving the message, is a combination of auditory and visual cues. The 'superior' aspects (at the cognitive processing level) of spoken language are mapped to the motor-programs responsible for the production of both speech sounds and accompanying hand gestures".

Nespor, Langus and Guellai had 20 Italian speakers listen to a series of "ambiguous" utterances, which could be said with different prosodies corresponding to two different meanings. Examples of utterances were "come sicuramente hai visto la vecchia sbarra la porta" where, depending on meaning, "vecchia" can be the subject of the main verb (sbarrare, to block) or an adjective qualifying the subject (sbarra, bar) ('As you for sure have seen the old lady blocks the door' versus 'As you for sure have seen the old bar carries it'). The utterances could be simply listened to ("audio only" modality) or be presented in a video, where the participants could both listen to the sentences and see the accompanying gestures. In the "video" stimuli, the condition could be "matched" (gestures corresponding to the meaning conveyed by speech prosody) or "mismatched" (gestures matching the alternative meaning).

"In the matched conditions there was no improvement ascribable to gestures: the participants' performance was very good both in the video and in the "audio only" sessions. It's in the mismatched condition that the effect of became apparent", explains Langus. "With these stimuli the subjects were much more likely to make the wrong choice (that is, they'd choose the meaning indicated in the gestures rather than in the speech) compared to matched or audio-only conditions. This means that gestures affect how meaning is interpreted, and we believe this points to the existence of a common cognitive system for , intonation and rhythm of spoken language".

"In human communication, voice is not sufficient: even the torso and in particular hand movements are involved, as are facial expressions", concludes Nespor.

Explore further: Pointing is infants' first communicative gesture (w/ Video)

Related Stories

Pointing is infants' first communicative gesture (w/ Video)

February 24, 2014
Catalan researchers have studied the acquisition and development of language in babies on the basis of the temporary coordination of gestures and speech. The results are the first in showing how and when they acquire the ...

Gestures research suggests language instinct in young children

June 5, 2014
Young children instinctively use a 'language-like' structure to communicate through gestures.

Researchers link wild chimpanzee gestures to language evolution

July 15, 2012
(Phys.org) -- A Stirling researcher has identified between 20 and 30 manual gestures used by a community of wild chimpanzees, used to communicate with others in a range of activities including nursing, feeding, sex, aggression ...

The structure of language influences learning

October 3, 2013
There are words that convey a meaning, like verbs, nouns or adjectives, and others, like articles or conjunctions that sustain them, providing a structure for the sentence. A few years ago some scientists of the International ...

Recommended for you

College students choose smartphones over food

November 16, 2018
University at Buffalo researchers have found that college students prefer food deprivation over smartphone deprivation, according to results from a paper in Addictive Behaviors.

Study finds mindfulness apps can improve mental health

November 15, 2018
A University of Otago study has found that using mindfulness meditation applications (apps) on phones is associated with improvements in people's mental health.

Social media is affecting the way we view our bodies—and not in a good way

November 15, 2018
Young women who actively engage with social media images of friends who they think are more attractive than themselves report feeling worse about their own appearance afterward, a York University study shows.

New research has revealed we are actually better at remembering names than faces

November 14, 2018
With the Christmas party season fast approaching, there will be plenty of opportunity to re-live the familiar, and excruciatingly-awkward, social situation of not being able to remember an acquaintance's name.

Older adults' abstract reasoning ability predicts depressive symptoms over time

November 14, 2018
Age-related declines in abstract reasoning ability predict increasing depressive symptoms in subsequent years, according to data from a longitudinal study of older adults in Scotland. The research is published in Psychological ...

The illusion of multitasking boosts performance

November 13, 2018
Our ability to do things well suffers when we try to complete several tasks at once, but a series of experiments suggests that merely believing that we're multitasking may boost our performance by making us more engaged in ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.