Bilingual infants lip-read more than monolingual infants

February 12, 2015 by Greg St. Martin, Northeastern University
Credit: Anna Langova/public domain

New research from Northeastern developmental psychologist David J. Lewkowicz shows that infants learning more than one language do more lip-reading than infants learning a single language.

In the study, bilingual and monolingual infants were observed watching a video of a woman speaking in Spanish or Catalan; the infants were learning one or both of these languages. Lewkowicz and his collaborators found that bilingual infants focused their attention on the mouth at an earlier age and for a longer period of time than monolingual infants. This suggests that bilingual infants pick up on salient audiovisual cues more than their monolingual peers to help them distinguish between the two languages they are learning simultaneously, he said.

"These results provide new insights into the underlying mechanisms of people's ability to acquire more than one at the same time early in life," said Lewkowicz, a professor in the Department of Communication Sciences and Disorders in Northeastern's Bouvé College of Health Sciences.

Lewkowicz and his co-authors—Ferran Pons and Laura Bosch, both at the University of Barcelona and the Institute for Brain, Cognition, and Behavior in Spain—report these findings in a forthcoming paper in the journal Psychological Science. Lewkowicz said the findings have important implications for understanding how infants acquire speech and language and shed light on how —despite their neural and behavioral immaturity—manage to learn two different languages as easily as monolingual infants learn one language.

The findings, he said, could also play a role in treating and diagnosing children with communicative and learning disorders like autism. He noted that children with autism are typically diagnosed between 18 and 24 months and tend to look at faces less often than typical children, a factor that significantly reduces their opportunities for experiencing audiovisual speech that Lewkowicz's previous research has shown to be important for young babies. What this means in the context of his research is that identifying infants with particular patterns of selective attention to speech could help diagnose communication and learning disorders earlier than is currently possible.

In this new study, Lewkowicz and his collaborators used eye-tracking technology to measure precisely how much time infants attended to the eyes and mouth—the two critical areas that we focus on during social communication—of a person who could be seen and heard speaking. The infants all lived in Spain and were learning Spanish and/or Catalan.

The researchers found that, regardless of what language the person spoke, 4-month-old monolingual babies looked longer at the eyes than the mouth but that 4-month-old bilingual babies looked equally as long at the eyes and mouth. Similarly, whereas 12-month-old monolingual babies looked equally at the eyes and mouth in response to native speech and more at the mouth in response to non-native speech, 12-month-old looked longer at the mouth regardless of language and, critically, longer than monolingual infants in both cases.

These findings build upon Lewkowicz's groundbreaking research published in 2012, which showed that babies learn to talk not only by listening to sounds but also by lip-reading. Findings showed that as babies start to babble—at around six months of age—they begin to shift their attention to the mouth of the person speaking. In essence, they begin to lip-read, having discovered how much salient speech information they can learn from watching a person's mouth.

In the previous study, two experiments were conducted with different age groups of monolingual, English-learning infants between 4 and 12 months of age. In these experiments, the infants watched videos of women speaking either English or Spanish. In addition to finding that babies begin to shift their attention to a talker's mouth after 6 months of age, this study showed that 12-month-olds attended to the longer when the person spoke Spanish than when she spoke English, presumably because what had now become an unfamiliar language was more difficult to understand.

These findings led the researchers to pursue this latest study. Upon learning that combined auditory and visual speech information is very important for speech and language acquisition in infancy, they wondered whether babies growing up in a bilingual environment take even greater advantage of these combined auditory and visual cues and, thus, whether they lip-read even more.

"That's precisely what we found," Lewkowicz said, adding that "These findings shed new light on bilingualism, which happens to be of great interest to researchers studying the effects of early experience as well as policymakers concerned with integrating non-English speaking children into the classroom."

Lewkowicz noted that his team's research offers insight into what kinds of information to expose children to in order to help them acquire two languages more effectively. Babies, he explained, go through an intense period of learning in the first year and during this time they acquire expertise in their native language. Paradoxically, while native-language expertise emerges, ' ability to perceive other languages declines—a process known as perceptual narrowing, he said.

"By the end of their first year, infants have narrowed their ability to perceive different languages if they have not had exposure to them," he explained. "This process happens very rapidly and earlier than we thought, though children still retain a great deal of plasticity throughout childhood. But certainly, if you don't get exposed to another language during childhood, you'll have difficulty learning it later on.

"The flip side of this is that exposure to multiple languages in infancy prevents narrowing, and it is now clear that one way in which bilingual manage to accomplish their task is by taking maximum advantage of both audible and visible speech whenever they interact with their social partners."

Explore further: Do infants judge others' language proficiency? It depends on their own, research shows

Related Stories

Do infants judge others' language proficiency? It depends on their own, research shows

January 7, 2015
Monolingual infants expect others to understand only one language, an assumption not held by bilingual infants, a study by researchers at New York University and McGill University has found.

Multilingual or not, infants learn words best when it sounds like home

June 4, 2014
Growing up in a multilingual home has many advantages, but many parents worry that exposure to multiple languages might delay language acquisition. New research could now lay some of these multilingual myths to rest, thanks ...

Study links bilingual babies' vocabulary to early brain differentiation

August 29, 2011
Babies and children are whizzes at learning a second language, but that ability begins to fade as early as their first birthdays.

Recommended for you

Psychiatric disorders share an underlying genetic basis

June 21, 2018
Psychiatric disorders such as schizophrenia and bipolar disorder often run in families. In a new international collaboration, researchers explored the genetic connections between these and other disorders of the brain at ...

One year of school comes with an IQ bump, meta-analysis shows

June 21, 2018
A year of schooling leaves students with new knowledge, and it also equates with a small but noticeable increase to students' IQ, according to a systematic meta-analysis published in Psychological Science, a journal of the ...

Ketamine acts fast to treat depression and its effects last—but how?

June 21, 2018
In contrast to most antidepressant medications, which can take several weeks to reduce depressive symptoms, ketamine—a commonly used veterinary anesthetic—can lift a person out of a deep depression within minutes of its ...

Mindful movement may help lower stress, anxiety

June 21, 2018
Taking a walk may be a good opportunity to mentally review your to-do list, but using the time to instead be more mindful of your breathing and surroundings may help boost your wellbeing, according to researchers.

New study debunks Dale Carnegie advice to 'put yourself in their shoes'

June 21, 2018
Putting yourself in someone else's shoes and relying on intuition or "gut instinct" isn't an accurate way to determine what they're thinking or feeling," say researchers from Ben-Gurion University of the Negev (BGU), the ...

Brain tingles—first study of its kind reveals physiological benefits of ASMR

June 21, 2018
Autonomous sensory meridian response (ASMR) – the relaxing 'brain tingles' experienced by some people in response to specific triggers, such as whispering, tapping and slow hand movements – may have benefits for both ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.