Hearing through lip-reading

Hearing through lip-reading
Speech entrainment during audio-only (top) and video-only (bottom). Credit: Bourguignon et al., JNeurosci 2019

Brain activity synchronizes with sound waves, even without audible sound, through lip-reading, according to new research published in JNeurosci.

Listening to speech activates our to synchronize with the rhythm of incoming sound waves. Lip-reading is a useful aid to comprehend unintelligible speech, but we still don't know how lip-reading helps the brain process sound.

Bourguignon et al. used magnetoencephalography to measure in healthy adults while they listened to a story or watched a silent video of a woman speaking. The participants' auditory cortices synchronized with produced by the woman in the video, even though they could not hear it. The synchronization resembled that in those who actually did listen to the story, indicating the brain can glean auditory information from the available to them through lip-reading. The researchers suggest this ability arises from activity in the visual cortex synchronizing with lip movement. This signal is sent to other brain areas that translate the movement information into sound information, creating the sound wave synchronization.


Explore further

How blindness shapes sound processing

More information: Mathieu Bourguignon et al, Lip-reading enables the brain to synthesize auditory features of unknown silent speech, The Journal of Neuroscience (2019). DOI: 10.1523/JNEUROSCI.1101-19.2019
Journal information: Journal of Neuroscience

Citation: Hearing through lip-reading (2020, January 2) retrieved 22 February 2020 from https://medicalxpress.com/news/2020-01-lip-reading.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.
39 shares

Feedback to editors

User comments