Touch helps make the connection between sight and hearing

March 19, 2009,

The sense of touch allows us to make a better connection between sight and hearing and therefore helps adults to learn to read. This is what has been shown by the team of Édouard Gentaz, CNRS researcher at the Laboratoire de Psychologie et Neurocognition in Grenoble (France). These results, published March 16th in the journal PloS One, should improve learning methods, both for children learning to read and adults learning foreign languages.

To read words that are new to us, we have to learn to associate a visual stimulus (a letter, or grapheme) with its corresponding auditory stimulus (the sound, or phoneme). When can be explored both visually and by touch, learn arbitrary associations between auditory and visual stimuli more efficiently.

The researchers reached this conclusion from an experiment on thirty French-speaking adults. They first compared two with which the adults had to learn 15 new visual stimuli, inspired by Japanese characters, and their 15 corresponding sounds (new with no associated meaning). The two learning methods differed in the senses used to explore the visual stimuli. The first, “classic”, method used only vision. The second, “multisensory”, method used touch as well as vision for the perception of the visual stimuli. After the learning phase, the researchers measured the performances of each adult using different tests. They found that all the participants had acquired an above-chance ability to recognize the visual and auditory stimuli using the two methods.

The researchers then went on to test the participants by two other methods, this time to measure the capacity to learn associations between visual and auditory stimuli. The results showed that the subjects were capable of learning the associations with both learning methods, but that their performances were much better using the “multisensory” learning method. When the subjects were given the same tests a week after the learning phase, the results were the same.

These results support those already found by the same team, in work done with young children. The explication lies in the specific properties of the haptic sense in the hands, which plays a “cementing” role between sight and hearing, favoring the connection between the senses. What goes on in the brain remains to be explored, as does the neuronal mechanism: the researchers plan to develop a protocol that will let them use fMRI to identify the areas of the cortex that are activated during the “multisensory” learning process.

More information: Fredembach, B., Boisferon, A. et Gentaz, E. (to appear). Learning of arbitrary association between visual and auditory novel stimuli in adults: the « bond effect » of haptic exploration. PloS One.
Gentaz, E. (2009). La main, le cerveau et le toucher. Apprendre neurocognitive du sens haptique et des apprentissages. Paris : Dunod

Provided by CNRS

Related Stories

Recommended for you

Brainwaves show how exercising to music bends your mind

February 18, 2018
Headphones are a standard sight in gyms and we've long known research shows listening to tunes can be a game-changer for your run or workout.

New approaches in neuroscience show it's not all in your head

February 16, 2018
Our own unique experiences shape how we view the world and respond to the events in our lives. But experience is highly subjective. What's distressing or joyful to one person may be very different to another.

Link between hallucinations and dopamine not such a mystery, finds study

February 16, 2018
Researchers at Columbia University Irving Medical Center (CUIMC) and New York State Psychiatric Institute (NYSPI) found that people with schizophrenia who experience auditory hallucinations tend to hear what they expect, ...

People find comfort listening to the same songs over and over, study finds

February 16, 2018
With the frequency that some people play their favorite song, it's a good thing vinyl records aren't used often because they might wear out.

Ketamine found to reduce bursting in brain area reducing depression quickly

February 15, 2018
A team of researchers at Zhejiang University in China has found that the drug ketamine reduces neuronal bursting in the lateral habenula (LHb) brain region, reducing symptoms of depression in rodent models. In their paper ...

What predicts the quality of children's friendships? Study shows cognition, emotion together play

February 15, 2018
Whether children think their peers' intentions are benign or hostile, and how those children experience and express their own emotions, may influence the quality of their friendships, according to a new study from the University ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.