Sound and vision: Visual cortex processes auditory information too

May 25, 2014, University of Glasgow
The dorsal stream (green) and ventral stream (purple) are shown. They originate from primary visual cortex.

Scientists studying brain process involved in sight have found the visual cortex also uses information gleaned from the ears as well as the eyes when viewing the world.

They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.

Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: "Sounds create visual imagery, mental images, and automatic projections.

"So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised."

The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early in 10 volunteer subjects.

In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.

Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.

A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.

Lars Muckli said: "This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.

"In future we will test how this supports visual processing, but the assumption is it provides predictions to help the to focus on surprising events which would confer a .

"This might provide insights into such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals."

The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.

The researchers will explore more sounds to find out how precise predictive coding in the brain can be.

Explore further: Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

More information: Decoding Sound and Imagery Content in Early Visual Cortex, dx.doi.org/10.1016/j.cub.2014.04.020

Related Stories

Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

October 23, 2013
Imagine the brain's delight when experiencing the sounds of Beethoven's "Moonlight Sonata" while simultaneously taking in a light show produced by a visualizer.

Perceptual motion bias helps humans interpret vague motion information

April 11, 2014
When viewing a scene with low contrast, such as in cloudy or low-light situations, humans tend to perceive objects to be moving slower or flickering faster than in reality. This less-than-faithful interpretation of the sensory ...

Rewired visual input to sound-processing part of the brain leads to compromised hearing

August 22, 2012
Scientists at Georgia State University have found that the ability to hear is lessened when, as a result of injury, a region of the brain responsible for processing sounds receives both visual and auditory inputs.

Neuronal activity in the visual cortex controlled by both where the eyes are looking and what they see

September 20, 2013
Even though our eyes are constantly moving, the brain perceives the external world as stationary—a feat achieved by integrating images acquired by the retina with information about the direction of the gaze. An international ...

Reward linked to image is enough to activate brain's visual cortex

March 21, 2013
Once rhesus monkeys learn to associate a picture with a reward, the reward by itself becomes enough to alter the activity in the monkeys' visual cortex. This finding was made by neurophysiologists Wim Vanduffel and John Arsenault ...

Recommended for you

Convergence of synaptic signals is mediated by a protein critical for learning and memory

July 16, 2018
Inside the brain, is a complex symphony of perfectly coordinated signaling. Hundreds of different molecules amplify, modify and carry information from tiny synaptic compartments all the way through the entire length of a ...

'Concussion pill' shows promise in pre-clinical pilot study

July 16, 2018
In 2016, funded by a $16 million grant from Scythian, the multidisciplinary Miller School team embarked on a five-year study to examine the effects of combining CBD (a cannabinoid derivative of hemp) with an NMDA antagonist ...

Synapse-specific plasticity governs the identity of overlapping memory traces

July 16, 2018
Memories are formed through long-term changes in synaptic efficacy, a process known as synaptic plasticity, and are stored in the brain in specific neuronal ensembles called engram cells, which are activated during corresponding ...

Fetal gene therapy prevents fatal neurodegenerative disease

July 16, 2018
A fatal neurodegenerative condition known as Gaucher disease can be prevented in mice following fetal gene therapy, finds a new study led by UCL, the KK Women's and Children's Hospital and National University Health System ...

Rehabilitating the mind could improve outcomes after spinal cord injury

July 16, 2018
A study led by Heriot-Watt University has explored how individuals with spinal cord injuries perceive the space around them. The findings suggest additions are needed to the rehabilitation programmes adopted post-injury to ...

Study suggests mice and rats, like humans, make poor choices based on 'sunk costs'

July 13, 2018
A team of researchers at the University of Minnesota has found that mice and rats, like humans, tend to make poor decisions based on "sunk costs." In their paper published in the journal Science, the group describes their ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

skibitom
not rated yet May 25, 2014
Excellent article of brain function.
I think on the implementation of tractography which dorsal and ventral apparent stream.
Sincerely,
Dr Tomasz Skaba
RobertKarlStonjek
not rated yet May 27, 2014
The brain must solve the 'Binding Problem.'

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.