Sound and vision: Visual cortex processes auditory information too

May 25, 2014
The dorsal stream (green) and ventral stream (purple) are shown. They originate from primary visual cortex.

Scientists studying brain process involved in sight have found the visual cortex also uses information gleaned from the ears as well as the eyes when viewing the world.

They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.

Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: "Sounds create visual imagery, mental images, and automatic projections.

"So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised."

The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early in 10 volunteer subjects.

In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.

Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.

A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.

Lars Muckli said: "This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.

"In future we will test how this supports visual processing, but the assumption is it provides predictions to help the to focus on surprising events which would confer a .

"This might provide insights into such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals."

The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.

The researchers will explore more sounds to find out how precise predictive coding in the brain can be.

Explore further: Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

More information: Decoding Sound and Imagery Content in Early Visual Cortex,

Related Stories

Recommended for you

How lying takes our brains down a 'slippery slope'

October 24, 2016

Telling small lies desensitises our brains to the associated negative emotions and may encourage us to tell bigger lies in future, reveals new UCL research funded by Wellcome and the Center for Advanced Hindsight.

How even our brains get 'slacker' as we age

October 24, 2016

New research from Newcastle University, UK, in collaboration with the Federal University of Rio de Janeiro, investigated the way the human brain folds and how this 'cortical folding' changes with age.

Robotic tutors for primary school children

October 24, 2016

The use of robotic tutors in primary school classrooms is one step closer according to research recently published in the open access journal Frontiers in Computational Neuroscience.

Mouse decision-making more complex than once thought

October 24, 2016

Working with dot-counting mice running through a virtual-reality maze, scientists from Harvard Medical School have found that in order to navigate space rodent brains rely on a cascade of neural signals that culminate in ...


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet May 25, 2014
Excellent article of brain function.
I think on the implementation of tractography which dorsal and ventral apparent stream.
Dr Tomasz Skaba
not rated yet May 27, 2014
The brain must solve the 'Binding Problem.'

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.