Sound and vision: Visual cortex processes auditory information too

May 25, 2014, University of Glasgow
The dorsal stream (green) and ventral stream (purple) are shown. They originate from primary visual cortex.

Scientists studying brain process involved in sight have found the visual cortex also uses information gleaned from the ears as well as the eyes when viewing the world.

They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.

Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: "Sounds create visual imagery, mental images, and automatic projections.

"So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised."

The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early in 10 volunteer subjects.

In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.

Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.

A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.

Lars Muckli said: "This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.

"In future we will test how this supports visual processing, but the assumption is it provides predictions to help the to focus on surprising events which would confer a .

"This might provide insights into such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals."

The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.

The researchers will explore more sounds to find out how precise predictive coding in the brain can be.

Explore further: Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

More information: Decoding Sound and Imagery Content in Early Visual Cortex, dx.doi.org/10.1016/j.cub.2014.04.020

Related Stories

Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

October 23, 2013
Imagine the brain's delight when experiencing the sounds of Beethoven's "Moonlight Sonata" while simultaneously taking in a light show produced by a visualizer.

Perceptual motion bias helps humans interpret vague motion information

April 11, 2014
When viewing a scene with low contrast, such as in cloudy or low-light situations, humans tend to perceive objects to be moving slower or flickering faster than in reality. This less-than-faithful interpretation of the sensory ...

Rewired visual input to sound-processing part of the brain leads to compromised hearing

August 22, 2012
Scientists at Georgia State University have found that the ability to hear is lessened when, as a result of injury, a region of the brain responsible for processing sounds receives both visual and auditory inputs.

Neuronal activity in the visual cortex controlled by both where the eyes are looking and what they see

September 20, 2013
Even though our eyes are constantly moving, the brain perceives the external world as stationary—a feat achieved by integrating images acquired by the retina with information about the direction of the gaze. An international ...

Reward linked to image is enough to activate brain's visual cortex

March 21, 2013
Once rhesus monkeys learn to associate a picture with a reward, the reward by itself becomes enough to alter the activity in the monkeys' visual cortex. This finding was made by neurophysiologists Wim Vanduffel and John Arsenault ...

Recommended for you

Neuroimaging study reveals 'hot spot' for cue-reactivity in substance-dependent population

November 20, 2018
When patients with dependence on alcohol, cocaine or nicotine are shown drug cues, or images related to the substance, an area of their brain known as the medial prefrontal cortex (mPFC) shows increased activity, report investigators ...

When storing memories, brain prioritizes those experiences that are most rewarding

November 20, 2018
The brain's ability to preserve memories lies at the heart of our basic human experience. But how does the brain's mechanism for memory make sure we remember the most significant events and not clog our minds with superfluous ...

To predict the future, the brain has two clocks

November 20, 2018
That moment when you step on the gas pedal a split second before the light changes, or when you tap your toes even before the first piano note of Camila Cabello's "Havana" is struck. That's anticipatory timing.

Researchers hope to be able to replace dysfunctional brain cells

November 20, 2018
A new study by researchers at Karolinska Institutet supports the theory that replacement of dysfunctional immune cells in the brain has therapeutic potential for neurodegenerative diseases like ALS and Alzheimer's disease. ...

White matter pathway and individual variability in human stereoacuity

November 20, 2018
Researchers in the Center for Information and Neural Networks (CiNet), the National Institute of Information and Communications Technology and Osaka University have identified a human white matter pathway associated with ...

Can genetic therapy help kids with Angelman syndrome overcome seizures?

November 20, 2018
Angelman syndrome is a genetic disease with no cure. Children grow up with severe intellectual disabilities and a range of other problems, arguably the worst of which are epileptic seizures. Now scientists at the UNC School ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

skibitom
not rated yet May 25, 2014
Excellent article of brain function.
I think on the implementation of tractography which dorsal and ventral apparent stream.
Sincerely,
Dr Tomasz Skaba
RobertKarlStonjek
not rated yet May 27, 2014
The brain must solve the 'Binding Problem.'

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.