Sound and vision: Visual cortex processes auditory information too

May 25, 2014, University of Glasgow
The dorsal stream (green) and ventral stream (purple) are shown. They originate from primary visual cortex.

Scientists studying brain process involved in sight have found the visual cortex also uses information gleaned from the ears as well as the eyes when viewing the world.

They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.

Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: "Sounds create visual imagery, mental images, and automatic projections.

"So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised."

The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early in 10 volunteer subjects.

In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.

Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.

A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.

Lars Muckli said: "This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.

"In future we will test how this supports visual processing, but the assumption is it provides predictions to help the to focus on surprising events which would confer a .

"This might provide insights into such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals."

The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.

The researchers will explore more sounds to find out how precise predictive coding in the brain can be.

Explore further: Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

More information: Decoding Sound and Imagery Content in Early Visual Cortex, dx.doi.org/10.1016/j.cub.2014.04.020

Related Stories

Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

October 23, 2013
Imagine the brain's delight when experiencing the sounds of Beethoven's "Moonlight Sonata" while simultaneously taking in a light show produced by a visualizer.

Perceptual motion bias helps humans interpret vague motion information

April 11, 2014
When viewing a scene with low contrast, such as in cloudy or low-light situations, humans tend to perceive objects to be moving slower or flickering faster than in reality. This less-than-faithful interpretation of the sensory ...

Rewired visual input to sound-processing part of the brain leads to compromised hearing

August 22, 2012
Scientists at Georgia State University have found that the ability to hear is lessened when, as a result of injury, a region of the brain responsible for processing sounds receives both visual and auditory inputs.

Neuronal activity in the visual cortex controlled by both where the eyes are looking and what they see

September 20, 2013
Even though our eyes are constantly moving, the brain perceives the external world as stationary—a feat achieved by integrating images acquired by the retina with information about the direction of the gaze. An international ...

Reward linked to image is enough to activate brain's visual cortex

March 21, 2013
Once rhesus monkeys learn to associate a picture with a reward, the reward by itself becomes enough to alter the activity in the monkeys' visual cortex. This finding was made by neurophysiologists Wim Vanduffel and John Arsenault ...

Recommended for you

Sensory perception is not a one-way street

October 17, 2018
When we interact with the world, such as when we reach out to touch an object, the brain actively changes incoming sensory signals based on anticipation. This so-called 'sensory gating' has now been investigated by neuroscientists ...

Environmental factors may trigger onset of multiple sclerosis

October 16, 2018
A new Tel Aviv University study finds that certain environmental conditions may precipitate structural changes that take place in myelin sheaths in the onset of multiple sclerosis (MS). Myelin sheaths are the "insulating ...

Study points to possible new therapy for hearing loss

October 15, 2018
Researchers have taken an important step toward what may become a new approach to restore hearing loss. In a new study, out today in the European Journal of Neuroscience, scientists have been able to regrow the sensory hair ...

Scientists examine how neuropathic pain responds to Metformin

October 15, 2018
Scientists seeking an effective treatment for one type of chronic pain believe a ubiquitous, generic diabetes medication might solve both the discomfort and the mental deficits that go with the pain.

Sugar, a 'sweet' tool to understand brain injuries

October 15, 2018
Australian researchers have developed ground-breaking new technology which could prove crucial in treating brain injuries and have multiple other applications, including testing the success of cancer therapies.

Abnormal vision in childhood can affect brain functions

October 13, 2018
A research team has discovered that abnormal vision in childhood can affect the development of higher-level brain areas responsible for things such as attention.

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

skibitom
not rated yet May 25, 2014
Excellent article of brain function.
I think on the implementation of tractography which dorsal and ventral apparent stream.
Sincerely,
Dr Tomasz Skaba
RobertKarlStonjek
not rated yet May 27, 2014
The brain must solve the 'Binding Problem.'

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.