Sound and vision: Visual cortex processes auditory information too

May 25, 2014
The dorsal stream (green) and ventral stream (purple) are shown. They originate from primary visual cortex.

Scientists studying brain process involved in sight have found the visual cortex also uses information gleaned from the ears as well as the eyes when viewing the world.

They suggest this auditory input enables the visual system to predict incoming information and could confer a survival advantage.

Professor Lars Muckli, of the Institute of Neuroscience and Psychology at the University of Glasgow, who led the research, said: "Sounds create visual imagery, mental images, and automatic projections.

"So, for example, if you are in a street and you hear the sound of an approaching motorbike, you expect to see a motorbike coming around the corner. If it turned out to be a horse, you'd be very surprised."

The study, published in the journal Current Biology, involved conducting five different experiments using functional Magnetic Resonance Imaging (fMRI) to examine the activity in the early in 10 volunteer subjects.

In one experiment they asked the blindfolded volunteers to listen to three different natural sounds – birdsong, traffic noise and a talking crowd.

Using a special algorithm that can identify unique patterns in brain activity, the researchers were able to discriminate between the different sounds being processed in early visual cortex activity.

A second experiment revealed even imagined images, in the absence of both sight and sound, evoked activity in the early visual cortex.

Lars Muckli said: "This research enhances our basic understanding of how interconnected different regions of the brain are. The early visual cortex hasn't previously been known to process auditory information, and while there is some anatomical evidence of interconnectedness in monkeys, our study is the first to clearly show a relationship in humans.

"In future we will test how this supports visual processing, but the assumption is it provides predictions to help the to focus on surprising events which would confer a .

"This might provide insights into such as schizophrenia or autism and help us understand how sensory perceptions differ in these individuals."

The project was part of a five-year study funded by a €1.5m European Research Council consolidator grant entitled 'Brain reading of contextual feedback and predictions', and the Biotechnology and Biological Sciences Research Council.

The researchers will explore more sounds to find out how precise predictive coding in the brain can be.

Explore further: Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

More information: Decoding Sound and Imagery Content in Early Visual Cortex, dx.doi.org/10.1016/j.cub.2014.04.020

Related Stories

Study aims to understand how, when the auditory system registers complex auditory-visual synchrony

October 23, 2013
Imagine the brain's delight when experiencing the sounds of Beethoven's "Moonlight Sonata" while simultaneously taking in a light show produced by a visualizer.

Perceptual motion bias helps humans interpret vague motion information

April 11, 2014
When viewing a scene with low contrast, such as in cloudy or low-light situations, humans tend to perceive objects to be moving slower or flickering faster than in reality. This less-than-faithful interpretation of the sensory ...

Rewired visual input to sound-processing part of the brain leads to compromised hearing

August 22, 2012
Scientists at Georgia State University have found that the ability to hear is lessened when, as a result of injury, a region of the brain responsible for processing sounds receives both visual and auditory inputs.

Neuronal activity in the visual cortex controlled by both where the eyes are looking and what they see

September 20, 2013
Even though our eyes are constantly moving, the brain perceives the external world as stationary—a feat achieved by integrating images acquired by the retina with information about the direction of the gaze. An international ...

Reward linked to image is enough to activate brain's visual cortex

March 21, 2013
Once rhesus monkeys learn to associate a picture with a reward, the reward by itself becomes enough to alter the activity in the monkeys' visual cortex. This finding was made by neurophysiologists Wim Vanduffel and John Arsenault ...

Recommended for you

Scientists become research subjects in after-hours brain-scanning project

July 27, 2017
A quest to analyze the unique features of individual human brains evolved into the so-called Midnight Scan Club, a group of scientists who had big ideas but almost no funding and little time to research the trillions of neural ...

In witnessing the brain's 'aha!' moment, scientists shed light on biology of consciousness

July 27, 2017
Columbia scientists have identified the brain's 'aha!' moment—that flash in time when you suddenly become aware of information, such as knowing the answer to a difficult question. Today's findings in humans, combined with ...

Scientists block evolution's molecular nerve pruning in rodents

July 27, 2017
Researchers investigating why some people suffer from motor disabilities report they may have dialed back evolution's clock a few ticks by blocking molecular pruning of sophisticated brain-to-limb nerve connections in maturing ...

Social influences can override aggression in male mice, study shows

July 27, 2017
Stanford University School of Medicine investigators have identified a cluster of nerve cells in the male mouse's brain that, when activated, triggers territorial rage in a variety of situations. Activating the same cluster ...

Researchers reveal unusual chemistry of protein with role in neurodegenerative disorders

July 27, 2017
A common feature of neurodegenerative diseases is the formation of permanent tangles of insoluble proteins in cells. The beta-amyloid plaques found in people with Alzheimer's disease and the inclusion bodies in motor neurons ...

Mother's brain reward response to offspring reduced by substance addiction

July 27, 2017
Maternal addiction and its effects on children is a major public health problem, often leading to high rates of child abuse, neglect and foster care placement. In a study published today in the journal Human Brain Mapping, ...

2 comments

Adjust slider to filter visible comments by rank

Display comments: newest first

skibitom
not rated yet May 25, 2014
Excellent article of brain function.
I think on the implementation of tractography which dorsal and ventral apparent stream.
Sincerely,
Dr Tomasz Skaba
RobertKarlStonjek
not rated yet May 27, 2014
The brain must solve the 'Binding Problem.'

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.