Multisensory integration: When correlation implies causation
This is the experimental setup. Credit: Kopp/ Parise
In order to get a better picture of our surroundings, the brain has to integrate information from different senses, but how does it know which signals to combine? New research involving scientists from the Max Planck Institute for Biological Cybernetics, the Bernstein Center for Computational Neuroscience Tübingen, the University of Oxford, and the University of Bielefeld has demonstrated that humans exploit the correlation between the temporal structures of signals to decide which of them to combine and which to keep segregated. This research is about to be published in Current Biology.
Multisensory signals originating from the same distal event are often similar in nature. Think of fireworks on New Year's Eve, an object falling and bouncing on the floor, or the footsteps of a person walking down the street. The temporal structures of such visual and auditory events are always almost overlapping (i.e., they correlate), and we often effortlessly assume an underlying unity between our visual and auditory experiences. In fact, the similarity of temporal structure of multiple unisensory signals, rather than merely their temporal coincidence as it has been previously thought, provides a potentially powerful cue for the brain to determine whether or not multiple sensory signals have a common cause.
Cesare Parise from the Max Planck Institute for Biological Cybernetics in Tübingen and Bernstein Center for Computational Neuroscience Tübingen and his colleagues set out to examine the role of signal correlation in multisensory integration by asking people to localize a stream of beeps and flashes. Participants seated in front of a large screen where sounds (streams of noise bursts) and images (streams blurred blobs) were presented from different spatial locations. On some trials only visual or auditory stimuli were presented, while on other trials visual and auditory stimuli were presented in combination. Critically, on combined audiovisual trials, the temporal structure of the visual and auditory stimuli could either be correlated or not. Participants were required to report the spatial position of such stimuli by moving a cursor controlled by a graphic tablet. In line with previous studies, participants were more precise when the auditory and visual streams were presented together than when they were presented in isolation. Notably, precision was even higher when auditory and visual streams were correlated, and closely approached the theoretical maximum.
These results demonstrate that humans optimally combine multiple sensory signals only when they correlate in time. Previous research has demonstrated that optimal integration only occurs when the brain is sure that the signals have a common underlying cause. These results therefore demonstrate that the brain uses the statistical correlation between the sensory signals to infer whether they have a common physical cause, and hence whether they provide redundant information that should be integrated.
The researchers suggest the brain has evolved this ability to combine potentially related information from different senses so it can effectively pick its way through the noisy environments of everyday life.
"It's why at a noisy cocktail party you can tell who is speaking with which voice," says Parise. "Our eyes and ears are continually taking in sensory information and our brains make sense of it all by merging together sights and sounds with similar temporal structures."
In spite of being a pervasive aspect of sensory processing, little is known about the low-level statistical determinants of multisensory integration for signals with complex dynamic temporal patterns. This research highlights the role of a key organizational principle for multisensory perceptual grouping. What at first glance appears to be a logical fallacy, namely inferring causation from correlation, turns out to be the rule in perception.
More information: Cesare V. Parise, Charles Spence, Marc O. Ernst: When Correlation Implies Causation in Multisensory Integration. Current Biology doi: 10.1016/j.cub.2011.11.039
Journal reference: Current Biology
Provided by Max-Planck-Gesellschaft
- Playing music alters the processing of multiple sensory stimuli in the brain Nov 24, 2011 | not rated yet | 0
- Where the brain combines what's heard and felt Oct 19, 2005 | not rated yet | 0
- Wired for sound: How the brain senses visual illusions Apr 11, 2007 | not rated yet | 0
- Do you hear what i see? Feb 20, 2007 | not rated yet | 0
- How our senses combine to give us a better view of the world Nov 12, 2008 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Why is zone 1 in liver more prone to ischemic injury?
11 hours ago Hi, Is it because around central vein, there is only deoxygenated blood from the vein where as in the periphery there is hepatic artery. Also why...
How can there be villous adenoma in colon, if there are no villi there
May 22, 2013 As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
- More from Physics Forums - Medical Sciences
More news stories
(Medical Xpress)—The human brain is able to identify individuals' voices by comparing them against an internal 'average voice' prototype, according to neuroscientists.
Neuroscience 1 hour ago | not rated yet | 0 |
A new study determined that children and adolescents with seizures involving the temporal lobe are likely to have clinically significant behavioral problems and psychiatric illness, especially depression. Findings published ...
Neuroscience 2 hours ago | not rated yet | 0
As the human body fine-tunes its neurological wiring, nerve cells often must fix a faulty connection by amputating an axon—the "business end" of the neuron that sends electrical impulses to tissues or other ...
Neuroscience 3 hours ago | 5 / 5 (1) | 0 |
A study by researchers at Henry Ford Hospital found "substantial evidence" that a regenerative process involving damaged nerve fibers in the spinal cord could hold the key to better functional recovery by most stroke victims.
Neuroscience 3 hours ago | not rated yet | 0 |
Cinnamon: Can the red-brown spice with the unmistakable fragrance and variety of uses offer an important benefit? The common baking spice might hold the key to delaying the onset of –– or warding off ...
7 seconds ago | not rated yet | 0 |
Chinese and U.S. scientists have used virus isolated from a person who died from H7N9 avian influenza infection to determine whether the virus could infect and be transmitted between ferrets. Ferrets are often used as a mammalian ...
24 minutes ago | not rated yet | 0 |
By discovering the new mechanism by which estrogen suppresses lipid synthesis in the liver, UC Irvine endocrinologists have revealed a potential new approach toward treating certain liver diseases.
1 minute ago | not rated yet | 0 |
UCLA researchers examining outcomes for advanced heart-failure patients over the past two decades have found that, coinciding with the increased availability and use of new therapies, overall mortality has decreased and sudden ...
5 minutes ago | not rated yet | 0
Aortic arch pulse wave velocity, a measure of arterial stiffness, is a strong independent predictor of disease of the vessels that supply blood to the brain, according to a new study published in the June issue the journal ...
5 minutes ago | not rated yet | 0
Scientists at the National Institutes of Health report they have discovered in mouse studies that a small molecule released in the spinal cord triggers a process that is later experienced in the brain as the sensation of ...
1 hour ago | 5 / 5 (1) | 0 |