15 years of brain research: Multisensory speech perception examined

by Bettye Miller

Research on multisensory speech perception in recent years has helped revolutionize our understanding of how the brain organizes the information it receives from our many different senses, UC Riverside psychology professor Lawrence D. Rosenblum writes in the January 2013 issue of Scientific American.

" and have largely abandoned early ideas of the brain as a , in which many distinct regions are dedicated to different senses," he says. "Instead scientists now think that the brain has evolved to encourage as much cross talk as possible between the senses—that the brain's sensory regions are physically intertwined."

The article, "A Confederacy of Senses," explains how research in the past 15 years has demonstrated that no sense works alone. An abstract of the article can be read here.

"The multisensory revolution is also suggesting new ways to improve devices for the blind and deaf, such as cochlear implants," Rosenblum writes. This research also has improved speech-recognition software, he says.

Researchers have discovered that the brain "does not channel visual information from the eyes into one neural container and auditory information from the ears into another, discrete, container as though it were sorting coins," Rosenblum writes. "Rather our brains derive meaning from the world in as many ways as possible by blending the diverse forms of sensory perception."

Rosenblum is the author of "See What I'm Saying: The Extraordinary Powers of Our Five Senses" (Norton, 2010), and has spent two decades studying multisensory perception, lipreading and hearing. His research has been supported by the National Science Foundation and the National Institutes of Health. He is known internationally for his research on risks the inaudibility of hybrid cars pose for blind and other pedestrians.

add to favorites email to friend print save as pdf

Related Stories

Harnessing Our Sensory Superpowers

Mar 12, 2010

(PhysOrg.com) -- New research in perceptual psychology and brain science is revealing that our senses pick up information about the world that we thought was only available to other species, Lawrence Rosenblum, UCR professor ...

Psychologist explores human perception

May 13, 2010

(PhysOrg.com) -- Faces tell the stories in UC Riverside professor Larry Rosenblum's ecological listening lab, as volunteer test subjects show that they can "read" unheard speech — not just from lips, but from the simple ...

Hybrid Cars Are Harder to Hear

Mar 31, 2008

Hybrid cars are so quiet when operating only with their electric motors that they may pose a risk to the blind and some other pedestrians, research by a University of California, Riverside psychologist suggests.

How our senses combine to give us a better view of the world

Nov 12, 2008

From a young age we are taught about the five senses and how they help us to explore our world. Although each sense seems to be its own entity, recent studies have indicated that there is actually a lot of overlap and blending ...

Recommended for you

Know the brain, and its axons, by the clothes they wear

Apr 18, 2014

(Medical Xpress)—It is widely know that the grey matter of the brain is grey because it is dense with cell bodies and capillaries. The white matter is almost entirely composed of lipid-based myelin, but ...

Turning off depression in the brain

Apr 17, 2014

Scientists have traced vulnerability to depression-like behaviors in mice to out-of-balance electrical activity inside neurons of the brain's reward circuit and experimentally reversed it – but there's ...

Rapid whole-brain imaging with single cell resolution

Apr 17, 2014

A major challenge of systems biology is understanding how phenomena at the cellular scale correlate with activity at the organism level. A concerted effort has been made especially in the brain, as scientists are aiming to ...

User comments