New study sheds light on how selective hearing works in the brain
The longstanding mystery of how selective hearing works how people can tune in to a single speaker while tuning out their crowded, noisy environs is solved this week in the journal Nature by two scientists from the University of California, San Francisco (UCSF).
Psychologists have known for decades about the so-called "cocktail party effect," a name that evokes the Mad Men era in which it was coined. It is the remarkable human ability to focus on a single speaker in virtually any environmenta classroom, sporting event or coffee bareven if that person's voice is seemingly drowned out by a jabbering crowd.
To understand how selective hearing works in the brain, UCSF neurosurgeon Edward Chang, MD, a faculty member in the UCSF Department of Neurological Surgery and the Keck Center for Integrative Neuroscience, and UCSF postdoctoral fellow Nima Mesgarani, PhD, worked with three patients who were undergoing brain surgery for severe epilepsy.
Part of this surgery involves pinpointing the parts of the brain responsible for disabling seizures. The UCSF epilepsy team finds those locales by mapping the brain's activity over a week, with a thin sheet of up to 256 electrodes placed under the skull on the brain's outer surface or cortex. These electrodes record activity in the temporal lobehome to the auditory cortex.
UCSF is one of few leading academic epilepsy centers where these advanced intracranial recordings are done, and, Chang said, the ability to safely record from the brain itself provides unique opportunities to advance our fundamental knowledge of how the brain works.
"The combination of high-resolution brain recordings and powerful decoding algorithms opens a window into the subjective experience of the mind that we've never seen before," Chang said.
In the experiments, patients listened to two speech samples played to them simultaneously in which different phrases were spoken by different speakers. They were asked to identify the words they heard spoken by one of the two speakers.
The authors then applied new decoding methods to "reconstruct" what the subjects heard from analyzing their brain activity patterns. Strikingly, the authors found that neural responses in the auditory cortex only reflected those of the targeted speaker. They found that their decoding algorithm could predict which speaker and even what specific words the subject was listening to based on those neural patterns. In other words, they could tell when the listener's attention strayed to another speaker.
"The algorithm worked so well that we could predict not only the correct responses, but also even when they paid attention to the wrong word," Chang said.
SPEECH RECOGNITION BY THE HUMAN BRAIN AND MACHINES
The new findings show that the representation of speech in the cortex does not just reflect the entire external acoustic environment but instead just what we really want or need to hear.
They represent a major advance in understanding how the human brain processes language, with immediate implications for the study of impairment during aging, attention deficit disorder, autism and language learning disorders.
In addition, Chang, who is also co-director of the Center for Neural Engineering and Prostheses at UC Berkeley and UCSF, said that we may someday be able to use this technology for neuroprosthetic devices for decoding the intentions and thoughts from paralyzed patients that cannot communicate.
Revealing how our brains are wired to favor some auditory cues over others may even inspire new approaches toward automating and improving how voice-activated electronic interfaces filter sounds in order to properly detect verbal commands.
How the brain can so effectively focus on a single voice is a problem of keen interest to the companies that make consumer technologies because of the tremendous future market for all kinds of electronic devices with voice-active interfaces. While the voice recognition technologies that enable such interfaces as Apple's Siri have come a long way in the last few years, they are nowhere near as sophisticated as the human speech system.
An average person can walk into a noisy room and have a private conversation with relative easeas if all the other voices in the room were muted. In fact, said Mesgarani, an engineer with a background in automatic speech recognition research, the engineering required to separate a single intelligible voice from a cacophony of speakers and background noise is a surprisingly difficult problem.
Speech recognition, he said, is "something that humans are remarkably good at, but it turns out that machine emulation of this human ability is extremely difficult."
More information: The article, "Selective cortical representation of attended speaker in multi-talker speech perception" by Nima Mesgarani and Edward F. Chang appears in the April 19, 2012 issue of the journal Nature. dx.doi.org/10.1038/nature11020
Journal reference: Nature
Provided by University of California, San Francisco
- Decoding brain waves to eavesdrop on what we hear Jan 31, 2012 | not rated yet | 0
- Our brains are wired so we can better hear ourselves speak, study shows Dec 08, 2010 | not rated yet | 0
- Brain 'hears' voices when reading direct speech Jul 26, 2011 | not rated yet | 0
- Brain 'talks over' boring speech quotes Mar 26, 2012 | not rated yet | 0
- Researchers identify components of speech recognition pathway in humans Jun 22, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Why is zone 1 in liver more prone to ischemic injury?
19 hours ago Hi, Is it because around central vein, there is only deoxygenated blood from the vein where as in the periphery there is hepatic artery. Also why...
How can there be villous adenoma in colon, if there are no villi there
May 22, 2013 As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
- More from Physics Forums - Medical Sciences
More news stories
Neuroscience 6 hours ago | 4.8 / 5 (5) | 0 |
(Medical Xpress)—The human brain is able to identify individuals' voices by comparing them against an internal 'average voice' prototype, according to neuroscientists.
Neuroscience 10 hours ago | 1 / 5 (1) | 0 |
A new study determined that children and adolescents with seizures involving the temporal lobe are likely to have clinically significant behavioral problems and psychiatric illness, especially depression. Findings published ...
Neuroscience 10 hours ago | not rated yet | 0
As the human body fine-tunes its neurological wiring, nerve cells often must fix a faulty connection by amputating an axon—the "business end" of the neuron that sends electrical impulses to tissues or other ...
Neuroscience 11 hours ago | 5 / 5 (2) | 0 |
A study by researchers at Henry Ford Hospital found "substantial evidence" that a regenerative process involving damaged nerve fibers in the spinal cord could hold the key to better functional recovery by most stroke victims.
Neuroscience 11 hours ago | not rated yet | 0 |
9 hours ago | 5 / 5 (1) | 2 |
11 hours ago | 4.9 / 5 (8) | 0 |
9 hours ago | 5 / 5 (2) | 0 |
10 hours ago | not rated yet | 0 |
7 hours ago | not rated yet | 0 |
By discovering the new mechanism by which estrogen suppresses lipid synthesis in the liver, UC Irvine endocrinologists have revealed a potential new approach toward treating certain liver diseases.
8 hours ago | not rated yet | 0 |