Solving the 'cocktail party problem'

January 6, 2014 by Keith Hautala, University of Kentucky

Ever try to make out a quiet voice in a crowded room, where many conversations are happening all at once?

It's what Kevin Donohue calls the "Cocktail Party Problem."

Donohue, the Databeam Professor of Electrical and Computer Engineering at the University of Kentucky, is working on the technology that just might solve it. For more than 25 years he has researched signal-processing systems. This area deals with systems that mimic the 's ability to extract meaning from audiovisual information. A good example is what's going on, behind your eyes and between your ears, when you watch the video above.

"Your brain is making sense out of the sound and images," Donohue says. "Your ears and eyes function as sensors, which send signals to your brain where they are processed to have meaning."

Electrical and computer engineers are not limited to signals that can be seen or heard naturally by humans. They can employ sensors that use ultrasound, x-rays and electromagnetics to tease a meaningful signal out from a .

For the past six years, the main focus of Donohue's work at UK's Center for Visualization and Virtual Environments (the Vis Center) has been in distributed audio systems. This involves arranging systems of microphones in a room to be able to identify sounds, in particular voices, and to isolate and track them using computers.

This technology has applications in surveillance—for example, enabling investigators to home in on a "person of interest" whispering into a cell phone at a noisy airport—as well as in "smart rooms" that "understand" what is happening in an environment and can respond in useful ways, such as taking minutes at meetings, documenting brainstorming sessions, and archiving information for efficient retrieval.

Donohue's work is featured in the above video, produced by the Vis Center as part of its "What's Next" series.

Explore further: Audio processing: Following the brain's lead

Related Stories

Audio processing: Following the brain's lead

November 6, 2013
When designed to process sound based on familiar patterns, sound recognition by computers becomes more robust.

Deserts 'greening' from rising CO2

July 3, 2013
Increased levels of carbon dioxide (CO2) have helped boost green foliage across the world's arid regions over the past 30 years through a process called CO2 fertilisation, according to CSIRO research.

Uncovering how humans hear one voice among many

March 11, 2013
Humans have an uncanny ability to zero in on a single voice, even amid the cacophony of voices found in a crowded party or other large gathering of people. Researchers have long sought to identify the precise mechanisms by ...

Computer algorithms reveal how the brain processes and perceives sound in noisy environments

July 19, 2013
Every day the human brain encounters a cacophony of sounds, often all simultaneously competing for its attention.

Noises off: The machine that rubs out noise (w/ Video)

October 3, 2013
Future hearing aids could be adjusted by the wearer to remove background noise using new technology that could also be used to clean up and search YouTube videos.

New system allows for high-accuracy, through-wall, 3-D motion tracking (w/ Video)

December 11, 2013
Imagine playing a video game like Call of Duty or Battlefield and having the ability to lead your virtual army unit while moving freely throughout your house.

Recommended for you

New neuron-like cells allow investigation into synthesis of vital cellular components

January 22, 2018
Neuron-like cells created from a readily available cell line have allowed researchers to investigate how the human brain makes a metabolic building block essential for the survival of all living organisms. A team led by researchers ...

Finding unravels nature of cognitive inflexibility in fragile X syndrome

January 22, 2018
Mice with the genetic defect that causes fragile X syndrome (FXS) learn and remember normally, but show an inability to learn new information that contradicts what they initially learned, shows a new study by a team of neuroscientists. ...

Epilepsy linked to brain volume and thickness differences

January 22, 2018
Epilepsy is associated with thickness and volume differences in the grey matter of several brain regions, according to new research led by UCL and the Keck School of Medicine of USC.

Research reveals atomic-level changes in ALS-linked protein

January 18, 2018
For the first time, researchers have described atom-by-atom changes in a family of proteins linked to amyotrophic lateral sclerosis (ALS), a group of brain disorders known as frontotemporal dementia and degenerative diseases ...

Fragile X finding shows normal neurons that interact poorly

January 18, 2018
Neurons in mice afflicted with the genetic defect that causes Fragile X syndrome (FXS) appear similar to those in healthy mice, but these neurons fail to interact normally, resulting in the long-known cognitive impairments, ...

How your brain remembers what you had for dinner last night

January 17, 2018
Confirming earlier computational models, researchers at University of California San Diego and UC San Diego School of Medicine, with colleagues in Arizona and Louisiana, report that episodic memories are encoded in the hippocampus ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

RobertKarlStonjek
not rated yet Jan 07, 2014
Humans generally can't achieve the cocktail party effect from recordings of cocktail parties unless they listen to the recordings many times. Why?

The answer is that in the real cocktail party environment humans turn their head and move in an effort to zoom in on the voice of interest. This is phase locking along with frequency and transient response profiling of the voice of interest. One can not achieve this from a recording...

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.