Solving the 'cocktail party problem'

January 6, 2014 by Keith Hautala

Ever try to make out a quiet voice in a crowded room, where many conversations are happening all at once?

It's what Kevin Donohue calls the "Cocktail Party Problem."

Donohue, the Databeam Professor of Electrical and Computer Engineering at the University of Kentucky, is working on the technology that just might solve it. For more than 25 years he has researched signal-processing systems. This area deals with systems that mimic the 's ability to extract meaning from audiovisual information. A good example is what's going on, behind your eyes and between your ears, when you watch the video above.

"Your brain is making sense out of the sound and images," Donohue says. "Your ears and eyes function as sensors, which send signals to your brain where they are processed to have meaning."

Electrical and computer engineers are not limited to signals that can be seen or heard naturally by humans. They can employ sensors that use ultrasound, x-rays and electromagnetics to tease a meaningful signal out from a .

For the past six years, the main focus of Donohue's work at UK's Center for Visualization and Virtual Environments (the Vis Center) has been in distributed audio systems. This involves arranging systems of microphones in a room to be able to identify sounds, in particular voices, and to isolate and track them using computers.

The video will load shortly

This technology has applications in surveillance—for example, enabling investigators to home in on a "person of interest" whispering into a cell phone at a noisy airport—as well as in "smart rooms" that "understand" what is happening in an environment and can respond in useful ways, such as taking minutes at meetings, documenting brainstorming sessions, and archiving information for efficient retrieval.

Donohue's work is featured in the above video, produced by the Vis Center as part of its "What's Next" series.

Explore further: Audio processing: Following the brain's lead

Related Stories

Audio processing: Following the brain's lead

November 6, 2013
When designed to process sound based on familiar patterns, sound recognition by computers becomes more robust.

Deserts 'greening' from rising CO2

July 3, 2013
Increased levels of carbon dioxide (CO2) have helped boost green foliage across the world's arid regions over the past 30 years through a process called CO2 fertilisation, according to CSIRO research.

Uncovering how humans hear one voice among many

March 11, 2013
Humans have an uncanny ability to zero in on a single voice, even amid the cacophony of voices found in a crowded party or other large gathering of people. Researchers have long sought to identify the precise mechanisms by ...

Computer algorithms reveal how the brain processes and perceives sound in noisy environments

July 19, 2013
Every day the human brain encounters a cacophony of sounds, often all simultaneously competing for its attention.

Noises off: The machine that rubs out noise (w/ Video)

October 3, 2013
Future hearing aids could be adjusted by the wearer to remove background noise using new technology that could also be used to clean up and search YouTube videos.

New system allows for high-accuracy, through-wall, 3-D motion tracking (w/ Video)

December 11, 2013
Imagine playing a video game like Call of Duty or Battlefield and having the ability to lead your virtual army unit while moving freely throughout your house.

Recommended for you

The neural codes for body movements

July 21, 2017
A small patch of neurons in the brain can encode the movements of many body parts, according to researchers in the laboratory of Caltech's Richard Andersen, James G. Boswell Professor of Neuroscience, Tianqiao and Chrissy ...

Faulty support cells disrupt communication in brains of people with schizophrenia

July 20, 2017
New research has identified the culprit behind the wiring problems in the brains of people with schizophrenia. When researchers transplanted human brain cells generated from individuals diagnosed with childhood-onset schizophrenia ...

Scientists reveal how patterns of brain activity direct specific body movements

July 20, 2017
New research by Columbia scientists offers fresh insight into how the brain tells the body to move, from simple behaviors like walking, to trained movements that may take years to master. The discovery in mice advances knowledge ...

Scientists discover combined sensory map for heat, humidity in fly brain

July 20, 2017
Northwestern University neuroscientists now can visualize how fruit flies sense and process humidity and temperature together through a "sensory map" within their brains, according to new research.

Team traces masculinization in mice to estrogen receptor in inhibitory neurons

July 20, 2017
Researchers at Cold Spring Harbor Laboratory (CSHL) have opened a black box in the brain whose contents explain one of the remarkable yet mysterious facts of life.

Speech language therapy delivered through the Internet leads to similar improvements as in-person treatment

July 20, 2017
Telerehabilitation helps healthcare professionals reach more patients in need, but some worry it doesn't offer the same quality of care as in-person treatment. This isn't the case, according to recent research by Baycrest.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

RobertKarlStonjek
not rated yet Jan 07, 2014
Humans generally can't achieve the cocktail party effect from recordings of cocktail parties unless they listen to the recordings many times. Why?

The answer is that in the real cocktail party environment humans turn their head and move in an effort to zoom in on the voice of interest. This is phase locking along with frequency and transient response profiling of the voice of interest. One can not achieve this from a recording...

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.