Audio processing: Following the brain's lead

Audio processing: Following the brain's lead
A brain-based pattern-recognition process that searches for familiar features in the audio spectrum improves sound recognition in computers. Credit: A*STAR Institute for Infocomm Research

When designed to process sound based on familiar patterns, sound recognition by computers becomes more robust.

Computers, machines and even smart phones can process sounds and audio signals with apparent ease, but they all require significant . Researchers from the A*STAR Institute for Infocomm Research in Singapore have proposed a way to improve computer audio processing by applying lessons inspired from the way the brain processes sounds1.

"The method proposed in our study may not only contribute to a better understanding of the mechanisms by which the biological acoustic systems operate, but also enhance both the effectiveness and efficiency of audio processing," comments Huajin Tang, an electrical engineer from the research team.

When listening to someone speaking in a quiet room, it is easy to identify the speaker and understand their words. While the same words spoken in a loud bar are more difficult to process, our brain is still capable of distinguishing the voice of the speaker from the background noise. Computers, on the other hand, still have considerable problems identifying complex sounds from a noisy background; even must send to a powerful centralized server for processing.

Considerable computing power at the server is required because the computer continuously processes the entire spectrum of human audio frequencies. The brain, however, analyzes information more selectively: it processes audio patterns localized in time and frequency (see image). When someone speaks with a deep voice, for example, the brain dispenses with analyzing high-pitched sounds. So when a speaker in a loud bar stops talking, the brain stops trying to catch and process the sounds that form his words.

Tang and his team emulated the brain's sound-recognition strategy by identifying key points in the audio spectrum of a sound. These points could be characteristic frequencies in a voice or repeating patterns, such as those of an alarm bell. They analyzed the signal in more detail around these key points only, looking for familiar audio frequencies as well as time patterns. This analysis enabled a robust extraction of matching signals when a noise was present. To improve the detection over time, the researchers fed matching frequency patterns into a neurological algorithm that mimics the way the brain learns through the repetition of known patterns.

In computer experiments, the algorithm successfully processed known target signals, even in the presence of noise. Expanding this approach, says Tang, "could lead to a greater understanding of the way the processes sound; and, beyond that, it could also include touch, vision and other senses."

The A*STAR-affiliated researchers contributing to this research are from the Institute for Infocomm Research

More information: Dennis, J., Yu, Q., Tang, H., Tran, H. D. & Li, H. Temporal coding of local spectrogram features for robust sound recognition. 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, 26–31 May 2013. ieeexplore.ieee.org/xpl/articl… _Number%3A6637585%29

add to favorites email to friend print save as pdf

Related Stories

Hearing brainwaves: Epilepsy EEG sonified

Jul 16, 2013

A simple method of converting the brain wave signals of people living with epilepsy into sound has been developed by a team of researchers at the University of Sydney.

Recommended for you

Emotional adjustment following traumatic brain injury

Oct 24, 2014

Life after a traumatic brain injury resulting from a car accident, a bad fall or a neurodegenerative disease changes a person forever. But the injury doesn't solely affect the survivor – the lives of their spouse or partner ...

New ALS associated gene identified using innovative strategy

Oct 22, 2014

Using an innovative exome sequencing strategy, a team of international scientists led by John Landers, PhD, at the University of Massachusetts Medical School has shown that TUBA4A, the gene encoding the Tubulin Alpha 4A protein, ...

User comments

Adjust slider to filter visible comments by rank

Display comments: newest first

RobertKarlStonjek
1 / 5 (1) Nov 07, 2013
What is missing here is the replacement of noisy signals with clearer ones. Upon an audio cue, the brain replaces the sound with the words expected or anticipated.

In this way, if the brain makes a mistake we *clearly hear* the erroneous word rather than the ambiguous audio.

This can be induced by priming an individual with information about what is expected to be heard. For instance 'haven' will readily be replaced with 'heaven' if we are primed to hear religious talk.