Audio processing: Following the brain's lead

Audio processing: Following the brain's lead
A brain-based pattern-recognition process that searches for familiar features in the audio spectrum improves sound recognition in computers. Credit: A*STAR Institute for Infocomm Research

When designed to process sound based on familiar patterns, sound recognition by computers becomes more robust.

Computers, machines and even smart phones can process sounds and audio signals with apparent ease, but they all require significant . Researchers from the A*STAR Institute for Infocomm Research in Singapore have proposed a way to improve computer audio processing by applying lessons inspired from the way the brain processes sounds1.

"The method proposed in our study may not only contribute to a better understanding of the mechanisms by which the biological acoustic systems operate, but also enhance both the effectiveness and efficiency of audio processing," comments Huajin Tang, an electrical engineer from the research team.

When listening to someone speaking in a quiet room, it is easy to identify the speaker and understand their words. While the same words spoken in a loud bar are more difficult to process, our brain is still capable of distinguishing the voice of the speaker from the background noise. Computers, on the other hand, still have considerable problems identifying complex sounds from a noisy background; even must send to a powerful centralized server for processing.

Considerable computing power at the server is required because the computer continuously processes the entire spectrum of human audio frequencies. The brain, however, analyzes information more selectively: it processes audio patterns localized in time and frequency (see image). When someone speaks with a deep voice, for example, the brain dispenses with analyzing high-pitched sounds. So when a speaker in a loud bar stops talking, the brain stops trying to catch and process the sounds that form his words.

Tang and his team emulated the brain's sound-recognition strategy by identifying key points in the audio spectrum of a sound. These points could be characteristic frequencies in a voice or repeating patterns, such as those of an alarm bell. They analyzed the signal in more detail around these key points only, looking for familiar audio frequencies as well as time patterns. This analysis enabled a robust extraction of matching signals when a noise was present. To improve the detection over time, the researchers fed matching frequency patterns into a neurological algorithm that mimics the way the brain learns through the repetition of known patterns.

In computer experiments, the algorithm successfully processed known target signals, even in the presence of noise. Expanding this approach, says Tang, "could lead to a greater understanding of the way the processes sound; and, beyond that, it could also include touch, vision and other senses."

The A*STAR-affiliated researchers contributing to this research are from the Institute for Infocomm Research

More information: Dennis, J., Yu, Q., Tang, H., Tran, H. D. & Li, H. Temporal coding of local spectrogram features for robust sound recognition. 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, 26–31 May 2013. ieeexplore.ieee.org/xpl/articl… _Number%3A6637585%29

add to favorites email to friend print save as pdf

Related Stories

Hearing brainwaves: Epilepsy EEG sonified

Jul 16, 2013

A simple method of converting the brain wave signals of people living with epilepsy into sound has been developed by a team of researchers at the University of Sydney.

Recommended for you

What happens in our brain when we unlock a door?

9 hours ago

People who are unable to button up their jacket or who find it difficult to insert a key in lock suffer from a condition known as apraxia. This means that their motor skills have been impaired – as a result ...

Sport can help multiple sclerosis patients

12 hours ago

A study developed at the Miguel Hernández University of Elche (Spain) has preliminarily concluded that people with multiple sclerosis may reduce perceived fatigue and increase mobility through a series of ...

Obama's BRAIN initiative gets more than $300 million

17 hours ago

President Barack Obama's initiative to study the brain and improve treatment of conditions like Alzheimer's and autism was given a boost Tuesday with the announcement of more than $300 million in funds.

User comments

Adjust slider to filter visible comments by rank

Display comments: newest first

RobertKarlStonjek
1 / 5 (1) Nov 07, 2013
What is missing here is the replacement of noisy signals with clearer ones. Upon an audio cue, the brain replaces the sound with the words expected or anticipated.

In this way, if the brain makes a mistake we *clearly hear* the erroneous word rather than the ambiguous audio.

This can be induced by priming an individual with information about what is expected to be heard. For instance 'haven' will readily be replaced with 'heaven' if we are primed to hear religious talk.