Researchers develop multimedia corpus of noise-induced word misperceptions

February 20, 2017, University of the Basque Country
María Luisa García Lecumberri and Martin Cooke, are in one of the laboratories of the Language and Speech research group, in the University of the Basque Country. Credit: Nuria González. UPV/EHU

Completely quiet conditions are actually quite rare. Most of the time, there is some kind of ambient noise present, including traffic, machinery, or conversations. Native speakers with a rich experience of a particular language and the context in which speech occurs have a great capacity to reconstruct part of a message obscured by noise. However, errors still occur at times. A group involving Dr García Lecumberri, Ikerbasque Research Professor Martin Cooke and collaborators have identified 3,207 "consistent" confusions. The confusions are said to be consistent because, in every case, a significant number of listeners agree. This type of confusion is extremely valuable in the construction of models of speech perception, since any model capable of making the same error is very likely to be undergoing the same processes as those in human listeners.

The research study involved more than 300,000 individual stimulus presentations to 212 listeners in a range of different conditions. The resulting corpus is the only one of its kind for the English language and is available at http://spandh.dcs.shef.ac.uk/ECCC/. For each confusion, the corpus contains the waveforms of both the speech and the sound, a record of what a cohort of listeners heard, along with phonemic transcriptions. Distinct types of confusion appear with some frequency in the corpus. In the simplest cases, it is clear that the noise masks some parts of the confused word, forcing listeners to suggest a word that best fits the audible fragments (e.g., "wooden" → "wood"; "pánico" → "pan") or to substitute one sound for another ("ten" → "pen"; "valla →falla"). In other cases, listeners appear to incorporate elements from the noise itself ("purse" → "permitted"; "ciervo" → "invierno"). Finally, the researchers find odd cases where there is little or no relation between the word produced and the confusion ("modern" → "suggest"; "guardan → pozo"). In these cases, the interaction of the speech and noise signals is complex, and therefore interesting.

Dr García Lecumberri says, "These studies help to reveal the mechanisms underlying , and the better we understand these processes, the more we can help at a technical and clinical level those who suffer hearing and comprehension problems." The group has also elicited a similar corpus for the Spanish language that can be accessed from the same web page. "There are similarities and differences between Spanish and English confusions: Spanish is a highly inflected language, leading to more confusion in word-final position; English has a larger number of monosyllabic words and a richer set of word-final consonants, leading to more substitution-type errors in this position." However, both languages show a similar pattern of types in noise, with some sounds surviving better than others.

Explore further: Ability to process speech declines with age

More information: Ricard Marxer et al, A corpus of noise-induced word misperceptions for English, The Journal of the Acoustical Society of America (2016). DOI: 10.1121/1.4967185

Related Stories

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Cutting through the clamor—how the brain helps us understand spoken words in noisy settings

December 21, 2016
Humans are exquisitely skilled at perceiving spoken words, even when speakers' voices are intermittently overwhelmed by noise, as happens in the din of construction sites or on busy urban streets. Now, in a study conducted ...

Research studies role native language plays in processing words in new languages

December 16, 2014
Research at the University of Kansas is exploring how a person's native language can influence the way the brain processes auditory words in a second language.

3Qs: Researcher studies how human listeners process speech in order to recognize spoken words

June 4, 2014
Joanne Miller, Matthews Distinguished University Professor and chair of Northeastern's Department of Psychology, was recently recognized for her pioneering research on human language processing in the field of speech perception. ...

Recommended for you

Animal study connects fear behavior, rhythmic breathing, brain smell center

April 20, 2018
"Take a deep breath" is the mantra of every anxiety-reducing advice list ever written. And for good reason. There's increasing physiological evidence connecting breathing patterns with the brain regions that control mood ...

Mechanism behind neuron death in motor neurone disease and frontotemporal dementia discovered

April 20, 2018
Scientists have identified the molecular mechanism that leads to the death of neurons in amyotrophic lateral sclerosis (also known as ALS or motor neurone disease) and a common form of frontotemporal dementia.

When there's an audience, people's performance improves

April 20, 2018
Often, people think performing in front of others will make them mess up, but a new study led by a Johns Hopkins University neuroscientist found the opposite: being watched makes people do better.

Signaling between neuron types found to instigate morphological changes during early neocortex development

April 20, 2018
A team of researchers from several institutions in Japan has found that developing neocortex neurons in mammals undergo a morphological transition from a multipolar shape to a bipolar shape due at least partially to signaling ...

MRI technique detects spinal cord changes in MS patients

April 20, 2018
A Vanderbilt University Medical Center-led research team has shown that magnetic resonance imaging (MRI) can detect changes in resting-state spinal cord function in patients with multiple sclerosis (MS).

Gene variant increases empathy-driven fear in mice

April 20, 2018
Researchers at the Center for Cognition and Sociality, within the Institute for Basic Science (IBS), have just published as study in Neuron reporting a genetic variant that controls and increases empathy-driven fear in mice. ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.