Researchers develop multimedia corpus of noise-induced word misperceptions

February 20, 2017, University of the Basque Country
María Luisa García Lecumberri and Martin Cooke, are in one of the laboratories of the Language and Speech research group, in the University of the Basque Country. Credit: Nuria González. UPV/EHU

Completely quiet conditions are actually quite rare. Most of the time, there is some kind of ambient noise present, including traffic, machinery, or conversations. Native speakers with a rich experience of a particular language and the context in which speech occurs have a great capacity to reconstruct part of a message obscured by noise. However, errors still occur at times. A group involving Dr García Lecumberri, Ikerbasque Research Professor Martin Cooke and collaborators have identified 3,207 "consistent" confusions. The confusions are said to be consistent because, in every case, a significant number of listeners agree. This type of confusion is extremely valuable in the construction of models of speech perception, since any model capable of making the same error is very likely to be undergoing the same processes as those in human listeners.

The research study involved more than 300,000 individual stimulus presentations to 212 listeners in a range of different conditions. The resulting corpus is the only one of its kind for the English language and is available at http://spandh.dcs.shef.ac.uk/ECCC/. For each confusion, the corpus contains the waveforms of both the speech and the sound, a record of what a cohort of listeners heard, along with phonemic transcriptions. Distinct types of confusion appear with some frequency in the corpus. In the simplest cases, it is clear that the noise masks some parts of the confused word, forcing listeners to suggest a word that best fits the audible fragments (e.g., "wooden" → "wood"; "pánico" → "pan") or to substitute one sound for another ("ten" → "pen"; "valla →falla"). In other cases, listeners appear to incorporate elements from the noise itself ("purse" → "permitted"; "ciervo" → "invierno"). Finally, the researchers find odd cases where there is little or no relation between the word produced and the confusion ("modern" → "suggest"; "guardan → pozo"). In these cases, the interaction of the speech and noise signals is complex, and therefore interesting.

Dr García Lecumberri says, "These studies help to reveal the mechanisms underlying , and the better we understand these processes, the more we can help at a technical and clinical level those who suffer hearing and comprehension problems." The group has also elicited a similar corpus for the Spanish language that can be accessed from the same web page. "There are similarities and differences between Spanish and English confusions: Spanish is a highly inflected language, leading to more confusion in word-final position; English has a larger number of monosyllabic words and a richer set of word-final consonants, leading to more substitution-type errors in this position." However, both languages show a similar pattern of types in noise, with some sounds surviving better than others.

Explore further: Ability to process speech declines with age

More information: Ricard Marxer et al, A corpus of noise-induced word misperceptions for English, The Journal of the Acoustical Society of America (2016). DOI: 10.1121/1.4967185

Related Stories

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Cutting through the clamor—how the brain helps us understand spoken words in noisy settings

December 21, 2016
Humans are exquisitely skilled at perceiving spoken words, even when speakers' voices are intermittently overwhelmed by noise, as happens in the din of construction sites or on busy urban streets. Now, in a study conducted ...

Research studies role native language plays in processing words in new languages

December 16, 2014
Research at the University of Kansas is exploring how a person's native language can influence the way the brain processes auditory words in a second language.

3Qs: Researcher studies how human listeners process speech in order to recognize spoken words

June 4, 2014
Joanne Miller, Matthews Distinguished University Professor and chair of Northeastern's Department of Psychology, was recently recognized for her pioneering research on human language processing in the field of speech perception. ...

Recommended for you

Rare in-vivo study shows weak brain nodes have strong influence on memory network

June 20, 2018
Our ability to learn, remember, problem solve, and speak are all cognitive functions related to different parts of our brain. If researchers can identify how those brain parts communicate and exchange information with each ...

A dual-therapy approach to boost motor recovery after a stroke

June 20, 2018
Paralysis of an arm and/or leg is one of the most common effects of a stroke. But thanks to research carried out by scientists at the Defitech Foundation Chair in Brain-Machine Interface and collaborators, stroke victims ...

Powerful new approach helps understand molecular alterations in neurological disease

June 20, 2018
Neurological diseases are typically associated with a multitude of molecular changes. But out of these thousands of changes in gene expression, which ones are actually driving the disease? To answer this question, a team ...

Scientists unravel DNA code behind rare neurologic disease

June 20, 2018
Scientists conducting one of the largest full DNA analyses of a rare disease have identified a gene mutation associated with a perplexing brain condition that blinds and paralyzes patients.

New technique fine-tunes treatment for severe epilepsy cases

June 20, 2018
One of three epilepsy patients experience no relief from drugs and are candidates for surgery. An advance by researchers at Yale and the Cleveland Clinic will enable surgeons to more precisely target areas of the brain causing ...

Absence epilepsy—when the brain is like 'an orchestra without a conductor'

June 20, 2018
At first, the teacher described her six-year-old student as absentminded, a daydreamer. The boy was having difficulty paying attention in class. As the teacher watched the boy closely, she realized that he was not daydreaming. ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.