Researchers develop multimedia corpus of noise-induced word misperceptions

February 20, 2017, University of the Basque Country
María Luisa García Lecumberri and Martin Cooke, are in one of the laboratories of the Language and Speech research group, in the University of the Basque Country. Credit: Nuria González. UPV/EHU

Completely quiet conditions are actually quite rare. Most of the time, there is some kind of ambient noise present, including traffic, machinery, or conversations. Native speakers with a rich experience of a particular language and the context in which speech occurs have a great capacity to reconstruct part of a message obscured by noise. However, errors still occur at times. A group involving Dr García Lecumberri, Ikerbasque Research Professor Martin Cooke and collaborators have identified 3,207 "consistent" confusions. The confusions are said to be consistent because, in every case, a significant number of listeners agree. This type of confusion is extremely valuable in the construction of models of speech perception, since any model capable of making the same error is very likely to be undergoing the same processes as those in human listeners.

The research study involved more than 300,000 individual stimulus presentations to 212 listeners in a range of different conditions. The resulting corpus is the only one of its kind for the English language and is available at http://spandh.dcs.shef.ac.uk/ECCC/. For each confusion, the corpus contains the waveforms of both the speech and the sound, a record of what a cohort of listeners heard, along with phonemic transcriptions. Distinct types of confusion appear with some frequency in the corpus. In the simplest cases, it is clear that the noise masks some parts of the confused word, forcing listeners to suggest a word that best fits the audible fragments (e.g., "wooden" → "wood"; "pánico" → "pan") or to substitute one sound for another ("ten" → "pen"; "valla →falla"). In other cases, listeners appear to incorporate elements from the noise itself ("purse" → "permitted"; "ciervo" → "invierno"). Finally, the researchers find odd cases where there is little or no relation between the word produced and the confusion ("modern" → "suggest"; "guardan → pozo"). In these cases, the interaction of the speech and noise signals is complex, and therefore interesting.

Dr García Lecumberri says, "These studies help to reveal the mechanisms underlying , and the better we understand these processes, the more we can help at a technical and clinical level those who suffer hearing and comprehension problems." The group has also elicited a similar corpus for the Spanish language that can be accessed from the same web page. "There are similarities and differences between Spanish and English confusions: Spanish is a highly inflected language, leading to more confusion in word-final position; English has a larger number of monosyllabic words and a richer set of word-final consonants, leading to more substitution-type errors in this position." However, both languages show a similar pattern of types in noise, with some sounds surviving better than others.

Explore further: Ability to process speech declines with age

More information: Ricard Marxer et al, A corpus of noise-induced word misperceptions for English, The Journal of the Acoustical Society of America (2016). DOI: 10.1121/1.4967185

Related Stories

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Cutting through the clamor—how the brain helps us understand spoken words in noisy settings

December 21, 2016
Humans are exquisitely skilled at perceiving spoken words, even when speakers' voices are intermittently overwhelmed by noise, as happens in the din of construction sites or on busy urban streets. Now, in a study conducted ...

Research studies role native language plays in processing words in new languages

December 16, 2014
Research at the University of Kansas is exploring how a person's native language can influence the way the brain processes auditory words in a second language.

3Qs: Researcher studies how human listeners process speech in order to recognize spoken words

June 4, 2014
Joanne Miller, Matthews Distinguished University Professor and chair of Northeastern's Department of Psychology, was recently recognized for her pioneering research on human language processing in the field of speech perception. ...

Recommended for you

Parents' brain activity 'echoes' their infant's brain activity when they play together

December 13, 2018
When infants are playing with objects, their early attempts to pay attention to things are accompanied by bursts of high-frequency activity in their brain. But what happens when parents play together with them? New research, ...

Researchers discover abundant source for neuronal cells

December 13, 2018
USC researchers seeking a way to study genetic activity associated with psychiatric disorders have discovered an abundant source of human cells—the nose.

In the developing brain, scientists find roots of neuropsychiatric diseases

December 13, 2018
The most comprehensive genomic analysis of the human brain ever undertaken has revealed new insights into the changes it undergoes through development, how it varies among individuals, and the roots of neuropsychiatric illnesses ...

Researchers find the cause of and cure for brain injury associated with gut condition

December 13, 2018
Using a mouse model of necrotizing enterocolitis (NEC)—a potentially fatal condition that causes a premature infant's gut to suddenly die—researchers at Johns Hopkins say they have uncovered the molecular causes of the ...

How the brain tells you to scratch that itch

December 13, 2018
It's a maddening cycle that has affected us all: it starts with an itch that triggers scratching, but scratching only makes the itchiness worse. Now, researchers have revealed the brain mechanism driving this uncontrollable ...

Researchers identify pathway that drives sustained pain following injury

December 13, 2018
A toddler puts her hand on a hot stove and swiftly withdraws it. Alas, it's too late—the child's finger has sustained a minor burn. To soothe the pain, she puts the burned finger in her mouth.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.