Researchers develop multimedia corpus of noise-induced word misperceptions

February 20, 2017, University of the Basque Country
María Luisa García Lecumberri and Martin Cooke, are in one of the laboratories of the Language and Speech research group, in the University of the Basque Country. Credit: Nuria González. UPV/EHU

Completely quiet conditions are actually quite rare. Most of the time, there is some kind of ambient noise present, including traffic, machinery, or conversations. Native speakers with a rich experience of a particular language and the context in which speech occurs have a great capacity to reconstruct part of a message obscured by noise. However, errors still occur at times. A group involving Dr García Lecumberri, Ikerbasque Research Professor Martin Cooke and collaborators have identified 3,207 "consistent" confusions. The confusions are said to be consistent because, in every case, a significant number of listeners agree. This type of confusion is extremely valuable in the construction of models of speech perception, since any model capable of making the same error is very likely to be undergoing the same processes as those in human listeners.

The research study involved more than 300,000 individual stimulus presentations to 212 listeners in a range of different conditions. The resulting corpus is the only one of its kind for the English language and is available at http://spandh.dcs.shef.ac.uk/ECCC/. For each confusion, the corpus contains the waveforms of both the speech and the sound, a record of what a cohort of listeners heard, along with phonemic transcriptions. Distinct types of confusion appear with some frequency in the corpus. In the simplest cases, it is clear that the noise masks some parts of the confused word, forcing listeners to suggest a word that best fits the audible fragments (e.g., "wooden" → "wood"; "pánico" → "pan") or to substitute one sound for another ("ten" → "pen"; "valla →falla"). In other cases, listeners appear to incorporate elements from the noise itself ("purse" → "permitted"; "ciervo" → "invierno"). Finally, the researchers find odd cases where there is little or no relation between the word produced and the confusion ("modern" → "suggest"; "guardan → pozo"). In these cases, the interaction of the speech and noise signals is complex, and therefore interesting.

Dr García Lecumberri says, "These studies help to reveal the mechanisms underlying , and the better we understand these processes, the more we can help at a technical and clinical level those who suffer hearing and comprehension problems." The group has also elicited a similar corpus for the Spanish language that can be accessed from the same web page. "There are similarities and differences between Spanish and English confusions: Spanish is a highly inflected language, leading to more confusion in word-final position; English has a larger number of monosyllabic words and a richer set of word-final consonants, leading to more substitution-type errors in this position." However, both languages show a similar pattern of types in noise, with some sounds surviving better than others.

Explore further: Ability to process speech declines with age

More information: Ricard Marxer et al, A corpus of noise-induced word misperceptions for English, The Journal of the Acoustical Society of America (2016). DOI: 10.1121/1.4967185

Related Stories

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Cutting through the clamor—how the brain helps us understand spoken words in noisy settings

December 21, 2016
Humans are exquisitely skilled at perceiving spoken words, even when speakers' voices are intermittently overwhelmed by noise, as happens in the din of construction sites or on busy urban streets. Now, in a study conducted ...

Research studies role native language plays in processing words in new languages

December 16, 2014
Research at the University of Kansas is exploring how a person's native language can influence the way the brain processes auditory words in a second language.

3Qs: Researcher studies how human listeners process speech in order to recognize spoken words

June 4, 2014
Joanne Miller, Matthews Distinguished University Professor and chair of Northeastern's Department of Psychology, was recently recognized for her pioneering research on human language processing in the field of speech perception. ...

Recommended for you

Cesarean-born mice show altered patterns of brain development, study finds

October 15, 2018
Cesarean-born mice show altered patterns of cell death across the brain, exhibiting greater nerve cell death than vaginally delivered mice in at least one brain area, a finding by Georgia State University researchers that ...

Scientists chase mystery of how dogs process words

October 15, 2018
When some dogs hear their owners say "squirrel," they perk up, become agitated. They may even run to a window and look out of it. But what does the word mean to the dog? Does it mean, "Pay attention, something is happening?" ...

Study points to possible new therapy for hearing loss

October 15, 2018
Researchers have taken an important step toward what may become a new approach to restore hearing loss. In a new study, out today in the European Journal of Neuroscience, scientists have been able to regrow the sensory hair ...

Sugar, a 'sweet' tool to understand brain injuries

October 15, 2018
Australian researchers have developed ground-breaking new technology which could prove crucial in treating brain injuries and have multiple other applications, including testing the success of cancer therapies.

Scientists examine how neuropathic pain responds to Metformin

October 15, 2018
Scientists seeking an effective treatment for one type of chronic pain believe a ubiquitous, generic diabetes medication might solve both the discomfort and the mental deficits that go with the pain.

Abnormal vision in childhood can affect brain functions

October 13, 2018
A research team has discovered that abnormal vision in childhood can affect the development of higher-level brain areas responsible for things such as attention.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.