Researchers develop multimedia corpus of noise-induced word misperceptions

February 20, 2017, University of the Basque Country
María Luisa García Lecumberri and Martin Cooke, are in one of the laboratories of the Language and Speech research group, in the University of the Basque Country. Credit: Nuria González. UPV/EHU

Completely quiet conditions are actually quite rare. Most of the time, there is some kind of ambient noise present, including traffic, machinery, or conversations. Native speakers with a rich experience of a particular language and the context in which speech occurs have a great capacity to reconstruct part of a message obscured by noise. However, errors still occur at times. A group involving Dr García Lecumberri, Ikerbasque Research Professor Martin Cooke and collaborators have identified 3,207 "consistent" confusions. The confusions are said to be consistent because, in every case, a significant number of listeners agree. This type of confusion is extremely valuable in the construction of models of speech perception, since any model capable of making the same error is very likely to be undergoing the same processes as those in human listeners.

The research study involved more than 300,000 individual stimulus presentations to 212 listeners in a range of different conditions. The resulting corpus is the only one of its kind for the English language and is available at http://spandh.dcs.shef.ac.uk/ECCC/. For each confusion, the corpus contains the waveforms of both the speech and the sound, a record of what a cohort of listeners heard, along with phonemic transcriptions. Distinct types of confusion appear with some frequency in the corpus. In the simplest cases, it is clear that the noise masks some parts of the confused word, forcing listeners to suggest a word that best fits the audible fragments (e.g., "wooden" → "wood"; "pánico" → "pan") or to substitute one sound for another ("ten" → "pen"; "valla →falla"). In other cases, listeners appear to incorporate elements from the noise itself ("purse" → "permitted"; "ciervo" → "invierno"). Finally, the researchers find odd cases where there is little or no relation between the word produced and the confusion ("modern" → "suggest"; "guardan → pozo"). In these cases, the interaction of the speech and noise signals is complex, and therefore interesting.

Dr García Lecumberri says, "These studies help to reveal the mechanisms underlying , and the better we understand these processes, the more we can help at a technical and clinical level those who suffer hearing and comprehension problems." The group has also elicited a similar corpus for the Spanish language that can be accessed from the same web page. "There are similarities and differences between Spanish and English confusions: Spanish is a highly inflected language, leading to more confusion in word-final position; English has a larger number of monosyllabic words and a richer set of word-final consonants, leading to more substitution-type errors in this position." However, both languages show a similar pattern of types in noise, with some sounds surviving better than others.

Explore further: Ability to process speech declines with age

More information: Ricard Marxer et al, A corpus of noise-induced word misperceptions for English, The Journal of the Acoustical Society of America (2016). DOI: 10.1121/1.4967185

Related Stories

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Cutting through the clamor—how the brain helps us understand spoken words in noisy settings

December 21, 2016
Humans are exquisitely skilled at perceiving spoken words, even when speakers' voices are intermittently overwhelmed by noise, as happens in the din of construction sites or on busy urban streets. Now, in a study conducted ...

Research studies role native language plays in processing words in new languages

December 16, 2014
Research at the University of Kansas is exploring how a person's native language can influence the way the brain processes auditory words in a second language.

3Qs: Researcher studies how human listeners process speech in order to recognize spoken words

June 4, 2014
Joanne Miller, Matthews Distinguished University Professor and chair of Northeastern's Department of Psychology, was recently recognized for her pioneering research on human language processing in the field of speech perception. ...

Recommended for you

Therapeutic antibodies protected nerve–muscle connections in a mouse model of Lou Gehrig's disease

February 20, 2018
Amyotrophic lateral sclerosis (ALS), also known as Lou Gehrig's disease, causes lethal respiratory paralysis within several years of diagnosis. There are no effective treatments to slow or halt this devastating disease. Mouse ...

Brain immune system is key to recovery from motor neuron degeneration

February 20, 2018
The selective demise of motor neurons is the hallmark of Lou Gehrig's disease, also known as amyotrophic lateral sclerosis (ALS). Yet neurologists have suspected there are other types of brain cells involved in the progression ...

Brain liquefaction after stroke is toxic to surviving brain: study

February 20, 2018
Scientists have known for years that the brain liquefies after a stroke. If cut off from blood and oxygen for a long enough period, a portion of the brain will die, slowly morphing from a hard, rubbery substance into liquid ...

Brain aging may begin earlier than expected

February 20, 2018
Physicists have devised a new method of investigating brain function, opening a new frontier in the diagnoses of neurodegenerative and ageing related diseases.

Every experience that the brain perceives is unique

February 20, 2018
Neuronal activity in the prefrontal cortex represents every experience as "novel." The neurons adapt their activity accordingly, even if the new experience is very similar to a previous one. That is the main finding of a ...

Electrical implant reduces 'invisible' symptoms of man's spinal cord injury

February 19, 2018
An experimental treatment that sends electrical currents through the spinal cord has improved "invisible" yet debilitating side effects for a B.C. man with a spinal cord injury.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.