Is there a musical method for interpreting speech?

December 7, 2017, Acoustical Society of America
Credit: CC0 Public Domain

Cochlear implants have been a common method of correcting sensorineural hearing loss for individuals with damage to their brain, inner ear, or auditory nerves. The implanted devices use an electrode array that is inserted into the cochlea and assists in stimulating auditory nerve fibers. However, the speech patterns heard with the use of a cochlear implant are often spectrally degraded and can be difficult to understand. Vocoded speech, or distorted speech that imitates voice transduction by a cochlear implant, is used throughout acoustic and auditory research to explore speech comprehension under various conditions.

Researchers Kieran E. Laursen, Sara L. Protko and Terry L. Gottfried from Lawrence University, along with collaborators Iain C. Williams and Tahnee Marquardt from the University of North Carolina at Wilmington and the University of Oxford, respectively, will present their work on the effect of on the ability to understand vocoded speech at the 174th Meeting of the Acoustical Society of America, being held Dec. 4-8, 2017, in New Orleans, Louisiana.

Musical ability, described by a person's aptitude for playing an instrument, interpreting sound patterns or recognizing different tones, has long been linked to higher cognitive capacity and better communication skills.

"We are testing to see if someone's musicality or levels of musical experience affects their perceptions of vocoded speech," Laursen said in an email. "So, the question lies in how does music affect one's abilities to hear different pitches, intonations, and rhythms within distorted speech."

"The acoustic information in vocoded speech is quite different from that of natural speech in the presence of noise," said Gottfried. The rhythmic patterns of natural speech are often maintained in vocoded speech, so musicians may have the upper hand at interpretation due to their experience with rhythm production. However, musicians may also fair similarly to nonmusicians due to the loss of information that can result from vocoding.

Gottfried has been researching speech perception and its relation to music since he was in graduate school. "Over the years, I've continued my studies of this relation between speech and music perception, and there's been considerable recent research that suggests musical experience is related not only to improved second language speech perception, but also to improved phonetic perception in one's first language and in better recognition of speech in noise," he said, regarding a study on speech perceptions by nonnative listeners to Mandarin tones.

Using a commercially available program called SuperLab, research participants (both musicians and nonmusicians) were asked to transcribe vocoded sentences and words. They were then assigned to a training method on either vocoded or natural speech and asked to again transcribe vocoded sentences. The initial results showed that musicians had no significant advantage over nonmusicians in interpreting vocoded speech patterns, but this may be due to limited sample variation.

"Both groups scored well above chance on the Musical Ear Test, so it's possible that, if we tested listeners with very poor musical ears, they would also not do so well on the vocoded speech," Gottfried said. He also noted that the results are still useful in assessing the extent to which musical experience may relate to the of degraded speech.

The applications of this research span beyond the understanding of vocoded speech to a variety of acoustical interpretation patterns. Understanding normal speech in a noisy environment is dependent on rhythmic interpretations and is acoustically similar to attempting to understand vocoded . If musical experience improves vocoded understanding, it may also be useful in day to day interpretation in noisy environments.

Explore further: How musical training affects speech processing

More information: Abstract: 4pSC10: "Effect of musical experience on learning to understand vocoded speech," by Kieran E. Laursen, Iain C. Williams, Tahnee Marquardt, Sara L. Prostko and Terry L. Gottfried, Thursday, Dec. 7, 2017, in Studios Foyer in the New Orleans Marriott. asa2017fall.abstractcentral.com/s/u/OBlFa5aSFG8

Related Stories

How musical training affects speech processing

December 5, 2017
Musical training is associated with various cognitive improvements and pervasive plasticity in human brains. Among its merits, musical training is thought to enhance the cognitive and neurobiological foundation of speech ...

Ability to process speech declines with age

October 5, 2016
Researchers have found clues to the causes of age-related hearing loss. The ability to track and understand speech in both quiet and noisy environments deteriorates due in part to speech processing declines in both the midbrain ...

Patient older age not an issue in revision cochlear implantation

January 22, 2015
Older age of a patient does not appear to be an issue when revision cochlear implantation is warranted because of device failure, according to a report published online by JAMA Otolaryngology-Head & Neck Surgery.

Research team finds neurological notes that help identify how we process music

October 26, 2015
New York University researchers have identified how brain rhythms are used to process music, a finding that also shows how our perception of notes and melodies can be used as a method to better understand the auditory system.

Recommended for you

White matter repair and traumatic brain injury

September 20, 2018
Traumatic brain injury (TBI) is a leading cause of death and disability in the U.S., contributing to about 30 percent of all injury deaths, according to the CDC. TBI causes damage to both white and gray matter in the brain, ...

'Gut sense' is hardwired, not hormonal

September 20, 2018
If you've ever felt nauseous before an important presentation, or foggy after a big meal, then you know the power of the gut-brain connection.

Genomic dark matter activity connects Parkinson's and psychiatric diseases

September 20, 2018
Dopamine neurons are located in the midbrain, but their tendril-like axons can branch far into the higher cortical areas, influencing how we move and how we feel. New genetic evidence has revealed that these specialized cells ...

Full, but still feasting: Mouse study reveals how urge to eat overpowers a signal to stop

September 20, 2018
Almost everyone knows the feeling. You're at a restaurant or a holiday meal, and your stomach is telling you it's full, so logically you know you should stop eating.

Gut branches of vagus nerve essential components of brain's reward and motivation system

September 20, 2018
A novel gut-to-brain neural circuit establishes the vagus nerve as an essential component of the brain system that regulates reward and motivation, according to research conducted at the Icahn School of Medicine at Mount ...

Gambling monkeys help scientists find brain area linked to high-risk behavior

September 20, 2018
Monkeys who learned how to gamble have helped researchers pinpoint an area of the brain key to one's willingness to make risky decisions.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.