App will teach infants with cochlear implants to speak

March 31, 2017
App will teach infants with cochlear implants to speak
Dr Barnet was inspired to create the app after experiences with her own daughter. Credit: Swinburne University of Technology

A team of Swinburne researchers is developing an app to teach infants with cochlear implants how to speak.

GetTalking is designed for infants who are born deaf and receive . These infants must learn how to associate the sounds they can newly hear with the sounds they are able to make with their mouths.

The project was started by Swinburne's Dr Belinda Barnet after her own experience raising her hearing impaired daughter.

"With my own daughter – she had an implant at 11 months old – I could afford to take a year off to teach her to talk. This involved lots of repetitive exercises and time. Now that she can talk I'd like to help other families who may not have that time," Dr Barnet says.

Rewarding speech

Being developed to run on iPads or other tablets, GetTalking gives a bright visual reward for speaking.

"When a child has not heard any sound, they don't understand that a noise has an effect on the environment. So the first thing has to be a visual reward for an articulation," Dr Barnet says.

"At 12 months children respond well to visual rewards – and even an 'ahhh' or 'ohhh' should get a response from the app."

After the app recognises any kind of speech from the infant it then has to recognise what word the child was trying to say, rewarding them for speaking words and approximations of words.

App will teach infants with cochlear implants to speak
Credit: Swinburne University of Technology

As understanding a baby that doesn't know how to form words is exceptionally complicated, complex speech recognition software and artificial intelligence is needed.

"That's quite difficult. The speech needs to be cross-matched with thousands of articulations from normally-speaking babies," Dr Barnet says.

Swinburne's BabyLab is supporting GetTalking in this area with a large collection of speech samples.

GetTalking responds to the infant's word-approximation by re-articulating the correct word and showing a picture of what they are saying.

Building a team

Swinburne Department Chair of Health and Medical Sciences, Associate Professor Rachael McDonald, became involved with GetTalking as Dr Barnet was seeking someone with experience in occupational therapy and child development.

"I had just started at Swinburne and was very excited about the prospect of developing real technology that had the opportunity to really change people's lives," Associate Professor McDonald says.

"Dr Barnet and I gathered a team of experts to work on this project, in order to not only develop the app but to ensure that it is engaging for children and families and that it has an evidence base, so that it can be used in clinical settings."

Associate Professor McDonald hopes that the app will improve the lives of children and families who need to do repetitive activities.

"Rather than replacing, we are augmenting the experience, which will improve adherence to activities that often children and families struggle to do."

Explore further: Why deaf people can have accents, too

Related Stories

Why deaf people can have accents, too

March 22, 2017
Most people have probably encountered someone who appears to use lip-reading to overcome a hearing difficulty. But it is not as simple as that. Speech is "bimodal", in that we use both sounds and facial movements and gestures ...

Babies' babbles reflect their own involvement in language development

October 22, 2015
'Dada' is a first word for many babies. Babbling sounds with consonant-vowel repetitions, such as 'dada,' are common among infants once they reach 8 months old; however, these sounds are not prevalent among infants who have ...

Study aims to see how children with cochlear implants learn words

February 27, 2017
Research has proven the importance of early access to sound and spoken language among newborns and has led to significant advances in hearing screening and early intervention. Despite progress and improvements in educational ...

Infant cooing, babbling linked to hearing ability

September 23, 2014
Infants' vocalizations throughout the first year follow a set of predictable steps from crying and cooing to forming syllables and first words. However, previous research had not addressed how the amount of vocalizations ...

Infants benefit from implants with more frequency sounds

May 19, 2014
(Medical Xpress)—A new study from a UT Dallas researcher demonstrates the importance of considering developmental differences when creating programs for cochlear implants in infants.

Research demonstrates benefits of word repetition to infants

September 15, 2015
New research from the University of Maryland and Harvard University suggests that young infants benefit from hearing words repeated by their parents. With this knowledge, parents may make conscious communication choices that ...

Recommended for you

Injuries from window blinds send two children to the emergency department every day

December 11, 2017
Most homes have them. They help keep our rooms warm or cold and even add a pop of color to tie the décor together. But window blinds can cause serious injuries or even death to young children. A new study from the Center ...

Blood flow altered in brains of preterm newborns vs. full-term infants

December 4, 2017
Cerebral blood flow (CBF) of key regions of newborns' brains is altered in very premature infants and may provide an early warning sign of disturbed brain maturation well before such injury is visible on conventional imaging, ...

HPV vaccine is effective, safe 10 years after it's given

November 29, 2017
A decade of data on hundreds of boys and girls who received the HPV vaccine indicates the vaccine is safe and effective long term in protecting against the most virulent strains of the virus, researchers report.

Antibiotics administered during labor delay healthy gut bacteria in babies

November 28, 2017
Antibiotics administered during labour for Group B Streptococcus (GBS) affect the development of gut bacteria in babies, according to a study from McMaster University.

Stress in pregnancy linked to changes in infant's nervous system, less smiling, less resilience

November 23, 2017
Maternal stress during the second trimester of pregnancy may influence the nervous system of the developing child, both before and after birth, and may have subtle effects on temperament, resulting in less smiling and engagement, ...

Molecules in spit may be able to diagnose and predict length of concussions

November 20, 2017
Diagnosing a concussion can sometimes be a guessing game, but clues taken from small molecules in saliva may be able to help diagnose and predict the duration of concussions in children, according to Penn State College of ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.