Humanoid robot helps train children with autism
This is Aiden, who has been diagnosed with ASD, and NAO, the humanoid robot who can help him. Credit: Joe Howell, Vanderbilt University
"Aiden, look!" piped NAO, a two-foot tall humanoid robot, as it pointed to a flat-panel display on a far wall. As the cartoon dog Scooby Doo flashed on the screen, Aiden, a young boy with an unruly thatch of straw-colored hair, looked in the direction the robot was pointing.
Aiden, who is three-and-a-half years old, has been diagnosed with autism spectrum disorder (ASD). NAO (pronounced "now") is the diminutive "front man" for an elaborate system of cameras, sensors and computers designed specifically to help children like Aiden learn how to coordinate their attention with other people and objects in their environment. This basic social skill is called joint attention. Normal children develop it naturally. Children with autism, however, have difficulty doing it and that inability can compound into a variety of learning difficulties as they age.
An interdisciplinary team of mechanical engineers and autism experts at Vanderbilt University have developed the system and used it to demonstrate that robotic systems may be powerful tools for enhancing the basic social learning skills of children with ASD. Writing in the March issue of the IEEE Transactions on Neural Systems and Rehabilitation Engineering, the researchers report that children with ASD paid more attention to the robot and followed its instructions almost as well as they did those of a human therapist in standard exercises used to develop joint attention skill.
The finding indicates that robots could play a crucial role in responding to the "public health emergency" that has been created by the rapid growth in the number of children being diagnosed with ASD. Today, one in 88 children (one in 54 boys) are being diagnosed with ASD. That is a 78 percent increase in just four years. The trend has major implications for the nation's healthcare budget because estimates of the lifetime cost of treating ASD patients ranges from four to six times greater than for patients without autism.
"This is the first real world test of whether intelligent adaptive systems can make an impact on ASD," said team member Zachary Warren who directs the Treatment and Research Institute for Autism Spectrum Disorders (TRIAD) at Vanderbilt's Kennedy Center.
The initial impetus for the project came from Vanderbilt Professor of Mechanical Engineering and Computer Engineering Nilanjan Sarkar. His original research involved the development of systems to improve the man-machine interface. He did so by outfitting computer/robot users with biosensors and analyzing variations in various readings like blood pressure and skin response to evaluate their emotional state. The information was used to program computers and robots to respond accordingly.
Six years ago, when visiting his cousin in India, Sarkar learned that his cousin's son had been diagnosed with ASD. "After I learned something about autism, it occurred to me that my research could be valuable for treating ASD," he said.
Engineer Nilanjan Sarkar, NAO, and pediatrician Julie Crittendon. Credit: Joe Howell / VanderbiltAt the time, several experiments had been conducted that suggested young children, in general, and young children with ASD, in particular, found robots especially appealing. "We knew that this gave us an advantage, but we had to figure out how to leverage it to improve the children's social skills," Sarkar said.
"You can't just drop a robot down in front of a child and expect it to work," added Warren. "You must develop a sophisticated adaptive structure around the robot before it will work."
To develop this structure, which they named ARIA (Adaptive Robot-Mediated Intervention Architecture), Sarkar and Warren assembled a team that consists of Esubalew Bekele, a graduate student in electrical engineering and computer engineering, Uttama Lahiri, a graduate student in mechanical engineering and who is currently an assistant professor of electrical engineering at the Indian Institute of Technology in Gandhinagar, Amy Swanson, a project manager at TRIAD, and Julie Crittendon, assistant professor of pediatrics at the Vanderbilt University Medical Center.
The team decided that a robotic system had the greatest potential working with young children. "Research has shown that early intervention, individualized to the learner's needs, is currently the most effective approach for helping children with autism develop the foundational social communication skills they need to become productive adults," Crittendon said.
So the researchers built an "intelligent environment" around NAO, a commercial humanoid robot made in France, whose control architecture was augmented for the purpose. The small robot stands on a table at the front of the room. Flat panel displays are attached to the side walls. The chair where the child sits faces the front of the room and is high enough to put the robot at eye level. The room is equipped with a number of inexpensive web cameras that are aimed at the chair. Their purpose is to track the child's head movements, so the system can determine where he or she is looking. To aid in this effort, children in the study wore a baseball cap decorated with a strip of LED lights that allowed the computer to infer where they are looking.
NAO has been programmed with a series of verbal prompts, such as "look over here" and "let's do some more," and gestures such as looking and pointing at one of the displays, that imitate the prompts and gestures that human therapists use in joint attention training. The protocol begins with a verbal prompt that asks the child to look at an image or video displayed on one of the screens. If the child doesn't respond, then the therapist provides increasing support by combining a verbal prompt with physical gestures such as turning her head or pointing. When the child looks at the target then the therapist responds with praise, such as telling the child, "good job."
The set up allowed the researchers to test the relative effectiveness of the robot-based system and human therapists in joint attention training with a dozen 2- to 5-year old children, six with ASD and a control group of six typically-developing children. They alternated short human-led and robot-led training sessions and compared how the children performed.
The test found that the children in both groups spent more time looking at the robot than they spent looking at the human therapist. During the human-led sessions, the children in the control group spent significantly more time watching the therapist than the children with ASD did. In the robot-led sessions, however, both groups spent about the same amount of time looking at the robot.
"The children's engagement with the robot was excellent," Crittendon said, "and we saw improvements across the board in both groups."
One of the key elements of ARIA is its closed loop design. The robot adapts its behavior to each child automatically depending on how he or she is responding. "There is a saying in the field, 'If you've seen one child with ASD, you've seen one child with ASD.' So one size does not fit all. To be useful, the system must be adaptive," Warren said.
In addition, ARIA is not designed to replace human therapists, who are in short supply, but to leverage their efforts. "A therapist does many things that robots can't do," said Sarkar. "But a robot-centered system could provide much of the repeated practice that is essential to learning. The cost of robotic systems like this will continue to come down in the future so it should easily pay for itself by supplementing human intervention."
Warren hopes that robotic systems can act as an "accelerant technology" that actually increases the rate at which children with ASD learn the social skills that they need. Encouraged by the success of this current study, Sarkar and Warren have started developing robot-mediated autism intervention systems that will address other deficits of children with autism such as imitation learning, role playing and sharing.
Provided by Vanderbilt University
- Robot Speaks the Language of Kids Aug 05, 2010 | not rated yet | 0
- Eye-tracking reveals variability in successful social strategies for children with autism Feb 27, 2012 | not rated yet | 0
- Robots that monitor emotions of ASD children Feb 17, 2009 | not rated yet | 0
- Using robots to help children with autism Sep 28, 2012 | not rated yet | 0
- Study shows delays in siblings of children with autism spectrum disorders May 16, 2012 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
How many joules expended for a push up?
1 hour ago Just wondering if any of you can do the calculation that well approximates the amount of joules expended by a push up.
force to keep the folding doors
1 hour ago Hello, I would like to ask you to calculate the force F, which needed to keep the folding doors in this position. I would like to know what is the...
Confusion regarding direction of kinetic friction on inclined plane.
2 hours ago *please help! * The formula for kinetic friction acting on a sliding body is μkN When the body is sliding down an inclined plane fk=μkN
8 hours ago Alright, so in Pathfinder (like Dungeons and Dragons) there's a spell that allows you to lift/move stuff within 25 ft with 5 pounds of force. A...
10 hours ago So energy can only be converted... So when you squeeze the bulb on a blood pressure cuff, you are applying kinetic energy. Then the cuff fills with...
How does momentum, inertia and drag affect the motion of an object?
13 hours ago How does momentum and inertia affect changes in speed, when considering acceleration from thrust, or from decelleration from drag? Say, for a...
- More from Physics Forums - Classical Physics
More news stories
Research by Victoria University PhD education graduand Larah van der Meer highlights the importance of understanding the communication preferences of children with developmental disabilities such as autism.
Autism spectrum disorders May 14, 2013 | 3.3 / 5 (3) | 1
At times, Andy Shih still finds himself overwhelmed by the groundswell of interest in autism applications he's seen in the three years since Apple Inc. released the first iPad.
Autism spectrum disorders May 09, 2013 | 2 / 5 (1) | 0
Children with autism see simple movement twice as quickly as other children their age, and this hypersensitivity to motion may provide clues to a fundamental cause of the developmental disorder, according ...
Autism spectrum disorders May 08, 2013 | not rated yet | 0 |
(AP)—Autism scientists are seeking more brain samples for research.
Autism spectrum disorders May 02, 2013 | 5 / 5 (1) | 0
An increasing number of U.S. children are experiencing gastrointestinal issues that require interventions to resolve, according to research presented at Digestive Disease Week (DDW).
1 hour ago | not rated yet | 0 |
A ground-breaking advance in colonoscopy technology signals the future of colorectal care, according to research presented today at Digestive Disease Week(DDW). Additional research focuses on optimizing the minimal withdrawal ...
1 hour ago | not rated yet | 0
Big names in medicine are set to give an upbeat assessment of the war on AIDS on Tuesday, 30 years after French researchers identified the virus that causes the disease.
9 hours ago | 5 / 5 (1) | 0
For combat veterans suffering from post-traumatic stress disorder, 'fear circuitry' in the brain never rests
Chronic trauma can inflict lasting damage to brain regions associated with fear and anxiety. Previous imaging studies of people with post-traumatic stress disorder, or PTSD, have shown that these brain regions can over-or ...
10 hours ago | not rated yet | 0 |
(Medical Xpress)—What if the quality of your work depends more on your focus on the piano keys or canvas or laptop than your musical or painting or computing skills? If target users can be convinced, they ...
22 hours ago | 3.7 / 5 (3) | 0 |
The neural machinery underlying our olfactory sense continues to be an enigma for neuroscience. A recent review in Neuron seeks to expand traditional ideas about how neurons in the olfactory bulb might encode information about ...
21 hours ago | not rated yet | 0 |