Researchers harness virtual reality, motion capture to study neurological disorders

September 6, 2018 by Mark Michaud, University of Rochester Medical Center
Credit: CC0 Public Domain

Neuroscientists at the University of Rochester Medical Center (URMC) have a powerful new state-of-the-art tool at their disposal to study diseases like Autism, Alzheimer's, and traumatic brain injury. The Mobile Brain/Body Imaging system, or MoBI, combines virtual reality, brain monitoring, and Hollywood-inspired motion capture technology, enabling researchers to study the movement difficulties that often accompany neurological disorders and why our brains sometimes struggle while multitasking.

"Many studies of occur in controlled environments where study subjects are sitting in a sound proof room staring at a computer screen," said John Foxe, Ph.D., director of the URMC Del Monte Institute for Neuroscience. "The MoBI system allows us to get people walking, using their senses, and solving the types of tasks you face every day, all the while measuring brain activity and tracking how the processes associated with cognition and movement interact."

The MoBI platform – which is located in the Del Monte Institute's Cognitive Neurophysiology Lab – brings together several high tech systems. Using the same technology that is employed by movie studios to produce CGI special effects, study participants wear a black body suite that is fitted with reflective markers. Participants are then asked to walk on a treadmill or manipulate objects at a table in a room fitted out with 16 high speed cameras that record the position of the markers with millimeter precision. This data is mapped to a computer generated 3-D model that tracks movement.

While they are walking, a virtual environment – a cityscape, for example – is projected on the screen in front of them which they must navigate. They can also be asked to perform task and make decisions in response to what is being projected on the screen. While this occurring, the brains of are monitored via a high-density electroencephalogram (EEG) that detects electrical activity using small metal electrodes attached to the scalp.

Credit: University of Rochester Medical Center

The motion tracking and EEG data are synchronized, allowing researchers to track which areas of the brain are being activated when walking or performing task and study how the brain responds while moving, performing tasks, or doing both at the same time.

This information could provide new insight into developmental diseases like Autism, which is often characterized with difficulty in processing sensory information from multiple sources. Individuals with Autism also often have an abnormal gait. People with Alzheimer's, dementia, and sports concussions also experience movement difficulties.

"There is competition between the processes that allow you to walk well and the processes that allow you to think well," said Ed Freedman, Ph.D., an associate professor in the Del Monte Institute and principal investigator in the Cognitive Neurophysiology Lab. "We don't fall when we are sitting at a desk performing a task, we fall when we are walking down the street, avoiding traffic and other people, checking our phone, and thinking about what we are going to cook for dinner. We can use the MoBI to reveal underlying problems in the allocation of cognitive resources in individuals with neurological disorders because we are essentially stressing the system by asking them to perform task while on the treadmill."

The researchers are currently using MoBI to establish a set of data with healthy individuals. This baseline of brain activity can then be compared to people with neurological disorders to identify new "signatures" of disease and brain processes that can be employed during clinical trials.

"When you get good measurements of how the brain works and contrast that activity with people who are depressed or suffer from Autism or dementia, you can develop biomarkers – or neuro-markers – of disease," said Foxe. "Using these neuro-markers we can then test whether a given intervention or therapeutic is actually working."

Explore further: Eye test could help diagnose autism

Related Stories

Eye test could help diagnose autism

July 24, 2017
A new study out in European Journal of Neuroscience could herald a new tool that helps physicians identify a sub-group of people with Autism spectrum disorders (ASD). The test, which consists of measuring rapid eye movements, ...

Researchers uncover hidden brain states that regulate performance and decision making

July 3, 2018
Brain activity is driven by encounters with external stimuli and situations, simultaneously occurring with internal mental processes. A team of researchers from Stanford University, with funding from the NIH BRAIN Initiative, ...

Autism brain response theory a dead end, study says

December 6, 2016
A new study out today in the journal Cerebral Cortex challenges the hypothesis that nerve cells in the brains of individuals with Autism Spectrum Disorders do not reliably and consistently respond to external stimuli.

Brain activity alternates while stepping

May 14, 2018
Human steps are associated with neural activity that alternates between the left and right sides of the brain, finds a study of Parkinson's disease patients published in JNeurosci. The research recommends future investigations ...

Use of brain-computer interface, virtual avatar could help people with gait disabilities

August 23, 2017
Researchers from the University of Houston have shown for the first time that the use of a brain-computer interface augmented with a virtual walking avatar can control gait, suggesting the protocol may help patients recover ...

Researchers suggest dual gait testing as early predictor of dementia

May 23, 2017
In a new study, researchers at Lawson Health Research Institute and Western University are demonstrating that gait, or motion testing, while simultaneously performing a cognitively demanding task can be an effective predictor ...

Recommended for you

Classifying brain microglia: Which are good and which are bad?

December 6, 2018
Microglia are known to be important to brain function. The immune cells have been found to protect the brain from injury and infection and are critical during brain development, helping circuits wire properly. They also seem ...

Friend or foe? Brain area that controls social memory also triggers aggression

December 5, 2018
Columbia scientists have identified a brain region that helps tell an animal when to attack an intruder and when to accept it into its home. This brain area, called CA2, is part of the hippocampus, a larger brain structure ...

How the brain hears and fears

December 5, 2018
How is it that a sound can send a chill down your spine? By observing individual brain cells of mice, scientists at Cold Spring Harbor Laboratory (CSHL) are understanding how a sound can incite fear.

Adding new channels to the brain remote control

December 5, 2018
By enabling super-fast remote control of specific cells, light-activated proteins allow researchers to study the function of individual neurons within a large network—even an entire brain. Now one of the pioneers of 'optogenetics' ...

Microbial-based treatment reverses autism spectrum social deficits in mouse models

December 4, 2018
An unconventional approach has successfully reversed deficits in social behaviors associated with autism spectrum disorders (ASD) in genetic, environmental and idiopathic mouse models of the condition. Researchers at Baylor ...

'Error neurons' play role in how brain processes mistakes

December 4, 2018
New research from Cedars-Sinai has identified neurons that play a role in how people recognize errors they make, a discovery that may have implications for the treatment of conditions including obsessive-compulsive disorder ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.