Brain-machine interface study suggests how brains prepare for action

February 16, 2018 by Nathan Collins, Stanford University
Credit: CC0 Public Domain

Somewhere right now in Pyeongchang, South Korea, an Olympic skier is thinking through the twists and spins she'll make in the aerial competition, a speed skater is visualizing how he'll sneak past a competitor on the inside line, and a curler is imagining the perfect sweep.

It's called mental rehearsal, and psychologists and athletes alike know that it works: picturing ourselves going through routines, whether it's figure skating or something more mundane, improves our chances of success. Now, neuroscientists report Feb. 15 in Neuron, they've learned how the brain learns physical tasks, even in the absence of real-world movement, and found that it could hinge on getting the mind to the right starting place, ready to perfectly execute everything that follows.

"Mental rehearsal is tantalizing, but difficult to study," said Saurabh Vyas, a graduate student in bioengineering and the paper's lead author. That's because there's no easy way to peer into a person's brain as he imagines himself racing to a win or practicing a performance. "This is where we thought brain-machine interfaces could be that lens, because they give you the ability to see what the brain is doing even when they're not actually moving," he said.

Although there are some important caveats, the results could point the way toward a deeper understanding of what mental rehearsal is and, the researchers believe, to a future where brain-machine interfaces, usually thought of as prosthetics for people with paralysis, are also tools for understanding the brain, said Krishna Shenoy, the Hong Seh and Vivian W. M. Lim Professor in the School of Engineering, a member of Stanford Bio-X and the Stanford Neurosciences Institute and the study's senior author.

What are you thinking?

The idea for the study came while thinking about how people learn to use brain-machine interfaces to perform a task, Vyas said. In a typical setup, a person – or, very often, a monkey – has to learn to move a cursor around a computer screen using only patterns of activity in the brain, not hand or other movements. That got Vyas wondering whether what people (or monkeys) learned using brain-machine interfaces might somehow transfer, in a way similar to mental rehearsal, to physical movements.

"He's just sitting there thinking, and as he's thinking he's getting better and better" at moving the cursor, Vyas said, referring to one of the monkeys he studied. "The natural question becomes: What happens if you switch to another context, where now he actually has to generate muscle activity? Do you see the effects of that learning in that new context?"

The short answer is yes, mental learning does transfer to physical performance. Vyas initially taught two monkeys outfitted with brain-machine interfaces to move a cursor from one place to another on a computer screen using only their minds, then introduced a complication, called a visuomotor rotation: what mental signals they previously used to move a cursor up would now move it at an angle, say 45 degrees clockwise. The monkeys easily adapted, and that adaptation carried over when they repeated the same task using their hands, rather than the brain-machine interface, to control the cursor directly. Now, if the monkeys wanted to move the cursor up, they moved their hands 45 degrees clockwise.

This suggested that the monkeys were doing something like mental rehearsal, Vyas said – what they had learned to do in their minds, they could then do with their hands. Some additional experiments and an analysis of recorded neural activity suggest the reason why: rehearsing the task with a brain-machine interface got patterns of activity in the monkeys' brains into just the right spot, so they could carry out the same rotation task with their hands, even though they had never done so before.

A new way to probe the mind

"There are key differences between our paradigm and true mental rehearsal," Vyas said, and there are reasons to be cautious about interpreting the results too broadly. For one thing, one can't just ask a monkey to imagine skiing down a mountain slope, as one could with a person. For another, mentally rehearsing a task is not the same as using a brain-machine interface to do it. In the latter case, people get feedback on how they're doing, something they can only imagine in mental rehearsal.

"We can't prove the connection beyond a shadow of a doubt," Shenoy said, but "this is a major step in understanding what mental rehearsal may well be in all of us." The next steps, he and Vyas said, are to figure out how mental rehearsal relates to practice with a brain-machine interface – and how mental preparation, the key ingredient in transferring that practice to physical movements, relates to movement.

Meanwhile, Shenoy said, the results demonstrate the potential of an entirely new tool for studying the mind. "It's like building a new tool and using it for something," Shenoy said. "We used a to probe and advance basic science, and that's just super-exciting."

Explore further: Potential brain-machine interface for hand paralysis

Related Stories

Potential brain-machine interface for hand paralysis

January 15, 2018
A brain-machine interface that combines brain stimulation with a robotic device controlling hand movement increases the output of pathways connecting the brain and spinal cord, according to a study of healthy adults published ...

Adding movement to 'dry run' mental imagery enhances performance

February 19, 2013
Adding movement to mental rehearsal can improve performance finds a study in BioMed Central's open access journal Behavioral and Brain Functions. For high jumpers the study shows that dynamic imagery improves the number of ...

Decoding syllables to show the limits of artificial intelligence

January 31, 2018
For the last decade, researchers have been using machine learning to decode human brain activity. Applied to neuroimaging data, these algorithms can reconstitute what we see, hear, and even what we think. For example, they ...

Cognitive-related neural pattern to activate machines

June 14, 2017
Brain-machine interfaces represent a solution for people with physical difficulties to communicate with their physical and social environment. In this work, researchers have identified a functional brain pattern in the prefrontal ...

Conclusions on brain-machine interfaces for communication and rehabilitation

October 5, 2016
In the journal Nature Reviews Neurology, the researcher Ander Ramos of Tecnalia, with Niel Birbaumer, lecturer at the University of Tübingen, have expounded how brain-machine interfaces (BMI) use brain activity to control ...

Recommended for you

Wiring diagram of the brain provides a clearer picture of brain scan data

December 14, 2018
Already affecting more than five million Americans older than 65, Alzheimer's disease is on the rise and expected to impact more than 13 million people by 2050. Over the last three decades, researchers have relied on neuroimaging—brain ...

Scientists identify method to study resilience to pain

December 14, 2018
Scientists at the Yale School of Medicine and Veterans Affairs Connecticut Healthcare System have successfully demonstrated that it is possible to pinpoint genes that contribute to inter-individual differences in pain.

Parents' brain activity 'echoes' their infant's brain activity when they play together

December 13, 2018
When infants are playing with objects, their early attempts to pay attention to things are accompanied by bursts of high-frequency activity in their brain. But what happens when parents play together with them? New research, ...

In the developing brain, scientists find roots of neuropsychiatric diseases

December 13, 2018
The most comprehensive genomic analysis of the human brain ever undertaken has revealed new insights into the changes it undergoes through development, how it varies among individuals, and the roots of neuropsychiatric illnesses ...

Researchers discover abundant source for neuronal cells

December 13, 2018
USC researchers seeking a way to study genetic activity associated with psychiatric disorders have discovered an abundant source of human cells—the nose.

Researchers find the cause of and cure for brain injury associated with gut condition

December 13, 2018
Using a mouse model of necrotizing enterocolitis (NEC)—a potentially fatal condition that causes a premature infant's gut to suddenly die—researchers at Johns Hopkins say they have uncovered the molecular causes of the ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Feb 16, 2018
Note that this mental rehearsal mechanism is one of the basic motivations behind the consumption of pornography.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.