Retraining the brain's vision center to take action

March 1, 2018, University of California - Berkeley
Areas of the brain that get input from the eyes can be hijacked to control something outside the brain, such as a computer-generated tone. Yellow arrows represent feedback between the rat's visual cortex and striatum, which is key to learning such new skills. Ryan Neely image. Credit: Ryan Neely

Neuroscientists have demonstrated the astounding flexibility of the brain by training neurons that normally process input from the eyes to develop new skills, in this case, to control a computer-generated tone.

The researchers from the University of California, Berkeley, and Columbia University could just as easily have wired these , located in the , to operate a robotic arm or any other -machine interface, co-opting to do the work of .

"We arbitrarily hijacked small groups of neurons in the visual cortex and virtually re-routed their output to make them control a brain-machine interface, or BMI," said Jose Carmena, senior author of a paper about the development that will appear March 1 in the journal Neuron. "To gain a reward, the rats learned to produce arbitrary patterns of neural activity unrelated to visual input in order to control a BMI, highlighting the power of neuroplasticity and the flexibility of the brain."

Carmena and co-first author Ryan Neely also found that the connections from the cortex to the underlying striatum were key to this learning, representing a feedback loop that may be the building block for learning and memory throughout the brain.

"These findings suggest that the striatum has a broader role in shaping cortical activity based on ongoing experience and behavioral outcomes than previously acknowledged, and have wide implications for the neuroscience of thought and action and brain-machine interfaces," said Carmena, who is a professor in UC Berkeley's Department of Electrical Engineering and Computer Sciences and the Helen Wills Neuroscience Institute.

Are there limits to brain's plasticity?

The plasticity of the brain is well known; people with damage to one area of the brain can retrain neighboring areas to take over the lost function. Carmena, who studies how the brain learns new skills and controls movement, including the control of objects outside the body, such as prosthetic limbs, has seen how easily the brain learns to control BMIs.

"When I first came to Berkeley," he said, "my students and postdocs saw this plastic organization occurring in all the motor areas we have been using for BMI, and they asked: Which are the best areas to control BMI? What is the limit of this plasticity? Is there any area that will not work?"

He and Neely, who completed his Ph.D. with Carmena in 2017, tested these limits by trying to train visual neurons, which normally interpret input from the eyes but don't control any physical action, to act like motor neurons that control muscles.

Neely implanted 16 electrodes into the visual cortex (V1) of 12 rats. He arbitrarily routed the electrical activity recorded by the electrodes - representing the spiking of several - to a device that raised or lowered the pitch of an audible tone depending on which neurons were active.

The rats were then trained over several sessions to raise or lower the pitch, only one of which would reward them with a sweet drink. All rats learned to produce spike activity in the correct set of neurons, while silencing other neurons, in order to obtain the reward. They were successful in the dark - which the researchers thought would minimize interference from light shining in the rats' eyes - but also performed equally well with the lights on. Electrodes in the dorsomedial striatum, part of the basal ganglia, recorded changes consistent with learning in the visual cortex.

Co-first author Aaron Koralek and the paper's other senior author, Rui Costa, a neuroscientist previously at the Champalimaud Centre for the Unknown in Lisbon, Portugal, and now at Columbia University's Mortimer B. Zuckerman Mind Brain Behavior Institute, conducted similar experiments on mice, but also inserted optogenetic switches into cells of the dorsomedial striatum so that they could be turned off with the flash of a laser threaded into the brain. They employed a relatively recent optogenetic tool called Jaws, developed at the Massachusetts Institute of Technology four years ago, to silence the striatal neurons.

"These experiments further demonstrated that the striatum helps the organism learn to control patterns of activity in other areas of the brain, even if those patterns of activity are located in in primary sensory area, such as the visual cortex," said Costa. "These findings suggest that the striatum may be important for regulating an organism's ability for actively sensing, or perception."

These mice also learned to control the frequency of the tone, but were unable to do so when the cells of the striatum were turned off. In 2012, Carmena, Costa and colleagues were the first to show that in the motor area of the brain, neurons could not learn a virtual task without plasticity in the connections to cells in the striatum.

"When these cells were inactivated, the animal would not be able to learn, which suggests that what we observed six years ago in motor areas with respect to the striatum seems to be common, like a building block for learning in the brain," Carmena said.

Whole-cortex BMIs

Carmena suspects that another area of the brain is also part of the learning loop involving the cortex and striatum to provide feedback from the striatum to the cortex, since the feedback exists but no striatal cells connect directly back to the visual cortex. Ongoing studies are designed to locate the other areas that are part of these processes, and shed light on how the brain is able to retrain just a handful of cells in the cortex out of millions to operate an object outside the body.

"The data seem to raise the hypothesis that these networks, which have been studied mostly in the context of motor reinforcement, and can involve other brain areas like the thalamus and the midbrain, have evolved to control a wide variety of processes in the brain," said Costa.

"There are companies now, such as Neuralink started by Elon Musk and Kernel started by Bryan Johnson, which are working to create a whole-cortex interface in humans for future brain-machine direct communication" said Neely, who now works at iota Biosciences, a startup co-founded by Carmena and Berkeley colleague Michel Maharbiz. "An important question for this quest is to identify the supporting circuits that facilitate learning abstract skills, like communicating directly with machines. Our studies suggest that the cortex and the striatum are key elements of such a circuit."

To Carmena, all regions of the cortex produce some "action," whether that action is to interpret - as cells in the visual cortex interpret input from the eyes - or trigger a physical response, as do neurons in the motor cortex. From that perspective, the current study supports the idea that the circuit loop between the cortex and is the same throughout the brain and capable of the same type of learning no matter what function it currently has.

"This study demonstrates the flexibility of the central nervous system and the brain for being able to connect something very arbitrary and abstract for an animal - something they don't do in their ecological niche, such as tune a tone to a high pitch to get a reward - to neurons in the cortex," Carmena said. "You can leverage all these built-in mechanisms for learning to learn these new modalities and change the visual or into a BMI . The brain isn't saying, 'Hey, what is this?' The circuit is talking to them and they work."

Explore further: Mice, motor learning, and making decisions

More information: Ryan M. Neely et al, Volitional Modulation of Primary Visual Cortex Activity Requires the Basal Ganglia, Neuron (2018). DOI: 10.1016/j.neuron.2018.01.051

Related Stories

Mice, motor learning, and making decisions

March 1, 2018
Early understandings of the brain viewed it as a black box that takes sensory input and generates a motor response, with the in-between functioning of the brain as a mystery.

Deep sleep critical for visual learning

October 4, 2017
Remember those "Magic Eye" posters from the 1990s? You let your eyes relax, and out of the tessellating structures, a 3-D image of a dolphin or a yin yang or a shark would emerge.

From brouhaha to coordination: Motor learning from the neuron's point of view

February 9, 2017
When starting to learn to play the piano, there is much hesitation and hitting the wrong keys. But with training, the movements of the player become more fluid and accurate. This motor improvement begins in the brain, but ...

Recording a thought's fleeting trip through the brain

January 17, 2018
University of California, Berkeley neuroscientists have tracked the progress of a thought through the brain, showing clearly how the prefrontal cortex at the front of the brain coordinates activity to help us act in response ...

Electrical stimulation in brain bypasses senses, instructs movement

December 7, 2017
The brain's complex network of neurons enables us to interpret and effortlessly navigate and interact with the world around us. But when these links are damaged due to injury or stroke, critical tasks like perception and ...

Research shows brain more flexible, trainable than previously thought

March 4, 2012
Opening the door to the development of thought-controlled prosthetic devices to help people with spinal cord injuries, amputations and other impairments, neuroscientists at the University of California, Berkeley, and the ...

Recommended for you

Brain wave device enhances memory function

October 22, 2018
The entrainment of theta brain waves with a commercially available device not only enhances theta wave activity, but also boosts memory performance. That's according to new research from the Center for Neuroscience at the ...

Researchers uncover new target of alcohol in the brain

October 22, 2018
When alcohol enters the brain, it causes neurons in a specialized region called the ventral tegmental area, or VTA—also known as the "pleasure center"—to release dopamine, a neurotransmitter that produces those feel-good ...

Would you zap your brain to improve your memory?

October 22, 2018
Using a few wires and sponges, in ordinary homes around the world, people are trying to hack their own minds. Thanks to a 2002 study that found a link between brain transcranial direct current stimulation and better motor ...

Study gives new insight into how our brain perceives places

October 22, 2018
Nearly 30 years ago, scientists demonstrated that visually recognizing an object, such as a cup, and performing a visually guided action, such as picking the cup up, involved distinct neural processes, located in different ...

A topical gel that can prevent nerve damage due to spraying crops with pesticides

October 22, 2018
A team of researchers affiliated with several institutions in India has developed a topical get that can be used by farmers to prevent nerve damage due to chemical crop spraying. In their paper published in the journal Science ...

First impressions count, new speech research confirms

October 22, 2018
Human beings make similar judgements of the trustworthiness and dominance of an unfamiliar speaker after hearing just a single word, new research shows, suggesting the old saying that 'first impressions count' might well ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.