Study shows where brain transforms seeing into acting

July 3, 2018, Massachusetts Institute of Technology
A frame from video of neurons in the PPC, engineered to glow when active, as a mouse sees a visual stimulus and then decides whether to initiate a licking motion. Credit: Sur lab / MIT Picower Institute

You see the flour in the pantry, so you reach for it. You see the traffic light change to green, so you step on the gas. While the link between seeing and then moving in response is simple and essential to everyday existence, neuroscientists haven't been able to get beyond debating where the link is and how it's made. But in a new study in Nature Communications, a team at MIT's Picower Institute for Learning and Memory provides evidence that one crucial brain region called the posterior parietal cortex (PPC) plays an important role in converting vision into action.

"Vision in the service of action begins with the eyes, but then that information has to be transformed into motor commands," said senior author Mriganka Sur, Paul E. and Lilah Newton Professor of Neuroscience in the Department of Brain and Cognitive Sciences. "This is the place where that planning begins."

Sur said the study may help to explain a particular problem in some people who have suffered brain injuries or stroke, called "hemispatial neglect." In such cases, people are not able to act upon or even perceive objects on one side of their visual field. Their eyes and bodies are fine, but the brain just doesn't produce the notion that there is something there to trigger action. Some studies have implicated damage to the PPC in such cases.

In the new study, the research team pinpointed the exact role of the PPC in mice and showed that it contains a mix of attuned to visual processing, decision-making and action.

"This makes the PPC an ideal conduit for flexible mapping of sensory signals onto motor actions," said Gerald Pho, a former graduate student in the Sur lab who is now at Harvard University. Pho is co-lead author with Michael Goard, a former MIT postdoctoral fellow now at UC Santa Barbara.

Mouse see, mouse do

To do the research, the team trained mice on a simple task: if they saw a striped pattern on the screen drift upward, they could lick a nozzle for a liquid reward but if they saw the stripes moving to the side, they should not lick, lest they get a bitter liquid instead. In some cases they would be exposed to the same visual patterns, but the nozzle wouldn't emerge. In this way, the researchers could compare the neurons' responses to the visual pattern with or without the potential for motor action.

As the mice were viewing the visual patterns and making decisions whether to lick, the researchers were recording the activity of hundreds of neurons in each of two regions of their brain: the visual cortex, which processes sight, and the PPC, which receives input from the visual cortex, but also input from many other sensory and motor regions. The cells in each region were engineered to glow more brightly when they became active, giving the scientists a clear indication of exactly when they became engaged by the task.

Visual cortex neurons, as expected, principally lit up when the pattern appeared and moved, though they were split about evenly between responding to one visual pattern or the other.

Neurons in the mouse PPC, engineered to glow when they become active, flicker as the mouse sees a stimulus and decides whether to initiate a licking motion in response. Credit: Sur Lab / MIT Picower Institute

Neurons in the PPC showed more varied responses. Some acted like the visual cortex neurons but most (about 70 percent) were active based on whether the pattern was moving the right way for licking (upward) and only if the nozzle was available. In other words, most PPC neurons were selectively responsive not merely to seeing something, but to the rules of the task and the opportunity to act on the correct visual cue.

"Many neurons in the PPC seemed to be active only during particular combinations of visual input and motor action," Goard said. "This suggests that rather than playing a specified role in sensory or motor processing, they can flexibly link sensory and motor information to help the mouse respond to their environment appropriately."

But even the occasional error was instructive. Consider the case when the nozzle was available and the stripes were moving sideways. In that case, a mouse should not lick even though it could. Visual cortex neurons behaved the same way regardless of the mouse's decision, but PPC neurons were more active just before a mouse licked by mistake, than just before a mouse didn't lick. This suggested that many PPC neurons are oriented toward acting.

Rule reversal

Not yet fully convinced that the PPC encoded the decision to lick based on seeing the correct stripe movement, the researchers switched the rules of the task. Now, the nozzle would drip out the reward upon licking to the sideways stripe pattern and emit the bitter liquid when the stripes moved up. In other words, the mouse still saw the same things, but what they meant for action had reversed.

With the same mice re-trained, the researchers then looked again at the same neurons in the same regions. Visual cortex neurons didn't change their activity at all. Those that followed the upward pattern or sideways still did as before. What the mice were seeing, after all, hadn't changed.

However, the neural responses in PPC changed along with the rules for action. Neurons that had been activated selectively for upward now responded instead to sideways patterns. In other words, learning of the new rules was directly evident in the changed activity of neurons in the PPC. The researchers therefore observed a direct correlate of learning at the cellular level, strongly implicating the PPC as a critical node for where seeing meets acting on that information.

"If you flipped the rules of traffic lights so that red means go, the visual input would still be driven by the colors, but the linkage to motor output neurons would switch, and that happens in the PPC," Sur said.

The findings extend earlier results made by other researchers in primates, the researchers wrote, suggesting that mice bear the needed similarity to aid further studies of the PPC.

"Our understanding of how decisions are computed and visuomotor transformations are made, will be greatly aided by future circuit-level analyses of PPC function in this powerful model system," they concluded.

Explore further: Mice, motor learning, and making decisions

More information: Gerald N. Pho et al, Task-dependent representations of stimulus and choice in mouse parietal cortex, Nature Communications (2018). DOI: 10.1038/s41467-018-05012-y

Related Stories

Mice, motor learning, and making decisions

March 1, 2018
Early understandings of the brain viewed it as a black box that takes sensory input and generates a motor response, with the in-between functioning of the brain as a mystery.

Neuroscientists map brain cell activity that occurs during the delay between sensation and action

September 8, 2016
A UC Santa Barbara researcher studying how the brain uses perception of the environment to guide action has a new understanding of the neural circuits responsible for transforming sensation into movement.

Coupling of movement and vision

June 22, 2017
In a study published in Cell, Georg Keller and his group shed light on neural circuits in the cortex that underlie the integration of movement and visual feedback. They identified a mechanism in the visual cortex responsible ...

What you see is not always what you get

September 19, 2016
Georg Keller and his group at the Friedrich Miescher Institute for Biomedical Research (FMI) have identified neurons in the visual cortex whose activity predicts an upcoming visual stimulus. This activity emerges with experience ...

Deep sleep critical for visual learning

October 4, 2017
Remember those "Magic Eye" posters from the 1990s? You let your eyes relax, and out of the tessellating structures, a 3-D image of a dolphin or a yin yang or a shark would emerge.

Revolutionary brain-mapping technique provides new blueprint for cortical connections

March 28, 2018
Using a revolutionary new brain-mapping technology recently developed at Cold Spring Harbor Laboratory (CSHL), an international team of scientists led by Professor Anthony Zador have made a discovery that will force neuroscientists ...

Recommended for you

Researchers identify pathway that drives sustained pain following injury

December 13, 2018
A toddler puts her hand on a hot stove and swiftly withdraws it. Alas, it's too late—the child's finger has sustained a minor burn. To soothe the pain, she puts the burned finger in her mouth.

Pain: Perception and motor impulses arise in brain independently of one another

December 13, 2018
Pain is a negative sensation that we want to get rid of as soon as possible. In order to protect our bodies, we react by withdrawing the hand from heat, for example. This action is usually understood as the consequence of ...

Researchers discover an immune response associated with the development of idiopathic scoliosis (IS) in zebrafish

December 13, 2018
Idiopathic scoliosis (IS) is a complex genetic disorder that affects approximately 4 per cent of children worldwide, yet its underlying biological cause remains unknown.

New method for studying ALS more effectively

December 13, 2018
The neurodegenerative disease ALS causes motor neuron death and paralysis. However, long before the cells die, they lose contact with muscles as their axons atrophy. Researchers at Karolinska Institutet in Sweden have now ...

Ritalin drives greater connection between brain areas key to memory, attention

December 13, 2018
There's a reason so many children are prescribed methylphenidate, better known by the trade name Ritalin: it helps kids quell attention and hyperactivity problems and sit still enough to focus on a school lesson.

Attention, please! Anticipation of touch takes focus, executive skills

December 12, 2018
Anticipation is often viewed as an emotional experience, an eager wait for something to happen.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

5 / 5 (1) Jul 03, 2018
But, Seeing is Believing ! Can Any HUMAN Do This ?

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.