The motivation to move: Study finds rats calculate 'average' of reward across several tests

April 19, 2013 by Peter Reuell
A research team led by Naoshige Uchida, associate professor of molecular and cellular biology, found that rats averaged how much benefit they received over as many as five trials. When their brains were impaired in one region, however, the rats based their actions solely on the prior trial. “This is a new framework to think about decision-making,” Uchida said. Credit: Jon Chase/Harvard Staff Photographer

Suppose you had $1,000 to invest in the stock market. How would you decide to pick one stock over another? Scientists have made great progress in understanding the neuroscience behind how people choose between similar options.

But what happens when neither choice is right?

During an economic downturn, for instance, your best option might be not to invest at all, but to wait for market conditions to improve.

Using an unusual decision-making study, Harvard researchers exploring the question of found that rats will perform a task faster or slower depending on the size of the benefit they receive, suggesting that they maintain a long-term estimate of whether it's worth it to them to invest energy in a task.

As described in an April 14 paper in Nature Neuroscience, a research team led by Naoshige Uchida, associate professor of , found that rats averaged how much benefit they received over as many as five trials. When their brains were impaired in one region, however, the rats based their actions solely on the prior trial.

"This is a new framework to think about decision-making," Uchida said. "There have been many studies that focused on action selection or choices, but the question of the overall pace or rate of performance has been largely ignored."

To get at those decision-making questions, Uchida and his team designed the experiment.

In each trial, rats were presented with an apparatus that had three holes. Based on whether a sweet or sour odor was delivered through the middle hole, rats went either left or right to receive a water reward. On one side they received a large reward; the other side delivered a smaller reward.

"What we measured was, after getting the reward, how quickly they went back to initiate the next trial," Uchida said.

What researchers found, Uchida said, was surprising. When rats received, on average, a larger reward, they were more likely to quickly initiate the next trial, which suggested that they weren't reacting merely to the prior result, but were "averaging the size of the reward from several previous trials."

"They essentially calculate the average over the previous five or six trials, and adjust their performance accordingly," Uchida said. "They're making a calculation to determine whether they're getting something out of the task or not. If it's worth it for them, they go faster. If not, they go slower."

When researchers impaired part of the striatum, a structure that is part of the basal ganglia and is thought to be involved with associative thinking, in the rats' brains, however, that calculation changed. Rather than considering the average of multiple trials, the rats chose whether to go slower or faster based solely on the prior result.

"They still go faster or slower depending on the size of the reward, but they base that decision only on the size of the they just got," Uchida said. "So the rat becomes very myopic. They only care about what just happened, and they don't take other trials into account."

In addition to shedding new light on how decision-making happens, the study may also offer some hope for people suffering from Parkinson's disease.

"This part of the striatum receives a great deal of inputs from dopamine neurons, so it may be related to Parkinson's disease," Uchida said. "Some people now think Parkinson's may actually be related to the motivation, or 'vigor' to perform some movement. So if we can identify brain regions that are involved in the regulation of general motivation, it's possible that it could be contributing to the symptoms of Parkinson's disease."

Going forward, Uchida said, he hopes to study the role dopamine plays in regulating motivation and decision making, as well as working to understand what role other areas of the striatum might play in the process.

"There are some interesting similarities between this part of the striatum in and in humans," he said. "One is that this area receives very heavy inputs from the prefrontal cortex. That's an area that may be important in integrating information over a longer period of time. Deconstructing this process is a critical step to understanding our behavior, and this could go a long way toward that."

Explore further: Study shows how neurons interact, could lead to new treatment for addiction

Related Stories

Study shows how neurons interact, could lead to new treatment for addiction

January 18, 2012
Harvard scientists have developed the fullest picture yet of how neurons in the brain interact to reinforce behaviors ranging from learning to drug use, a finding that might open the door to possible breakthroughs in the ...

Using rabies virus, researcher tracks inputs to dopamine neurons

June 6, 2012
A genetically-modified version of the rabies virus is helping scientists at Harvard to trace neural pathways in the brain, a research effort that could one day lead to treatments for Parkinson's disease and addiction.

Feeding hormone ghrelin modulates ability of rewarding food to evoke dopamine release

July 12, 2011
New research findings to be presented at the upcoming annual meeting of the Society for the Study of Ingestive Behavior (SSIB), the foremost society for research into all aspects of eating and drinking behavior, finds that ...

Recommended for you

The neural codes for body movements

July 21, 2017
A small patch of neurons in the brain can encode the movements of many body parts, according to researchers in the laboratory of Caltech's Richard Andersen, James G. Boswell Professor of Neuroscience, Tianqiao and Chrissy ...

Faulty support cells disrupt communication in brains of people with schizophrenia

July 20, 2017
New research has identified the culprit behind the wiring problems in the brains of people with schizophrenia. When researchers transplanted human brain cells generated from individuals diagnosed with childhood-onset schizophrenia ...

Scientists reveal how patterns of brain activity direct specific body movements

July 20, 2017
New research by Columbia scientists offers fresh insight into how the brain tells the body to move, from simple behaviors like walking, to trained movements that may take years to master. The discovery in mice advances knowledge ...

Scientists discover combined sensory map for heat, humidity in fly brain

July 20, 2017
Northwestern University neuroscientists now can visualize how fruit flies sense and process humidity and temperature together through a "sensory map" within their brains, according to new research.

Team traces masculinization in mice to estrogen receptor in inhibitory neurons

July 20, 2017
Researchers at Cold Spring Harbor Laboratory (CSHL) have opened a black box in the brain whose contents explain one of the remarkable yet mysterious facts of life.

Speech language therapy delivered through the Internet leads to similar improvements as in-person treatment

July 20, 2017
Telerehabilitation helps healthcare professionals reach more patients in need, but some worry it doesn't offer the same quality of care as in-person treatment. This isn't the case, according to recent research by Baycrest.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.