'Explorers,' who embrace the uncertainty of choices, use specific part of cortex

February 8, 2012
"Explorers," whose decision-making style embraces the possibilities of uncertainty, use specific parts (red) of the right rostrolateral prefrontal cortex to make calculations based on relative uncertainty. Credit: Badre-Frank Lab/Brown University

Life shrouds most choices in mystery. Some people inch toward a comfortable enough spot and stick close to that rewarding status quo. Out to dinner, they order the usual. Others consider their options systematically or randomly. But many choose to grapple with the uncertainty head on. "Explorers" order the special because they aren't sure they'll like it. It's a strategy of maximizing rewards by discovering whether as yet unexplored options might yield better returns. In a new study, Brown University researchers show that such explorers use a specific part of their brain to calculate the relative uncertainty of their choices, while non-explorers do not.

The study, published in the journal Neuron, newly exposes an aspect of the brain's architecture for producing decisions and learning, said co-author David Badre, assistant professor of cognitive, linguistic, and at Brown. There was no that a precise area of the , in this case the right rostrolateral prefrontal cortex, would be so clearly associated with a specific operation, such as performing the requisite uncertainty comparison for supporting a decision-making strategy.

"There has long been a debate about the functional organization of the ," Badre said. "There has been a notion that the lacks specialization when exercising , that it's undifferentiated. This study provides evidence that there is a kind of organization. This is an example of how higher-order functions such as decision-making may relate to the frontal lobe's more general functional architecture."

Stop the clock

To spot explorer behavior among their 15 participants, Badre and Michael Frank, associate professor of cognitive, linguistic, and psychological sciences, slid them into an MRI scanner and presented them with a game to play. Participants had to stop the sweeping hand of a virtual clock to win points in different rounds. They were told that they could maximize their rewards by responding quickly in some rounds, and slowly in others. The trick is they did not know round-to-round which response prevailed, and the number of points they could win was highly variable. They therefore had to employ a strategy to discover how to maximize their rewards among uncertain options, keeping track of the current expected value of fast and slow responses in each round.

While the tracked the blood flow in the brains of the subjects — a proxy for neural activity — the game's software tracked their in each round. The computer then fed the game's data into mathematical models devised to determine whether participants adapted their response times by taking relative uncertainty into account or adapted in another manner.

Over dozens of rounds a clear pattern emerged. Regardless of which version of the model they used, the researchers found that about half the subjects were engaging in exploratory behavior based on uncertainty: Their choices of response times correlated strongly with the choices that had the greatest outcome uncertainty.

Badre, Frank, and their team then looked at the MRI scans, reasoning that if decision-making is based on relative uncertainty, then the subjects' brains must somehow represent this uncertainty. Sure enough, as relative uncertainty between choice options increased, so did activation in the right rostrolateral prefrontal cortex. This effect was substantially stronger in the explorers than the nonexplorers.

The result is the first to show that this region of the brain keeps track of relative uncertainty to guide exploration, but is consistent with previous studies that have shown an association between the right rostrolateral prefrontal cortex and relative comparisons. It also provides a potential explanation for Frank's previous findings that explorers were more likely to have a variation in a gene called COMT that affects dopamine levels in the prefrontal cortex.

From cortex to choice

Frank said researchers still don't know why some people employ the explorer strategy while others do not, but they might not be so different. According to one hypothesis, they all have an aversion to uncertainty and ambiguity.

"The difference could be that some people are averse to ambiguity in the time point where they make a single decision and other people are averse to ambiguity about their strategy over the long run," Frank said.

In other words, explorers may seek to reduce uncertainty by confronting it, rather than avoiding it.

Badre said that while the study has no direct clinical implications, the findings may still inform efforts to understand a broad set of disorders that affect frontal lobe function.

"There are a lot of diseases and disorders that affect the frontal lobes," Badre said. "They affect the ability to live independently, to carry out the day and make good decisions that get you where you want to go. The more we know about the specificity of these systems, the better that you can diagnose and suggest treatments."

Related Stories

Recommended for you

Team constructs whole-brain map of electrical connections key to forming memories

November 22, 2017
A team of neuroscientists at the University of Pennsylvania has constructed the first whole-brain map of electrical connectivity in the brain based on data from nearly 300 neurosurgical patients with electrodes implanted ...

To forget or to remember? Memory depends on subtle brain signals, scientists find

November 22, 2017
The fragrance of hot pumpkin pie can bring back pleasant memories of holidays past, while the scent of an antiseptic hospital room may cause a shudder. The power of odors to activate memories both pleasing and aversive exists ...

New research suggests high-intensity exercise boosts memory

November 22, 2017
The health advantages of high-intensity exercise are widely known but new research from McMaster University points to another major benefit: better memory.

Pitch imperfect? How the brain decodes pitch may improve cochlear implants

November 22, 2017
Picture yourself with a friend in a crowded restaurant. The din of other diners, the clattering of dishes, the muffled notes of background music, the voice of your friend, not to mention your own – all compete for your ...

What if consciousness is not what drives the human mind?

November 22, 2017
Everyone knows what it feels like to have consciousness: it's that self-evident sense of personal awareness, which gives us a feeling of ownership and control over the thoughts, emotions and experiences that we have every ...

Schizophrenia originates early in pregnancy, 'mini-brain' research suggests

November 20, 2017
Symptoms of schizophrenia usually appear in adolescence or young adulthood, but new research reveals that the brain disease likely begins very early in development, toward the end of the first trimester of pregnancy. The ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

A_Paradox
not rated yet Feb 09, 2012
This stuff is absolutely fascinating! And yes, of course, it is also very frustrating to realise that the researchers, as is so often the case, have found what looks like a strong *correlation* with a form of abstract behaviour. It's not proof of anything, but is a strong hint of future insight into causality.

As I see it, the likelihood of finding genetically caused mapping in the prefrontal cortex depends on the extent to which seemingly abstract features of the world can actually correlate exactly with discrete reactions and behaviours intrinsic to the human animal. "Comparative uncertainty" is abstract is it not? So what feature/s of our animal self can embody and represent uncertainty? My guess is a grouping of fear, anger, curiosity, and self-assertion [this last item used to be called "spirit"].

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.