How does the brain make perceptual predictions over time?

February 6, 2017
Credit: Wikimedia Commons

Prediction is crucial for brain function—without forecasting, our actions would always be too late because of the delay in neural processing. However, there has been limited theoretical work explaining how our brains perform perceptual predictions over time.

In the latest issue of Proceedings of the National Academy of Sciences (PNAS), New York University neuroscientist David Heeger offers a new framework to explain how the makes predictions. He outlines how "" may be a general principle of cortical function—along with the already-established role of inference.

"It has long been recognized that the brain performs a kind of inference, combining sensory information with expectations," explains Heeger, a professor in NYU's Center for Neural Science. "Those expectations can come from the current context, from memory recall, or as an ongoing prediction over time. This new theory puts all of this together and formalizes it mathematically."

Largely missing from our understanding of brain function had been models akin to those routinely employed by meteorologists. In making their predictions, forecasters rely on past weather information to project climate conditions over the next several days.

"Similarly, the in our brains embody a type of model of our surroundings," Heeger observes. "However, we don't have a clear understanding of how they operate to make predictions."

Existing theories of and neural networks used in artificial intelligence use a hierarchical structure: sensory input comes in at one end and progressively more abstract representations are computed along the hierarchy.

But this "feedforward"/pipeline processing architecture, Heeger argues, does not account for the brain's predictive capabilities because, unlike weather models, it does not explain how it loops in earlier information—a dynamic Heeger's theory includes.

"It's possible to run this process the other way around—to take an abstract representation at the top of the hierarchy and run it backwards, from top to bottom through the neural net, to generate something like a sensory prediction or expectation," he explains.

Overall, Heeger's theory blends inference with prediction. The brain's neural network can process in a feedforward manner—from sensory input to an abstract representation—akin to typical AI neural networks. Heeger's theory can instead run in a feedback mode—to generate a sensory prediction from an abstract representation (i.e., a kind of or mental imagery). Or it can run in a mode that is a combination of the two, in which inferences mix sensory input with prediction.

The theory also posits a role for noise or variability in neural activity to explore different possible interpretations, even when the and prediction are the same.

"This noise-driven process of exploration may be the neural basis of creativity," he speculates.

Heeger hypothesizes that neuromodulators like acetylcholineine change the brain state to control which mode—purely feedforward, purely feedback, or a combination—is operating at each moment in time. The amount of noise, which determines the amount of exploration, is controlled by other neuromodulators like noradrenaline and by oscillations in brain activity, he suggests.

The theory, which uses the model embedded in the neural network to predict and explore over time, offers promise in both the fields of neuroscience research and AI.

One of these areas is the assessment of the factors that explain autism. There is no special genetic mechanism that causes autism (so-called "autism genes" account for only a small percentage of cases). Rather, individuals with autism have a neurocomputational deficit—the brain's processing doesn't function properly. By understanding more fully how the brain effectively computes, Heeger says, we can potentially shed light on exactly what the neurocomputational differences are. Likewise for other developmental disorders and psychiatric illnesses.

In addition, while AI seeks to replicate human decision-making and processing, it cannot fully capture these phenomena if it's exclusively drawing from a "feedforward" architecture, ignoring prediction and exploration.

"The theory of neural function that I'm outlining aims to fill in some of the significant dynamics that AI is missing," Heeger says.

Explore further: Premature babies don't use sensory-prediction brain process that may be key to development

More information: Theory of cortical function, PNAS, www.pnas.org/cgi/doi/10.1073/pnas.1619788114

Related Stories

Premature babies don't use sensory-prediction brain process that may be key to development

January 26, 2017
Babies born prematurely don't use their expectations about the world to shape their brains as babies born at full term do, important evidence that this neural process is important to development.

How the brain deals with limited sensory input

September 20, 2016
Suppose you woke up in your bedroom with the lights off and wanted to get out. While heading toward the door with your arms out, you would predict the distance to the door based on your memory of your bedroom and the steps ...

Balancing time and space in the brain: New model holds promise for predicting brain dynamics

October 31, 2016
For as long as scientists have been listening in on the activity of the brain, they have been trying to understand the source of its noisy, apparently random, activity. In the past 20 years, "balanced network theory" has ...

Researchers link neural variability to short-term memory and decision making

April 2, 2012
A team of University of Pittsburgh mathematicians is using computational models to better understand how the structure of neural variability relates to such functions as short-term memory and decision making. In a paper published ...

The power of expectation can restrain hyper-emotional memories in the brain

November 14, 2016
The creaking of an opening gate followed by a dog attack can disturb otherwise pleasant evening walks. The sound of that gate opening on subsequent walks will elicit an emotional response, and the power of this response will ...

Recommended for you

Researchers find monkey brain structure that decides if viewed objects are new or unidentified

August 18, 2017
A team of researchers working at the University of Tokyo School of Medicine has found what they believe is the part of the monkey brain that decides if something that is being viewed is recognizable. In their paper published ...

Artificial neural networks decode brain activity during performed and imagined movements

August 18, 2017
Artificial intelligence has far outpaced human intelligence in certain tasks. Several groups from the Freiburg excellence cluster BrainLinks-BrainTools led by neuroscientist private lecturer Dr. Tonio Ball are showing how ...

Study of nervous system cells can help to understand degenerative diseases

August 18, 2017
The results of a new study show that many of the genes expressed by microglia differ between humans and mice, which are frequently used as animal models in research on Alzheimer's disease and other neurodegenerative disorders.

How whip-like cell appendages promote bodily fluid flow

August 18, 2017
Researchers at Nagoya University have identified a molecule that enables cell appendages called cilia to beat in a coordinated way to drive the flow of fluid around the brain; this prevents the accumulation of this fluid, ...

Researchers make surprising discovery about how neurons talk to each other

August 17, 2017
Researchers at the University of Pittsburgh have uncovered the mechanism by which neurons keep up with the demands of repeatedly sending signals to other neurons. The new findings, made in fruit flies and mice, challenge ...

Neurons involved in learning, memory preservation less stable, more flexible than once thought

August 17, 2017
The human brain has a region of cells responsible for linking sensory cues to actions and behaviors and cataloging the link as a memory. Cells that form these links have been deemed highly stable and fixed.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.