Past experiences shape what we see more than what we are looking at now

July 31, 2018, NYU Langone Health
Past experiences shape what we see more than what we are looking at now
Study subjects viewed pairs of blurred and clear images in a certain order, forcing their brains to use past experiences to recognize newly seen images, and letting researchers track the brain activity patterns underlying visual perception. Credit: NYU School of Medicine

A rope coiled on dusty trail may trigger a frightened jump by hiker who recently stepped on a snake. Now a new study better explains how a one-time visual experience can shape perceptions afterward.

Led by neuroscientists from NYU School of Medicine and published online July 31 in eLife, the study argues that humans recognize what they are looking at by combining current sensory stimuli with comparisons to stored in memory.

"Our findings provide important new details about how experience alters the content-specific activity in regions not previously linked to the representation of images by nerve cell networks," says senior study author Biyu He, Ph.D., assistant professor in the departments of Neurology, Radiology, and Neuroscience and Physiology.

"The work also supports the theory that what we recognize is influenced more by past experiences than by newly arriving sensory input from the eyes," says He, part of the Neuroscience Institute at NYU Langone Health.

She says this idea becomes more important as evidence mounts that hallucinations suffered by patients with post-traumatic stress disorder or schizophrenia occur when stored representations of past images overwhelm what they are looking at presently.

Glimpse of a Tiger

A key question in neurology is about how the brain perceives, for instance, that a tiger is nearby based on a glimpse of orange amid the jungle leaves. If the brains of our ancestors matched this incomplete picture with previous danger, they would be more likely to hide, survive and have descendants. Thus, the modern brain finishes perception puzzles without all the pieces.

Most past vision research, however, has been based on experiments wherein clear images were shown to subjects in perfect lighting, says He. The current study instead analyzed visual perception as subjects looked at black-and-white images degraded until they were difficult to recognize. Nineteen subjects were shown 33 such obscured "Mooney images—17 of animals and 16 manmade objects—in a particular order. They viewed each obscured image six times, then a corresponding clear version once to achieve recognition, and then blurred images again six times after. Following the presentation of each blurred image, subjects were asked if they could name the object shown.

As the subjects sought to recognize images, the researchers "took pictures" of their brains every two seconds using functional (fMRI). The technology lights up with increased blood flow, which is known to happen as brain cells are turned on during a specific task. The team's 7 Tesla scanner offered a more than three-fold improvement in resolution over past studies using standard 3 Tesla scanners, for extremely precise fMRI-based measurement of vision-related nerve circuit .

After seeing the clear version of each image, the study subjects were more than twice as likely to recognize what they were looking at when again shown the obscured version as they were of recognizing it before seeing the clear version. They had been "forced" to use a stored representation of clear images, called priors, to better recognize related, blurred versions, says He.

The authors then used mathematical tricks to create a 2-D map that measured, not nerve cell activity in each tiny section of the brain as it perceived images, but instead of how similar nerve activity patterns were in different brain regions. Nerve cell networks in the brain that represented images more similarly landed closer to each other on the map.

This approach revealed the existence of a stable system of brain organization that processed each image in the same steps, and regardless of whether clear or blurry, the authors say. Early, simpler brain circuits in the visual cortex that determine edge, shape, and color clustered on one end of the map, and more complex, "higher-order" circuits known to mix past and present information to plan actions at the opposite end.

These higher-order circuits included two brain networks, the default-mode network (DMN) and frontoparietal network (FPN), both linked by past studies to executing complex tasks such as planning actions, but not to visual, perceptual processing. Rather than remaining stable in the face of all images, the similarity patterns in these two networks shifted as brains went from processing unrecognized blurry images to effortlessly recognizing the same images after seeing a clear version. After previously seeing a clear version (disambiguation), neural activity patterns corresponding to each blurred image in the two networks became more distinct from the others, and more like the clear in each case.

Strikingly, the clear image-induced shift of neural representation towards perceptual prior was much more pronounced in with higher, more complex functions than in the early, simple visual processing networks. This further suggests that more of the information shaping current perceptions comes from what people have experienced before.

Explore further: Neuro filter sharpens visual processing

Related Stories

Neuro filter sharpens visual processing

May 7, 2018
Blurry and clear versions of an image are represented similarly in the brain, according to a neuroimaging study published in eNeuro. The research shows how the visual system fills in missing information to maintain perception ...

Research identifies key weakness in modern computer vision systems

July 30, 2018
Computer vision algorithms have come a long way in the past decade. They've been shown to be as good or better than people at tasks like categorizing dog or cat breeds, and they have the remarkable ability to identify specific ...

Brain arousal compound noradrenaline plays critical role in sensory perception

July 10, 2018
Being aware of our surroundings is a fundamental aspect of our existence. But what in our biological makeup determines how we access and interpret the endless stream of information around us?

Why the world looks stable while we move

March 12, 2018
Head movements change the environmental image received by the eyes. People still perceive the world as stable, because the brain corrects for any changes in visual information caused by head movements. For the first time, ...

Researchers in Japan are showing way to decode thoughts

January 15, 2018
Making news this month is a study by researchers the Advanced Telecommunications Research Institute International (ATR) and Kyoto University in Japan, having built a neural network that not only reads but re-creates what ...

Recommended for you

Wiring diagram of the brain provides a clearer picture of brain scan data

December 14, 2018
Already affecting more than five million Americans older than 65, Alzheimer's disease is on the rise and expected to impact more than 13 million people by 2050. Over the last three decades, researchers have relied on neuroimaging—brain ...

Scientists identify method to study resilience to pain

December 14, 2018
Scientists at the Yale School of Medicine and Veterans Affairs Connecticut Healthcare System have successfully demonstrated that it is possible to pinpoint genes that contribute to inter-individual differences in pain.

Parents' brain activity 'echoes' their infant's brain activity when they play together

December 13, 2018
When infants are playing with objects, their early attempts to pay attention to things are accompanied by bursts of high-frequency activity in their brain. But what happens when parents play together with them? New research, ...

In the developing brain, scientists find roots of neuropsychiatric diseases

December 13, 2018
The most comprehensive genomic analysis of the human brain ever undertaken has revealed new insights into the changes it undergoes through development, how it varies among individuals, and the roots of neuropsychiatric illnesses ...

Researchers find the cause of and cure for brain injury associated with gut condition

December 13, 2018
Using a mouse model of necrotizing enterocolitis (NEC)—a potentially fatal condition that causes a premature infant's gut to suddenly die—researchers at Johns Hopkins say they have uncovered the molecular causes of the ...

Researchers discover abundant source for neuronal cells

December 13, 2018
USC researchers seeking a way to study genetic activity associated with psychiatric disorders have discovered an abundant source of human cells—the nose.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.