Darkness sheds light on neural computations

September 8, 2011, University of Cambridge

In order to make sense of its environment, the brain forms and maintains an internal model of the external world. A study published in the journal Science shows that neural activity recorded in darkness, uncovers hallmarks of this internal model, allowing some insight into the computations performed by the visual areas of the brain.

Imagine browsing through a friend's holiday pictures: a trekking path crossing a stream in the Alps, a snapshot of a relaxed afternoon in a Budapest spa, or a punting scene on the Cam. Recognizing the people and objects in the photos seems to be automatic for us. However, as any engineer developing vision algorithms would attest, despite our effortless ability in interpreting images, image understanding is a complex and hard-to-imitate process. A study published in Science by Gergő Orbán and Máté Lengyel from Engineering department at the University of Cambridge, and their colleagues at Brandeis University, offer some clues to the brain machinery underlying our superior visual abilities. Interestingly, they found that the clue to how the brain interprets images is not what happens when we look at pleasant and colorful images, but what happens when we view a pitch-black image.

So what does a black image tell us about our visual system? Naively, without visual stimulation, one would expect very little activity in the visual part of the brain. Surprisingly however, when the activity of neurons in the dark (so-called spontaneous activity) was first analysed, researchers found very strong, coordinated neural responses. This observation has been equally puzzling from a neuroscience and an engineering perspective. Why would the brain waste precious resources to process a dark image? Does the stimulus matter to the brain at all? The answer to these questions turns out to concern the role of the visual system in processing not what there is, but rather what there may be in an image.

To gain some insight as to why this is the case, a closer examination of the photographs reveals several difficult problems that need to be solved for us to correctly interpret the images. In the picture of the punting scene, the punter in the foreground is higher and occupies a larger area than the colleges and bridges in the background, yet we percieve that she is in reality smaller than them. Her friend in the boat is partially hidden by her pole and is thus visually split into two halves, yet we perceive her as a single person. These and countless other examples reveal that our visual system needs to complement the information contained in any image with our internal model of the world, in order to fill-in the missing information and find the interpretations that are most consistent with reality. It is exactly the sophistication of these internal models that sets apart biological and artificial visual systems; our brains develop internal models of the environment whose complexity is unmatched by present-day visual object recognition algorithms.

So what does a black image tell us about our internal model for visual scenes? In their study, Drs. Orbán and Lengyel and their colleagues took inspiration from modern statistical machine vision algorithms and predicted that neural activity in the dark will reflect aspects of this internal model. For example, imagine reducing the brightness of a photograph. As the details begin to fade, the visual system needs to make increasing use of its internal model to make sense of the information it receives. Most of its activity will be dominated by the internal model. The researchers reasoned that if this is the explanation behind spontaneous activity, the patterns of neural activity in the dark should correspond to possible contents of images. These should then be similar to the patterns of neural activity in response to natural images, as opposed to patterns produced by stimuli that are very unlikely to occur in real situations.

The authors of the study analysed neural activity, previously recorded by their American collaborators, in the primary visual cortex of ferrets. These ferrets were of differing ages and were either sitting in , watching movies or watching a sequence of artificial patterns on a computer screen. In the young animals, that had little or no experience of the world, neural activity in darkness was found to be very different from visually stimulated neural activity. However, as the animals became more mature, spontaneous activity became increasingly similar to neural activity recorded in response to visual stimuli. Moreover, spontaneous activity bore a greater similarity to the neural activity recorded in response to the movies than to the artificial stimuli, just as the researchers predicted for an internal model that is adapted to the regularities of the natural visual environment. Thus, the activity of neurons in the dark is carefully orchestrated as the brain considers possible natural scenes that are compatible with the blank, featureless input stimulus.

In conclusion, it seems that understanding the structure of in darkness can indeed help us learn about the powerful internal models of the brain. Learning about internal models may in turn be useful for developing more intelligent computer vision algorithms as well as for healing mental disorders, such as schizophrenia, that are associated with disrupted internal models.

Explore further: Sight requires exact pattern of neural activity to be wired in the womb

More information: "Spontaneous cortical activity reveals hallmarks of optimal internal models of the environment" by Pietro Berkes, Gergő Orbán, Máté Lengyel, and József Fiser, appeared in Science on January 7, 2011. www.sciencemag.org/content/331 … 38-97ff-37789f6c4b6c

Related Stories

Sight requires exact pattern of neural activity to be wired in the womb

June 22, 2011
The precise wiring of our visual system depends upon the pattern of spontaneous activity within the brain that occurs well before birth, a new study by Yale researchers shows.

Recommended for you

Research reveals atomic-level changes in ALS-linked protein

January 18, 2018
For the first time, researchers have described atom-by-atom changes in a family of proteins linked to amyotrophic lateral sclerosis (ALS), a group of brain disorders known as frontotemporal dementia and degenerative diseases ...

Fragile X finding shows normal neurons that interact poorly

January 18, 2018
Neurons in mice afflicted with the genetic defect that causes Fragile X syndrome (FXS) appear similar to those in healthy mice, but these neurons fail to interact normally, resulting in the long-known cognitive impairments, ...

How your brain remembers what you had for dinner last night

January 17, 2018
Confirming earlier computational models, researchers at University of California San Diego and UC San Diego School of Medicine, with colleagues in Arizona and Louisiana, report that episodic memories are encoded in the hippocampus ...

Recording a thought's fleeting trip through the brain

January 17, 2018
University of California, Berkeley neuroscientists have tracked the progress of a thought through the brain, showing clearly how the prefrontal cortex at the front of the brain coordinates activity to help us act in response ...

Midbrain 'start neurons' control whether we walk or run

January 17, 2018
Locomotion comprises the most fundamental movements we perform. It is a complex sequence from initiating the first step, to stopping when we reach our goal. At the same time, locomotion is executed at different speeds to ...

Neuroscientists suggest a model for how we gain volitional control of what we hold in our minds

January 16, 2018
Working memory is a sort of "mental sketchpad" that allows you to accomplish everyday tasks such as calling in your hungry family's takeout order and finding the bathroom you were just told "will be the third door on the ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.