Darkness sheds light on neural computations

September 8, 2011

In order to make sense of its environment, the brain forms and maintains an internal model of the external world. A study published in the journal Science shows that neural activity recorded in darkness, uncovers hallmarks of this internal model, allowing some insight into the computations performed by the visual areas of the brain.

Imagine browsing through a friend's holiday pictures: a trekking path crossing a stream in the Alps, a snapshot of a relaxed afternoon in a Budapest spa, or a punting scene on the Cam. Recognizing the people and objects in the photos seems to be automatic for us. However, as any engineer developing vision algorithms would attest, despite our effortless ability in interpreting images, image understanding is a complex and hard-to-imitate process. A study published in Science by Gergő Orbán and Máté Lengyel from Engineering department at the University of Cambridge, and their colleagues at Brandeis University, offer some clues to the brain machinery underlying our superior visual abilities. Interestingly, they found that the clue to how the brain interprets images is not what happens when we look at pleasant and colorful images, but what happens when we view a pitch-black image.

So what does a black image tell us about our visual system? Naively, without visual stimulation, one would expect very little activity in the visual part of the brain. Surprisingly however, when the activity of neurons in the dark (so-called spontaneous activity) was first analysed, researchers found very strong, coordinated neural responses. This observation has been equally puzzling from a neuroscience and an engineering perspective. Why would the brain waste precious resources to process a dark image? Does the stimulus matter to the brain at all? The answer to these questions turns out to concern the role of the visual system in processing not what there is, but rather what there may be in an image.

To gain some insight as to why this is the case, a closer examination of the photographs reveals several difficult problems that need to be solved for us to correctly interpret the images. In the picture of the punting scene, the punter in the foreground is higher and occupies a larger area than the colleges and bridges in the background, yet we percieve that she is in reality smaller than them. Her friend in the boat is partially hidden by her pole and is thus visually split into two halves, yet we perceive her as a single person. These and countless other examples reveal that our visual system needs to complement the information contained in any image with our internal model of the world, in order to fill-in the missing information and find the interpretations that are most consistent with reality. It is exactly the sophistication of these internal models that sets apart biological and artificial visual systems; our brains develop internal models of the environment whose complexity is unmatched by present-day visual object recognition algorithms.

So what does a black image tell us about our internal model for visual scenes? In their study, Drs. Orbán and Lengyel and their colleagues took inspiration from modern statistical machine vision algorithms and predicted that neural activity in the dark will reflect aspects of this internal model. For example, imagine reducing the brightness of a photograph. As the details begin to fade, the visual system needs to make increasing use of its internal model to make sense of the information it receives. Most of its activity will be dominated by the internal model. The researchers reasoned that if this is the explanation behind spontaneous activity, the patterns of neural activity in the dark should correspond to possible contents of images. These should then be similar to the patterns of neural activity in response to natural images, as opposed to patterns produced by stimuli that are very unlikely to occur in real situations.

The authors of the study analysed neural activity, previously recorded by their American collaborators, in the primary visual cortex of ferrets. These ferrets were of differing ages and were either sitting in , watching movies or watching a sequence of artificial patterns on a computer screen. In the young animals, that had little or no experience of the world, neural activity in darkness was found to be very different from visually stimulated neural activity. However, as the animals became more mature, spontaneous activity became increasingly similar to neural activity recorded in response to visual stimuli. Moreover, spontaneous activity bore a greater similarity to the neural activity recorded in response to the movies than to the artificial stimuli, just as the researchers predicted for an internal model that is adapted to the regularities of the natural visual environment. Thus, the activity of neurons in the dark is carefully orchestrated as the brain considers possible natural scenes that are compatible with the blank, featureless input stimulus.

In conclusion, it seems that understanding the structure of in darkness can indeed help us learn about the powerful internal models of the brain. Learning about internal models may in turn be useful for developing more intelligent computer vision algorithms as well as for healing mental disorders, such as schizophrenia, that are associated with disrupted internal models.

Explore further: Sight requires exact pattern of neural activity to be wired in the womb

More information: "Spontaneous cortical activity reveals hallmarks of optimal internal models of the environment" by Pietro Berkes, Gergő Orbán, Máté Lengyel, and József Fiser, appeared in Science on January 7, 2011. www.sciencemag.org/content/331/6013/83.full?sid=c9bae9bf-573f-4138-97ff-37789f6c4b6c

Related Stories

Recommended for you

New insights on how cocaine changes the brain

November 25, 2015

The burst of energy and hyperactivity that comes with a cocaine high is a rather accurate reflection of what's going on in the brain of its users, finds a study published November 25 in Cell Reports. Through experiments conducted ...

Can physical exercise enhance long-term memory?

November 25, 2015

Exercise can enhance the development of new brain cells in the adult brain, a process called adult neurogenesis. These newborn brain cells play an important role in learning and memory. A new study has determined that mice ...

Umbilical cells help eye's neurons connect

November 24, 2015

Cells isolated from human umbilical cord tissue have been shown to produce molecules that help retinal neurons from the eyes of rats grow, connect and survive, according to Duke University researchers working with Janssen ...

Brain connections predict how well you can pay attention

November 24, 2015

During a 1959 television appearance, Jack Kerouac was asked how long it took him to write his novel On The Road. His response – three weeks – amazed the interviewer and ignited an enduring myth that the book was composed ...

No cable spaghetti in the brain

November 24, 2015

Our brain is a mysterious machine. Billions of nerve cells are connected such that they store information as efficiently as books are stored in a well-organized library. To this date, many details remain unclear, for instance ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.