What's in a simple line drawing? Quite a lot, our brains say

May 16, 2011 by Jeff Grabmeier, The Ohio State University
brain

A new study using sophisticated brain scans shows how simple line drawings can capture the essence of a beach or a mountain for viewers just as well as a photograph would.

Researchers found that viewing a "beach" scene depicted in a line drawing activated nearly the same patterns of brain activity in study participants as did viewing an actual color photograph of a beach. The same was true when people viewed line drawings and photographs of other natural scenes including city streets, forests, highways, mountains and offices.

Even when researchers removed up to 75 percent of the pixels in a line drawing, people still did better than chance at determining what the lines represented -- as long as the remaining lines showed the broad contours of the scene.

"Our results suggest that our brains can recreate whole detailed scenes from just a few lines, said Dirk Bernhardt-Walther, lead author of the study and assistant professor of at Ohio State University.

"The representations in our brain for categorizing these scenes seem to be a bit more abstract than some may have thought – we don't need features such as texture and color to tell a beach from a street scene," he said.

Walther conducted the study with Barry Chai and Li Fei-Fei of Stanford University and Eamon Caddigan and Diane Beck with the University of Illinois. Their results appear in the online early edition of the Proceedings of the National Academy of Sciences.

For the study, 10 participants viewed color photographs and line drawings of six categories of scenes -- beaches, city streets, forests, highways, mountains and offices -- while their brains were scanned using functional magnetic resonance imaging (fMRI).

The fMRI images showed the researchers what was going on in several areas of the participants' brains when they viewed the photos and line drawings. The most significant results occurred in the parahippocomal place area (PPA), an area of the brain that scientists know plays an important role in the encoding and recognition of scenes (rather than faces or objects).

Using the data from when participants viewed the color photos, the researchers trained a software-based decoder to tell what type of scene the participants viewed -- a beach, mountain, etc., -- based on the patterns of in the PPA revealed in the fMRI.

The decoder was far from perfect, but it did better than chance at predicting what scene a person was viewing in a particular fMRI image.

Most importantly, the decoder could do just as well at predicting which scene a person viewed when it was focused on line drawings as it was on photographs. In fact, the decoder did slightly better -- although not significantly so -- at predicting line drawings compared to photographs in the primary visual cortex.

"We expected that line drawings would be good enough to allow some decoding, but it was surprising that there was no benefit to photographs -- the decoder was no better when it was used on photos than it was on line drawings," Walther said.

Findings showed that when the decoder was trained on photographs, it still did equally well at predicting which scenes people were viewing in line drawings, and vice versa.

"That suggests the brain uses the same information to decode which scene it is viewing when it is presented with line drawings or photos," he said.

In addition, results showed that when the decoder did make errors, it made similar errors in both photographs and line drawings. For example, if the decoder thought people were looking at a photo of a mountain when they were really looking at a photo of a forest, it would make the same mistake when it was analyzing line drawings.

"The patterns of error match incredibly well, so that's an additional piece of evidence that the representations for photos and line drawings are very similar in the brain," Bernhardt-Walther said.

But what is it about line drawings that allow people to recognize what they represent? As part of the study, the researchers removed some of the lines in the line drawings and asked participants if they could still tell what scene was depicted. In some cases, they removed up to 75 percent of the pixels in the drawing.

If the researchers left the long contours in the drawings, which represented global structure -- such as sky, water or sand -- participants could still correctly predict what kind of scene was depicted about 60 percent of the time.

However, when researchers took out these long contours and left only short ones -- representing details like leaves, windows in buildings or individual ridges in a mountainside -- the accuracy of participants went way down.

These findings cast doubt on some models of human visual perception which argue that people need specific information that is found in photographs -- such as color, shading and texture -- to classify a scene.

"Of course, we use the rich sources of information found in a photograph when it is available, but the is an opportunist -- it uses what is available," Walther said. "We can get a lot of information from a line drawing."

The results also suggest why line drawings have played such an important role in human history, both as an art form and a way of presenting information simply.

"Imagine the astonishment of early man when he discovered he could draw shapes on a rock wall and it resembled the actual animal he had just killed. Line drawings have been with us since prehistoric times," Walther said.

Explore further: Carnegie Mellon study identifies where thoughts of familiar objects occur inside the human brain

Related Stories

Carnegie Mellon study identifies where thoughts of familiar objects occur inside the human brain

January 2, 2008
[B]Experts trained algorithm to extract patterns from participants' brain activation scans[/B] A team of Carnegie Mellon University computer scientists and cognitive neuroscientists, combining methods of machine learning ...

Tiny eye motions help us find where Waldo is

February 20, 2009
(PhysOrg.com) -- To recognize faces in a crowd, the brain employs tiny eye movements called saccades and microsaccades to help us search for objects of interest. While researchers know that these movements are involuntary ...

Timing is (almost) everything: Memory enhanced when events occur at behaviorally relevant times

March 15, 2010
What determines whether a scene is remembered or forgotten? According to a study published this week in the open access journal PLoS Biology, memory for visual scenes may not depend on attention level or what a scene contains, ...

How the brain copes with shifty eyeballs

April 18, 2007
Neurobiologists have pinpointed brain regions critical to one of the brain’s more remarkable feats—piecing together a continuous view of the world by integrating snippets of visual input from constantly moving eyes. Since ...

Our cheatin' brain: The brain's clever way of showing us the world as a whole

October 29, 2008
Whether we choose to admit it or not, we all experience memory errors from time to time. Research has suggested that false memory may be a result of having too many other things to remember or perhaps if too much time has ...

Women with eating disorders draw a different picture of themselves than women without

February 14, 2011
Women suffering from anorexia or bulimia draw themselves with prominently different characteristics than women who do not have eating disorders and who are considered of normal weight. This has been revealed in a new joint ...

Recommended for you

Wiring diagram of the brain provides a clearer picture of brain scan data

December 14, 2018
Already affecting more than five million Americans older than 65, Alzheimer's disease is on the rise and expected to impact more than 13 million people by 2050. Over the last three decades, researchers have relied on neuroimaging—brain ...

Scientists identify method to study resilience to pain

December 14, 2018
Scientists at the Yale School of Medicine and Veterans Affairs Connecticut Healthcare System have successfully demonstrated that it is possible to pinpoint genes that contribute to inter-individual differences in pain.

Parents' brain activity 'echoes' their infant's brain activity when they play together

December 13, 2018
When infants are playing with objects, their early attempts to pay attention to things are accompanied by bursts of high-frequency activity in their brain. But what happens when parents play together with them? New research, ...

In the developing brain, scientists find roots of neuropsychiatric diseases

December 13, 2018
The most comprehensive genomic analysis of the human brain ever undertaken has revealed new insights into the changes it undergoes through development, how it varies among individuals, and the roots of neuropsychiatric illnesses ...

Researchers discover abundant source for neuronal cells

December 13, 2018
USC researchers seeking a way to study genetic activity associated with psychiatric disorders have discovered an abundant source of human cells—the nose.

Researchers find the cause of and cure for brain injury associated with gut condition

December 13, 2018
Using a mouse model of necrotizing enterocolitis (NEC)—a potentially fatal condition that causes a premature infant's gut to suddenly die—researchers at Johns Hopkins say they have uncovered the molecular causes of the ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.