What's in a simple line drawing? Quite a lot, our brains say
A new study using sophisticated brain scans shows how simple line drawings can capture the essence of a beach or a mountain for viewers just as well as a photograph would.
Researchers found that viewing a "beach" scene depicted in a line drawing activated nearly the same patterns of brain activity in study participants as did viewing an actual color photograph of a beach. The same was true when people viewed line drawings and photographs of other natural scenes including city streets, forests, highways, mountains and offices.
Even when researchers removed up to 75 percent of the pixels in a line drawing, people still did better than chance at determining what the lines represented -- as long as the remaining lines showed the broad contours of the scene.
"Our results suggest that our brains can recreate whole detailed scenes from just a few lines, said Dirk Bernhardt-Walther, lead author of the study and assistant professor of psychology at Ohio State University.
"The representations in our brain for categorizing these scenes seem to be a bit more abstract than some may have thought we don't need features such as texture and color to tell a beach from a street scene," he said.
Walther conducted the study with Barry Chai and Li Fei-Fei of Stanford University and Eamon Caddigan and Diane Beck with the University of Illinois. Their results appear in the online early edition of the Proceedings of the National Academy of Sciences.
For the study, 10 participants viewed color photographs and line drawings of six categories of scenes -- beaches, city streets, forests, highways, mountains and offices -- while their brains were scanned using functional magnetic resonance imaging (fMRI).
The fMRI images showed the researchers what was going on in several areas of the participants' brains when they viewed the photos and line drawings. The most significant results occurred in the parahippocomal place area (PPA), an area of the brain that scientists know plays an important role in the encoding and recognition of scenes (rather than faces or objects).
Using the data from when participants viewed the color photos, the researchers trained a software-based decoder to tell what type of scene the participants viewed -- a beach, mountain, etc., -- based on the patterns of brain activity in the PPA revealed in the fMRI.
The decoder was far from perfect, but it did better than chance at predicting what scene a person was viewing in a particular fMRI image.
Most importantly, the decoder could do just as well at predicting which scene a person viewed when it was focused on line drawings as it was on photographs. In fact, the decoder did slightly better -- although not significantly so -- at predicting line drawings compared to photographs in the primary visual cortex.
"We expected that line drawings would be good enough to allow some decoding, but it was surprising that there was no benefit to photographs -- the decoder was no better when it was used on photos than it was on line drawings," Walther said.
Findings showed that when the decoder was trained on photographs, it still did equally well at predicting which scenes people were viewing in line drawings, and vice versa.
"That suggests the brain uses the same information to decode which scene it is viewing when it is presented with line drawings or photos," he said.
In addition, results showed that when the decoder did make errors, it made similar errors in both photographs and line drawings. For example, if the decoder thought people were looking at a photo of a mountain when they were really looking at a photo of a forest, it would make the same mistake when it was analyzing line drawings.
"The patterns of error match incredibly well, so that's an additional piece of evidence that the representations for photos and line drawings are very similar in the brain," Bernhardt-Walther said.
But what is it about line drawings that allow people to recognize what they represent? As part of the study, the researchers removed some of the lines in the line drawings and asked participants if they could still tell what scene was depicted. In some cases, they removed up to 75 percent of the pixels in the drawing.
If the researchers left the long contours in the drawings, which represented global structure -- such as sky, water or sand -- participants could still correctly predict what kind of scene was depicted about 60 percent of the time.
However, when researchers took out these long contours and left only short ones -- representing details like leaves, windows in buildings or individual ridges in a mountainside -- the accuracy of participants went way down.
These findings cast doubt on some models of human visual perception which argue that people need specific information that is found in photographs -- such as color, shading and texture -- to classify a scene.
"Of course, we use the rich sources of information found in a photograph when it is available, but the brain is an opportunist -- it uses what is available," Walther said. "We can get a lot of information from a line drawing."
The results also suggest why line drawings have played such an important role in human history, both as an art form and a way of presenting information simply.
"Imagine the astonishment of early man when he discovered he could draw shapes on a rock wall and it resembled the actual animal he had just killed. Line drawings have been with us since prehistoric times," Walther said.
Provided by The Ohio State University
- Carnegie Mellon study identifies where thoughts of familiar objects occur inside the human brain Jan 02, 2008 | not rated yet | 0
- Tiny eye motions help us find where Waldo is Feb 20, 2009 | not rated yet | 0
- Timing is (almost) everything: Memory enhanced when events occur at behaviorally relevant times Mar 15, 2010 | not rated yet | 0
- How the brain copes with shifty eyeballs Apr 18, 2007 | not rated yet | 0
- Our cheatin' brain: The brain's clever way of showing us the world as a whole Oct 29, 2008 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Why is zone 1 in liver more prone to ischemic injury?
5 hours ago Hi, Is it because around central vein, there is only deoxygenated blood from the vein where as in the periphery there is hepatic artery. Also why...
How can there be villous adenoma in colon, if there are no villi there
May 22, 2013 As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
- More from Physics Forums - Medical Sciences
More news stories
A study from the June issue of Anesthesiology found feedback from the front region of the brain is a crucial building block for consciousness and that its disruption is associated with unconsciousness when the anesthetics ketami ...
Neuroscience 24 minutes ago | not rated yet | 0
(HealthDay)—Migraines and depression can each cause a great deal of suffering, but new research indicates the combination of the two may be linked to something else entirely—a smaller brain.
Neuroscience 16 hours ago | 4.3 / 5 (3) | 0 |
Moving objects attract greater attention – a fact exploited by video screens in public spaces and animated advertising banners on the Internet. For most animal species, moving objects also play a major ...
Neuroscience 19 hours ago | not rated yet | 0 |
It is known that signs of neurological disorders such as Alzheimer's and Huntington's disease can appear years before the disease becomes manifest; these signs take the form of subtle changes in the brain and behavior of ...
Neuroscience 19 hours ago | not rated yet | 0
Scientists have reversed behavioral and brain abnormalities in adult mice that resemble some features of schizophrenia by restoring normal expression to a suspect gene that is over-expressed in humans with ...
Neuroscience 21 hours ago | 5 / 5 (2) | 0 |
For the first time, physicists from the Max Planck Institute for Extraterrestrial Physics (MPE), biologists and physicians demonstrated the synergistic effect of cold atmospheric plasma - a partly ionized ...
24 minutes ago | not rated yet | 0 |
As health services strive to improve quality and reduce costs, researchers study the benefits – and the pitfalls – of 'pay for performance' in hospitals.
33 minutes ago | not rated yet | 0 |
(Medical Xpress)—Scientists from the Joint Center for Structural Genomics (JCSG) at SLAC National Accelerator Laboratory have determined the 3-D structure of the chemically active part of an enzyme involved ...
4 minutes ago | not rated yet | 0 |
(Medical Xpress)—According to the World Health Organization, approximately 70 million couples experience infertility worldwide. Current data suggests that nearly one third of infertility disorders are due ...
44 minutes ago | not rated yet | 0
(Medical Xpress)—There is no significant risk directly associated with air travel during pregnancy, even at advanced gestation, says report by the University of Liverpool.
54 minutes ago | not rated yet | 0
Parents naturally are concerned for their children's safety, particularly when there is news of a child abduction that happens close to home. Finding the balance between emotions and the "teachable moment" as parents talk ...
14 minutes ago | not rated yet | 0