Readers build vivid mental simulations of narrative situations, brain scans suggest

January 26, 2009 By Gerry Everding,

Click the brain scans to view a color-coded chart describing changes in brain activation during the reading of a brief narrative.
(PhysOrg.com) -- A new brain-imaging study is shedding light on what it means to "get lost" in a good book — suggesting that readers create vivid mental simulations of the sounds, sights, tastes and movements described in a textual narrative while simultaneously activating brain regions used to process similar experiences in real life.

"Psychologists and neuroscientists are increasingly coming to the conclusion that when we read a story and really understand it, we create a mental simulation of the events described by the story," says Jeffrey M. Zacks, study co-author and director of the Dynamic Cognition Laboratory at Washington University in St. Louis.

The study, forthcoming in the journal Psychological Science, is one of a series in which Zacks and colleagues use functional magnetic resonance imaging (fMRI) to track real-time brain activity as study participants read and process individual words and short stories.

Nicole Speer, lead author of this study, says findings demonstrate that reading is by no means a passive exercise. Rather, readers mentally simulate each new situation encountered in a narrative. Details about actions and sensation are captured from the text and integrated with personal knowledge from past experiences. These data are then run through mental simulations using brain regions that closely mirror those involved when people perform, imagine, or observe similar real-world activities.

"These results suggest that readers use perceptual and motor representations in the process of comprehending narrated activity, and these representations are dynamically updated at points where relevant aspects of the situation are changing," says Speer, now a research associate with The Western Interstate Commission for Higher Education (WICHE) Mental Health Program in Boulder, Colo. "Readers understand a story by simulating the events in the story world and updating their simulation when features of that world change."

In addition to Zacks, an associate professor of psychology in Arts and Sciences and of radiology in the School of Medicine at WUSTL, other co-authors for this study are Jeremy R. Reynolds, assistant professor of psychology at the University of Denver in Denver, Colo.; and Khena M. Swallow, a post-doctoral associate in psychology at the University of Minnesota. Reynolds, Swallow and Speer all graduated from the psychology doctoral program at WUSTL in the last several years.

Reading, one of the most important skills human beings can acquire, has been difficult to study using fMRI because researchers seldom have access to expensive scanning equipment for long periods of time. Reading long passages of text also poses challenges because participants must remain very still for the scans to be effective. In an effort to minimize eye movements, participants are immobilized within the brain-scanning device and presented with text one-word-at-a-time on an adjacent computer screen.

Previous research has shown that when people read isolated words or phrases involving vivid visual or motor contents, brain activity in sensory and motor brain regions specifically related to those contents increased. But this result might not be typical of normal reading — in the previous studies there was no story to try to understand, and participants sometimes had to make an explicit judgment about each word or phrase. In this study, Speer and colleagues used fMRI to look for evidence of mental simulation during the reading of extended stories. Each participant read four stories of less than 1500 words excerpted from a simple, 1940s-era book about the daily activities of a young boy. Participants were shown text passages on a computer screen that displayed one word at a time; reading all four stories took most participants about 40 minutes.

The researchers had carefully coded the stories so that they knew when important features of the story were changing. The features had been chosen based on previous studies of narrative reading, and were known to be important for comprehension. The researchers hypothesized that some brain regions would increase at several different feature changes, but that other brain regions would be selectively activated by only one feature change. This is what was found.

For example, changes in the objects a character interacted with (e.g., "pulled a light cord") were associated with increases in a region in the frontal lobes known to be important for controlling grasping motions. Changes in characters' locations (e.g., "went through the front door into the kitchen") were associated with increases in regions in the temporal lobes that are selectively activate when people view pictures of spatial scenes.

Overall, the data supported the view that readers construct mental simulations of events when reading stories.

The Speer et al. paper extends results reported by this group previously in Psychological Science. In the previous study, the researchers asked readers to divide the stories into meaningful events after reading them in the MRI scanner. The researchers then asked which parts of the brain increased in activity at event boundaries. The mental simulation results reported here line up strikingly with those regions. This suggests that readers construct a mental simulation as they read, and then divide that simulation into meaningful events when important features change.

Provided by Washington University in St. Louis

Explore further: Poor sleep triggers viral loneliness and social rejection

Related Stories

Poor sleep triggers viral loneliness and social rejection

August 14, 2018
Poor sleep can literally kill your social life. Researchers at the University of California, Berkeley, have found that sleep-deprived people feel lonelier and less inclined to engage with others, avoiding close contact in ...

Satnavs 'switch off' parts of the brain

March 21, 2017
Using a satnav to get to your destination 'switches off' parts of the brain that would otherwise be used to simulate different routes, reveals new UCL research.

High earners in a stock market game have brain patterns that can predict market bubbles

July 7, 2014
If you're so smart, why aren't you rich? It may be that, when it comes to stock market success, your brain is heeding the wrong neural signals.

New insight into how brain performs 'mental time travel'

February 17, 2015
In Proust's novel Recollection of Things Past, the distinctive smell of a lemon madeleine launches the narrator on a long, involved reminiscence of his past that fills seven chapters.

New theory of how the brain transforms sensations into mental objects

November 15, 2017
Inputs to the brain from the eyes, ears, and skin are continually changing as we move. Yet our brain perceives objects in the world as stable. How the brain learns the structure of the world from rapidly changing inputs is ...

Algorithm decrypts brain-on-chip signals

July 10, 2017
IISRI researchers are helping to measure the brain's response to stimuli, with huge potential for breakthrough research – in areas ranging from mental health to artificial intelligence.

Recommended for you

Researchers use brain cells in a dish to study genetic origins of schizophrenia

October 16, 2018
A study in Biological Psychiatry has established a new analytical method for investigating the complex genetic origins of mental illnesses using brain cells that are grown in a dish from human embryonic stem cells. Researchers ...

Linguistic red flags from Facebook posts can predict future depression diagnoses

October 15, 2018
In any given year, depression affects more than 6 percent of the adult population in the United States—some 16 million people—but fewer than half receive the treatment they need. What if an algorithm could scan social ...

Early changes to synapse gene regulation may cause Alzheimer's disease

October 15, 2018
Alzheimer's disease (AD) is the most common form of dementia, involving memory loss and a reduction in cognitive abilities. Patients with AD develop multiple abnormal protein structures in their brains that are thought to ...

Clues that suggest people are lying may be deceptive, study shows

October 12, 2018
The verbal and physical signs of lying are harder to detect than people believe, a study suggests.

Why don't we understand statistics? Fixed mindsets may be to blame

October 12, 2018
Unfavorable methods of teaching statistics in schools and universities may be to blame for people ignoring simple solutions to statistical problems, making them hard to solve. This can have serious consequences when applied ...

From 'problem child' to 'prodigy'? LSD turns 75

October 12, 2018
Lysergic acid diethylamide was labelled a "problem child" by the man who discovered its hallucinogenic properties in 1943: as it turns 75, the drug known as LSD may now be changing its image.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

gmurphy
5 / 5 (2) Jan 26, 2009
this is why the book of a story is usually so much better than the movie.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.