This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:


peer-reviewed publication

trusted source


Researchers map the spatio-temporal human brain dynamics of a visual image being recognized

Mapping the brain pathways of visual memorability
A team of MIT researchers found highly memorable images have stronger and sustained responses in ventro-occipital brain cortices, peaking at around 300ms. Conceptually similar but easily forgettable images quickly fade away. Credit: Alex Shipps/MIT CSAIL

For nearly a decade, a team of MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers have been seeking to uncover why certain images persist in people's minds, while many others fade. To do this, they set out to map the spatio-temporal brain dynamics involved in recognizing a visual image.

And now for the first time, scientists harnessed the combined strengths of magnetoencephalography (MEG), which captures the timing of activity, and imaging (fMRI), which identifies active brain regions, to precisely determine when and where the brain processes a memorable image.

Their open-access study, published this month in PLOS Biology, used 78 pairs of images matched for the same concept but differing in their memorability scores—one was highly memorable and the other was easy to forget.

These images were shown to 15 subjects, with scenes of skateboarding, animals in various environments, everyday objects like cups and chairs, like forests and beaches, urban scenes of streets and buildings, and faces displaying different expressions.

What the researchers found was that a more distributed network of brain regions than previously thought are actively involved in the encoding and retention processes that underpin memorability.

"People tend to remember some images better than others, even when they are conceptually similar, like different scenes of a person skateboarding," says Benjamin Lahner, an MIT Ph.D. student in and , CSAIL affiliate, and first author of the study.

"We've identified a brain signature of visual memorability that emerges around 300 milliseconds after seeing an image, involving areas across the ventral occipital cortex and temporal cortex, which processes information like color perception and object recognition. This signature indicates that highly memorable images prompt stronger and more sustained brain responses, especially in regions like the early visual cortex, which we previously underestimated in memory processing."

While highly memorable images maintain a higher and more sustained response for about half a second, the response to less memorable images quickly diminishes. This insight, Lahner elaborated, could redefine our understanding of how memories form and persist. The team envisions this research holding potential for future clinical applications, particularly in early diagnosis and treatment of memory-related disorders.

The MEG/fMRI fusion method, developed in the lab of CSAIL Senior Research Scientist Aude Oliva, adeptly captures the brain's spatial and temporal dynamics, overcoming the traditional constraints of either spatial or temporal specificity.

The fusion method had a little help from its machine-learning friend, to better examine and compare the brain's activity when looking at various images. They created a "representational matrix," which is like a detailed chart, showing how similar neural responses are in various brain regions. This chart helped them identify the patterns of where and when the brain processes what we see.

Picking the conceptually similar image pairs with high and low memorability scores was the crucial ingredient to unlocking these insights into memorability. Lahner explained the process of aggregating behavioral data to assign memorability scores to images, where they curated a diverse set of high- and low-memorability images with balanced representation across different visual categories.

Despite strides made, the team notes a few limitations. While this work can identify brain regions showing significant memorability effects, it cannot elucidate the regions' function in how it is contributing to better encoding/retrieval from memory.

"Understanding the neural underpinnings of memorability opens up exciting avenues for clinical advancements, particularly in diagnosing and treating memory-related disorders early on," says Oliva. "The specific brain signatures we've identified for memorability could lead to early biomarkers for Alzheimer's disease and other dementias.

"This research paves the way for novel intervention strategies that are finely tuned to the individual's neural profile, potentially transforming the therapeutic landscape for memory impairments and significantly improving patient outcomes."

"These findings are exciting because they give us insight into what is happening in the brain between seeing something and saving it into memory," says Wilma Bainbridge, assistant professor of psychology at the University of Chicago, who was not involved in the study. "The researchers here are picking up on a cortical signal that reflects what's important to remember, and what can be forgotten early on."

More information: Benjamin Lahner et al, Visual perception of highly memorable images is mediated by a distributed network of ventral visual regions that enable a late memorability response, PLOS Biology (2024). DOI: 10.1371/journal.pbio.3002564

Journal information: PLoS Biology

This story is republished courtesy of MIT News (, a popular site that covers news about MIT research, innovation and teaching.

Citation: Researchers map the spatio-temporal human brain dynamics of a visual image being recognized (2024, April 24) retrieved 28 May 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Image viewing experiments challenge theory of universal internal clock


Feedback to editors