Visual short-term memory is more complex than previously assumed

Visual short-term memory is more complex than previously assumed
An international team has investigated what happens step by step in the brain when a person memorizes the image of a banana – or other objects. Credit: RUB, Marquard

Contrary to previous assumptions, visual short-term memory is not merely based on one kind of information about an object, such as only its color or only its name. Rather, several types of information can be retained simultaneously in short-term memory. Using complex EEG analyzes and deep neural networks, researchers at Beijing Normal University and Ruhr-Universität Bochum have discovered that short-term memory is more complex than previously assumed. The team published their findings in the journal Proceedings of the National Academy of Sciences on 7 December 2020.

For the study, Dr. Hui Zhang, Rebekka Heinen and Professor Nikolai Axmacher from the Department of Neuropsychology collaborated with the team headed by Jing Liu and Professor Gui Xue from Beijing Normal University.

The banana in short-term memory

Visual short-term memory helps us remember objects for a short period of time when these objects are no longer visible. Until now, it has been assumed that short-term memory is based on only one type of . The German-Chinese research team has now disproved this assumption. The researchers recorded brain activity in using electrodes that were inserted into the brain for the purpose of surgical planning. The patients saw pictures of objects like a banana and had to remember them for a short time.

Deep neural networks help interpret brain activity

Earlier studies by other groups had shown that process images in similar steps as humans do. If a person or a deep neural network sees a banana, the first step is to process simple characteristics such as its yellow color and smooth texture. Later on, the processed information becomes more and more complex. Eventually, the human and the network recognize the specific crescent shape and finally identify the banana.

The researchers compared the different processing steps of the neural with the brain data of the patients. This enabled them to see which activity patterns belong to the processing of simple visual properties like the yellow color of the banana and which belong to more complex properties like its name.

First simple, then complex

Based on this result, the team then showed that objects are not only represented in one form in short-term , as previously assumed, but in several forms simultaneously. When looking at them, initially simple properties of the banana are processed, then complex properties are added. During the memorisation phase, simple and complex information is retained together. The visual is thus more complex than has long been assumed.

More information: Jing Liu et al. Stable maintenance of multiple representational formats in human visual short-term memory, Proceedings of the National Academy of Sciences (2020). DOI: 10.1073/pnas.2006752117

Citation: Visual short-term memory is more complex than previously assumed (2020, December 8) retrieved 20 February 2024 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Model describes complete grasping movement planning in the brain


Feedback to editors