Sense and sensibility in short-term memory

February 20, 2007

More than three centuries ago, Sir Isaac Newton reflected on the similarities between the sense of hearing and the sense of sight. Newton’s speculations were impossible to test scientifically, until now. A novel Brandeis University study confirms the Newtonian idea that sight and sound are indeed parallel—at least when it comes to encoding and retrieving short-term memories from the two senses.

Published in this week’s issue of the open-access journal Public Library of Science Biology, the study was inspired by Newton’s 1706 book, Opticks, and set out to investigate whether sight and hearing behave similarly in encoding short-term memories.

"Obviously, sound and light are physically different, processed by different receptors—eyes and ears—and furthermore, processed in different neural streams within the brain," explained coauthor Robert Sekuler, a neuroscientist at the Volen National Center for Complex Systems at Brandeis University, and an expert on the neural and cognitive terrain associated with vision. "Previous studies that tried to compare auditory and visual memory did little or nothing to put the stimuli that would be remembered on equal footing—comparing ‘apples to apples’ between the two senses."

"But in this study we used insights from neuroscience to identify test materials in vision and hearing that the human brain would process and treat in similar ways, and then we used these well-matched stimuli to examine memory for studied lists of either auditory or visual items," said Sekuler.

The study used computer-generated visual images and sounds to test auditory and visual memory mechanisms. Both the sounds and the visual materials were intentionally unfamiliar to test subjects, who also found it difficult to name the test items. The results were based on behavioral measures and a computational model for memory.

"Memories are not exact representations of the past," said coauthor Kristina Visscher, a post-doctoral fellow at Brandeis. "This study shows that our representations of sight and sound get contorted on the way to being remembered, and they get contorted in the same ways." The errors we make in memory for sounds are the same types of errors we make in memory for sight.

The first of its kind, the study opens the door to the tantalizing possibility that, according to Visscher, "the brain, in this case at least, is relatively uninventive: it may use fairly similar methods to generate light-based and sound-based memories." So three centuries after Newton published his inspired speculation, there is evidence that his intuition was close to the mark.

Source: Brandeis University

Explore further: More frequent sexual activity can boost brain power in older adults, according to study

Related Stories

Retina may be sensitive gauge of blast-wave pressure injury

June 9, 2017

Modern military conflict has dramatically increased the number of military personnel and civilians exposed to blast wave pressure. Although traumatic brain injury (TBI) is a well-recognized consequence of extreme blast waves, ...

Concentration spans drop when online ads pop up

June 12, 2017

Two Polish researchers have shown that measurements of the brain's electrical activity can be used to test the influence of intrusive online advertisements on internet users' concentration and emotions. The exploratory study ...

Recommended for you

Tiny bubbles offer sound solution for drug delivery

June 25, 2017

Your brain is armored. It lives in a box made of bones with a security system of vessels. These vessels protect the brain and central nervous system from harmful chemicals circulating in the blood. Yet this protection system—known ...

Lab grown human colons change study of GI disease

June 22, 2017

Scientists used human pluripotent stem cells to generate human embryonic colons in a laboratory that function much like natural human tissues when transplanted into mice, according to research published June 22 in Cell Stem ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.