Imagining an object can change how we hear sounds later

April 12, 2018, Association for Psychological Science
Imagining an object can change how we hear sounds later
Credit: Association for Psychological Science

Seeing an object at the same time that you hear sound coming from somewhere else can lead to the "ventriloquist illusion" and its aftereffect, but research suggests that simply imagining the object produces the same illusory results. The findings are published in Psychological Science.

"The sensory information we imagine is often treated by the brain in the same way as information streaming in to us from the outside world," says researcher Christopher C. Berger of the California Institute of Technology. "Our work shows that what we imagine in our 'mind's eye' can lead to changes in perception across our sensory systems, changing how we perceive real information from the world around us in the future."

The brain is constantly integrating information from multiple senses to produce a coherent experience of the world. This process is seamless and adaptive—for example, in the ventriloquist illusion, the perceived of a sound shifts toward the location of if they are presented at the same time. And if we experience this pairing repeatedly, the illusion will persist as an aftereffect even when the visual stimulus is gone and we only hear the sound.

We might like to believe that sights and sounds in the real world is categorically different from imagining them - however, suggest that the distinction between real and imagined isn't quite so clear. Given this overlap, Berger and coauthor H. Henrik Ehrsson hypothesized that the ventriloquism aftereffect would occur with stimuli that are both seen and imagined. They tested their hypothesis in a series of six experiments.

In an adaptation , participants imagined a circle appearing in a specific location on screen at the same time that they heard coming from one of three locations behind the screen (e.g., left, center, right). In the test phase, they heard bursts of white noise emanating from randomly assigned locations and indicated whether the noise came from the left- or right-hand side of the screen.

The results showed that imagining a circle simultaneously with hearing sounds was enough to induce the ventriloquism aftereffect—participants' responses in the test phase were biased in accordance with the specific imagery-sound pairing they experienced during the adaptation phase.

"We were surprised to find that the effects on participants' perception of acoustic space were almost as strong for imagined stimuli as they were for real visual stimuli," says Berger. "That is, what we imagine seeing can affect our future perception of sound as much as what we actually see."

For the aftereffect to emerge, however, the sounds presented in the two phases must be consistent. In four experiments, the ventriloquism aftereffect emerged in response to both mental imagery and , but only when the adaptation and test phase featured the same tone. The aftereffect did not appear when the adaptation phase featured a tone and the test phase featured white noise.

Berger and Ehrsson hope to continue investigating the overlap in processing between and visual perception. They note that research in this area may eventually have applications in a variety of domains, including in rehabilitation following injury or stroke and the development of brain-computer interfaces and neural prostheses.

Explore further: 'Seeing' faces through touch

More information: Christopher C. Berger et al, Mental Imagery Induces Cross-Modal Sensory Plasticity and Changes Future Auditory Perception, Psychological Science (2018). DOI: 10.1177/0956797617748959

Related Stories

'Seeing' faces through touch

September 4, 2013
Our sense of touch can contribute to our ability to perceive faces, according to new research published in Psychological Science, a journal of the Association for Psychological Science.

Study sheds new light on a classic question in psychology and neuroscience

June 27, 2013
A study from Karolinska Institutet in Sweden shows, that our imagination may affect how we experience the world more than we perhaps think. What we imagine hearing or seeing "in our head" can change our actual perception. ...

The 'loudness' of our thoughts affects how we judge external sounds

February 23, 2018
The "loudness" of our thoughts—or how we imagine saying something—influences how we judge the loudness of real, external sounds, a team of researchers from NYU Shanghai and NYU has found.

Optimized perception in the twilight zone

April 11, 2018
In the pre-industrial age, twilight was a dangerous time for humans due to higher risk of encountering nocturnal predators. The ability to see in weak light conditions was therefore at a clear evolutionary advantage. Neuroscientists ...

How the brain represents sound elevation

March 5, 2018
Changing the shape of human participants' ears has provided new insight into how the brain represents the location of a sound source. The research, published in JNeurosci, highlights the link between sensory encoding and ...

Exposure to a common visual illusion may enhance your ability to read fine print

July 12, 2017
Exposure to a common visual illusion may enhance your ability to read fine print, according to new research from psychologists at the Universities of York and Glasgow.

Recommended for you

People can handle the truth (more than you think)

September 19, 2018
Most people value the moral principle of honesty. At the same time, they frequently avoid being honest with people in their everyday lives. Who hasn't told a fib or half-truth to get through an awkward social situation or ...

Study reveals cannabinoid drugs make pain feel 'less unpleasant, more tolerable'

September 19, 2018
Researchers in the College of Arts and Sciences have determined that cannabinoid drugs do not appear to reduce the intensity of experimental pain, but, instead, may make pain feel less unpleasant and more tolerable.

Mindfulness meditation: 10 minutes a day improves cognitive function

September 19, 2018
Practising mindfulness meditation for 10 minutes a day improves concentration and the ability to keep information active in one's mind, a function known as "working memory". The brain achieves this by becoming more efficient, ...

Close intercultural romantic relationships and friendships can boost creativity

September 19, 2018
You've worked abroad. You've lived abroad. But have you had a close friendship or romantic relationship with a person from a culture drastically different from your own?

The 'real you' is a myth – we constantly create false memories to achieve the identity we want

September 19, 2018
We all want other people to "get us" and appreciate us for who we really are. In striving to achieve such relationships, we typically assume that there is a "real me". But how do we actually know who we are? It may seem simple ...

New research helps to instill persistence in children

September 19, 2018
Encouraging children "to help," rather than asking them to "be helpers," can instill persistence as they work to fulfill daily tasks that are difficult to complete, finds a new psychology study.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.