The relationship between looking/listening and human emotions

The relationship between looking/listening and human emotions
(a) Pupillary responses during presentation of emotionally arousing pictures (b) Pupillary responses during presentation of emotionally arousing sounds Credit: Toyohashi University Of Technology.

Researchers at Toyohashi University of Technology report that the relationship between attentional states in response to pictures and sounds and the emotions elicited by them may be different in visual perception and auditory perception. This result suggests visual perception elicits emotions in all attentional states, whereas auditory perception elicits emotions only when attention is paid to sounds, thus showing the differences in the relationships between attentional states and emotions in response to visual and auditory stimuli.

This result was obtained by measuring pupillary reactions related to . It suggests that visual perception elicits emotions in all attentional states, whereas auditory perception elicits emotions only when attention is paid to sounds, thus showing the differences in the relationships between attentional states and emotions in response to visual and auditory stimuli.

In , emotions are often elicited by the information we receive from visual and auditory perception. As such, many studies up until now have investigated human emotional processing using emotional stimuli such as pictures and sounds. However, it was not clear whether such emotional processing differed between visual and auditory perception.

The research team asked participants in the experiment to perform four tasks to alert them to various attentional states when they were presented with emotionally arousing pictures and sounds in order to investigate how emotional responses differed between visual and auditory perception. They also compared the pupillary responses obtained by eye movement measurements as a physiological indicator of emotional responses. As a result, (pictures) elicited emotions during the execution of all tasks, whereas auditory perception (sounds) did so only during the execution of tasks where attention was paid to the sounds. These results suggest that there are differences in the relationship between attentional states and emotional responses to visual and .

"Traditionally, subjective questionnaires have been the most common method for assessing emotional states. However, in this study, we wanted to extract emotional states while some kind of task was being performed. We therefore focused on pupillary response, which is receiving a lot of attention as one of the biological signals that reflect cognitive states. Although many studies have reported about attentional states during arousal owing to visual and auditory perception, there have been no previous studies comparing these states across senses, and this is the first attempt," says lead author Satoshi Nakakoga, Ph. D. student.

Professor Tetsuto Minami, the leader of the research team, said, "There are more opportunities to come into contact with various visual media via smartphones and other devices and to evoke emotions through that visual and auditory information. We will continue investigating about sensory that elicits emotions, including the effects of elicited emotions on human behavior."

Based on the results of this research, the team suggests the possibility of a new method of emotion regulation in which the elicited by a certain sense are promoted or suppressed by stimuli input from another sense. Ultimately, they hope to establish this new method of emotion regulation to treat such as panic and mood disorders.

More information: Satoshi Nakakoga et al, Asymmetrical characteristics of emotional responses to pictures and sounds: Evidence from pupillometry, PLOS ONE (2020). DOI: 10.1371/journal.pone.0230775

Citation: The relationship between looking/listening and human emotions (2020, June 22) retrieved 28 March 2024 from https://medicalxpress.com/news/2020-06-relationship-lookinglistening-human-emotions.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Vision loss influences perception of sound

6 shares

Feedback to editors