The emotion of sound target modulates the auditory gaze cueing effect

Xinghe Feng Xinmeng Shi Zhonghua Hu a Institute of Brain and Psychological Sciences,Sichuan Normal University,Chengdu,People's Republic of Chinab Research Center of Brain and Cognitive Neuroscience,Liaoning Normal University,Dalian,People's Republic of China
DOI: https://doi.org/10.1080/02699931.2024.2364037
2024-06-13
Cognition & Emotion
Abstract:The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affec t auditory-GCE. Here, we set neutral faces with different gaze directions as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion.
psychology, experimental
What problem does this paper attempt to address?