Communication Channel, Emotion Category and Attentional Requirement Modulate Emotional Speech Perception: Electrophysiological and Behavioral Evidence
Yi Lin,Xinran Fan,Hao Zhang,Fei Chen,Hui Zhang,Hongwei Ding,Yang Zhang
DOI: https://doi.org/10.1121/10.0008272
2021-01-01
The Journal of the Acoustical Society of America
Abstract:The present study employed electrophysiological and behavioral measures to examine the modulatory effects of communication channels, emotion categories and attentional requirements on the timing, neural oscillatory activities and behavioral performances of emotional speech processing. Thirty participants (15 women and 15 men) were presented with spoken words denoting happiness, neutrality and sadness in prosody or semantics. They were asked to attend to the emotional content (explicit tasks) and speakers’ gender (implicit tasks) of the stimuli. Auditory event-related potential (AERP), inter-trial phase coherence (ITPC), accuracy, and reaction time data were recorded and analyzed. Results indicated that prosody (relative to semantics) and happiness (relative to neutrality and sadness) enjoyed greater processing advantages during the sensory processing of acoustic signals, initial derivation of emotional significance, and cognitive evaluation of emotional speech. However, these channel and category-specific effects were attenuated in implicit tasks and sadness processing. Explicit tasks also displayed greater perceptual sensitivities in early auditory processing, but exhibited greater processing difficulty during decision making. In addition, ITPC values served as significant predictors of AERP amplitudes across the three contextual factors. These findings reveal the neural and behavioral underpinnings of emotional speech processing, which is mediated by the dynamic interplay among channels, emotions and attention.