Abstract:Emotional expressions provide strong signals in social interactions and can function as emotion inducers in a perceiver. Although speech provides one of the most important channels for human communication, its physiological correlates, such as activations of the autonomous nervous system (ANS) while listening to spoken utterances, have received far less attention than in other domains of emotion processing. Our study aimed at filling this gap by investigating autonomic activation in response to spoken utterances that were embedded into larger semantic contexts. Emotional salience was manipulated by providing information on alleged speaker similarity. We compared these autonomic responses to activations triggered by affective sounds, such as exploding bombs, and applause. These sounds had been rated and validated as being either positive, negative, or neutral. As physiological markers of ANS activity, we recorded skin conductance responses (SCRs) and changes of pupil size while participants classified both prosodic and sound stimuli according to their hedonic valence. As expected, affective sounds elicited increased arousal in the receiver, as reflected in increased SCR and pupil size. In contrast, SCRs to angry and joyful prosodic expressions did not differ from responses to neutral ones. Pupil size, however, was modulated by affective prosodic utterances, with increased dilations for angry and joyful compared to neutral prosody, although the similarity manipulation had no effect. These results indicate that cues provided by emotional prosody in spoken semantically neutral utterances might be too subtle to trigger SCR, although variation in pupil size indicated the salience of stimulus variation. Our findings further demonstrate a functional dissociation between pupil dilation and skin conductance that presumably origins from their differential innervation.

Acoustic and Physiological Feature Analysis of Affective Speech

Investigation on Pleasure Related Acoustic Features of Affective Speech

Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Acoustic Analysis of Emotional Speech in Mandarin Chinese

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

A Study of Correlation Between Physiological Process of Articulation and Emotions on Mandarin Chinese.

A Study on Emotional Feature Recognition in Speech.

Mapping Acoustic Characteristics of Emotional Prosody in Mandarin Disyllabic Words: A Machine-Learning Approach

Corpus Design and Prosody Study for Mandarin Affective Speech

Affective Voice Interaction and Artificial Intelligence: A Research Study on the Acoustic Features of Gender and the Emotional States of the PAD Model

MASC: A Speech Corpus in Mandarin for Emotion Analysis and Affective Speaker Recognition

Emotion recognition from sound stimuli based on back-propagation neural networks and electroencephalograms

Articulatory-Acoustic Analyses of Mandarin Words in Emotional Context Speech for Smart Campus

Speech Emotion Recognition Using Acoustic Features

Prosody Analysis And Modeling For Emotional Speech Synthesis

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

The Acoustically Emotion-Aware Conversational Agent with Speech Emotion Recognition and Empathetic Responses

A Dimensional Emotion Model Driven Multi-stage Classification of Emotional Speech

Hot Speech and Exploding Bombs: Autonomic Arousal During Emotion Classification of Prosodic Utterances and Affective Sounds

MES-P: an Emotional Tonal Speech Dataset in Mandarin Chinese with Distal and Proximal Labels

Acoustic Feature Analysis in Speech Emotion Primitives Estimation.