Abstract:<p>We preliminarily explore physiological characteristics of the vocal folds when the subject is under different emotional modes. Glottal variations from speech production representing the vocal folds behavior will be mainly discussed. We believe that emotion of the human subject has specific impact on the behavior of the vocal folds, which may result in the variations in glottal flow. This paper investigates the physiological characteristics of the vocal folds through variation in the glottal flow under different emotions. A modified algorithm, Pitch Synchronous Iterative Adaptive Inverse Filtering using Average Magnitude Difference Function based on Empirical Mode Decomposition (AMDFEMD-PSIAIF), is proposed to estimate the glottal flow. Glottal flow is discussed and measured by parameters representing the variations in the vibration behavior of the vocal folds. The physical parameters characterizing the muscle tension and viscosity of the vocal folds are estimated using a speech production model, and a fitting method using the glottal flow is proposed. Through an evaluation on a dataset containing over 1200 voice signals, the glottal and physical parameters are measured to verify the variation mode in vocal folds vibration. We obtain the true positive rate and the average sensitivity of each 9 parameter in 6 different emotional modes. Experimental results show that vocal folds present obvious physical changes when under different emotional modes. The CT muscle of the vocal folds is contracting for fear, happy, angry and surprise mode. The TA is relaxing for happy, angry and sad, while contracting when the speaker is under surprise. Fear and surprise make the surface of the vocal folds sticker, while viscosity reduction occurs when the speaker is experiencing sadness. Therefore, the vibration mechanism and physiological properties of the vocal folds corresponding to emotion modes are preliminarily explored.</p>

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

Acoustic and Physiological Feature Analysis of Affective Speech

Emotional speaker recognition based on similar neighbor phenomenon

Emotional Speaker Identification By Humans And Machines

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Linguistic computing model for music emotion

Mapping Acoustic Characteristics of Emotional Prosody in Mandarin Disyllabic Words: A Machine-Learning Approach

Contribution of Glottal Waveform in Speech Emotion: A Comparative Pairwise Investigation

Investigation on Pleasure Related Acoustic Features of Affective Speech

An Experimental Study of Emotional Speech in Mandarin and English

Affective Voice Interaction and Artificial Intelligence: A Research Study on the Acoustic Features of Gender and the Emotional States of the PAD Model

Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

Affect Related Acoustic Features of Speech and Their Modification

Articulation constrained learning with application to speech emotion recognition

Exploration of glottal characteristics and the vocal folds behavior for the speech under emotion

An Emotional Text-Driven 3D Visual Pronunciation System for Mandarin Chinese

Acoustics and emotion in tonal and non-tonal languages: Findings from individuals with typical hearing and with cochlear implants

An articulatory model of standard Chinese using MRI and X-ray movie

Acoustic-articulatory emotion recognition using multiple features and parameter-optimized cascaded deep learning network

Speech Emotion Recognition Using Acoustic Features

Hot Speech and Exploding Bombs: Autonomic Arousal During Emotion Classification of Prosodic Utterances and Affective Sounds