Abstract:Speech emotion recognition is an indispensable part of realizing natural human-computer interaction and an important part of artificial intelligence. The regulation of speech production organs causes differences in the acoustic features of the emotional speech signal, and thus different emotions are perceived. Traditional speech emotion recognition methods are only focused on classifying emotions based on acoustical features or auditory features, ignoring the important role of speech production directly related features such as glottal source waveform and vocal tract shape cues on emotion perception. In our previous study, the contributions of glottal source and vocal tract cues to the emotion perception in speech have been theoretically analyzed. However, the glottal source and vocal tract features have not been used for speech emotion recognition. Therefore, in this paper, we revisited the possibility of glottal source and vocal tract cues for speech emotion recognition from the point of view of speech production. Motivated by the source-filter model of speech production, we propose a new speech emotion recognition method based on the glottal source and vocal tract features. Firstly, the glottal source and vocal tract features were estimated simultaneously from emotional speech signals based on an analysis-bysynthesis approach with a source-filter model constructed of an Auto-Regressive eXogenous（ARX）model and the Liljencrants-Fant（LF）model. Then, the estimated glottal source and vocal tract features were fed into the Bidirectional Gated Recurrent Unit（BiGRU）network for the speech emotion recognition tasks. The emotion recognition verification were conducted on an public emotion dataset of interactive emotional dyadic motion capture database（IEMOCAP）, and the experimental results showed that the glottal source and vocal tract features could effectively distinguish the emotions, and the emotion recognition accuracy of the glottal source and vocal tract features is superior to that of traditional emotion features. This paper is focused on the advantages of the glottal source and vocal tract features that are directly used for speech emotion recognition, which provides new insight into speech emotion recognition technology.

Comparison of Glottal Source Parameter Values in Emotional Vowels.

Applying Emotional Factor Analysis And I-Vector To Emotional Speaker Recognition

Speech Emotion Recognition Based on Glottal Source and Vocal Tract Features

Contribution of Glottal Waveform in Speech Emotion: A Comparative Pairwise Investigation

Exploration of glottal characteristics and the vocal folds behavior for the speech under emotion

Emotional speaker recognition based on similar neighbor phenomenon

Scores Selection for Emotional Speaker Recognition

Emotional speaker recognition based on i-vector through Atom Aligned Sparse Representation

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Prosody Conversion from Neutral Speech to Emotional Speech.

F0 Transformation for Emotional Speech Synthesis Using Target Approximation Features and Bidirectional Associative Memories

An Experimental Study of Emotional Speech in Mandarin and English

$F_0$-Noise-robust Glottal Source and Vocal Tract Analysis Based on ARX-LF Model

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

Emotional expressivity in singing. Assessing physiological and acoustic indicators of two opera singers' voice characteristics

Modeling and Estimation of Vocal Tract and Glottal Source Parameters Using ARMAX-LF Model

Affective Voice Interaction and Artificial Intelligence: A Research Study on the Acoustic Features of Gender and the Emotional States of the PAD Model

Prosody Analysis And Modeling For Emotional Speech Synthesis

The Voice of Emotion in Chinese and Italian Young Adults