Abstract:Speech emotion recognition is an indispensable part of realizing natural human-computer interaction and an important part of artificial intelligence. The regulation of speech production organs causes differences in the acoustic features of the emotional speech signal, and thus different emotions are perceived. Traditional speech emotion recognition methods are only focused on classifying emotions based on acoustical features or auditory features, ignoring the important role of speech production directly related features such as glottal source waveform and vocal tract shape cues on emotion perception. In our previous study, the contributions of glottal source and vocal tract cues to the emotion perception in speech have been theoretically analyzed. However, the glottal source and vocal tract features have not been used for speech emotion recognition. Therefore, in this paper, we revisited the possibility of glottal source and vocal tract cues for speech emotion recognition from the point of view of speech production. Motivated by the source-filter model of speech production, we propose a new speech emotion recognition method based on the glottal source and vocal tract features. Firstly, the glottal source and vocal tract features were estimated simultaneously from emotional speech signals based on an analysis-bysynthesis approach with a source-filter model constructed of an Auto-Regressive eXogenous（ARX）model and the Liljencrants-Fant（LF）model. Then, the estimated glottal source and vocal tract features were fed into the Bidirectional Gated Recurrent Unit（BiGRU）network for the speech emotion recognition tasks. The emotion recognition verification were conducted on an public emotion dataset of interactive emotional dyadic motion capture database（IEMOCAP）, and the experimental results showed that the glottal source and vocal tract features could effectively distinguish the emotions, and the emotion recognition accuracy of the glottal source and vocal tract features is superior to that of traditional emotion features. This paper is focused on the advantages of the glottal source and vocal tract features that are directly used for speech emotion recognition, which provides new insight into speech emotion recognition technology.

Exploration of glottal characteristics and the vocal folds behavior for the speech under emotion

Contribution of Glottal Waveform in Speech Emotion: A Comparative Pairwise Investigation

Speech Emotion Recognition Based on Glottal Source and Vocal Tract Features

Comparison of Glottal Source Parameter Values in Emotional Vowels.

Mapping Emotions into Acoustic Space: the Role of Voice Quality.

Extracting Physiologically Relevant Parameters of Vocal Folds from High-Speed Video Image Series

An Experimental Study of Emotional Speech in Mandarin and English

Numerical Investigation of the Influence of Thyroarytenoid and Cricothyroid Muscle Contraction on the Geometry and Biomechanical Properties of the Vocal Folds

Within and Across-Language Comparison of Vocal Emotions in Mandarin and English

Investigation of the Relation Between Acoustic Features and Articulation — an Application to Emotional Speech Analysis

Emotional expressivity in singing. Assessing physiological and acoustic indicators of two opera singers' voice characteristics

Parameter Estimation of an Asymmetric Vocal-Fold System from Glottal Area Time Series Using Chaos Synchronization.

Speech-Based Parameter Estimation of an Asymmetric Vocal Fold Oscillation Model and Its Application in Discriminating Vocal Fold Pathologies

Empirical measurements of biomechanical anisotropy of the human vocal fold lamina propria

Analysis of the relationship between emotion intensity and electrophysiology parameters during a voice examination of opera singers

Comparison of Parametrization Methods of Electroglottographic and Inverse Filtered Acoustic Speech Pressure Signals in Distinguishing Between Phonation Types

Neural correlates of embodied and vibratory mechanisms associated with vocal emotion production

The Potential Role of Subglottal Convergence Angle and Measurement.

The Investigation of Formant on Different Artistic Voice

Prosody Conversion from Neutral Speech to Emotional Speech.

Pressure Distributions in Glottal Geometries With Multichannel Airflows