Abstract:The paper presents an emotional speech recognition system with the analysis of manifolds of speech. Working with large volumes of high-dimensio nal acoustic features, the researchers confront the problem of dimensionality reduction. Unlike classical techniques, such as Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA), a new approach, named Enhanced Lipschitz Embedding (ELE) is proposed in the paper to discover the nonlinear degrees of freedom that underlie the emotional speech corpus. ELE adopts geodesic distance to preserve the intrinsic geometry at all scales of speech corpus. Based on geodesic distance estimation, ELE embeds the 64-dimensional acoustic features into a six-dimensional space in which speech data with the same emotional state are generally clustered around one plane and the data distribution feature is beneficial to emotion classification. The compressed testing data is classified into six emotional states (neutral, anger, fear, happiness, sadness and surprise) by a trained linear Support Vector Machine (SVM) system. Considering the perception constancy of humans, ELE is also investigated in terms of its ability to detect the intrinsic geometry of emotional speech corrupted by noise. The performance of the new approach is compared with the methods of feature selection by Sequential Forward Selection (SFS), PCA, LDA, Isomap and Locally Linear Embedding (LLE). Experimental results demonstrate that, compared with other methods, the proposed system gives 9%-26% relative improvement in speaker-indep endent emotion recognition and 5%-20% improvement in speaker-dependent recognition. Meanwhile, the proposed system shows robustness and an improvement of approximately 10% in emotion recognition accuracy when speech is corrupted by increasing noise.

Prediction of Emotional Dimensions PAD for Emotional Speech Recognition

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Dynamic Facial Features in Positive-Emotional Speech for Identification of Depressive Tendencies

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Analysis and Modeling of Affective Audio Visual Speech Based on PAD Emotion Space

Reduce the dimensions of emotional features by principal component analysis for speech emotion recognition

A New Learning Scheme of Emotion Recognition From Speech by Using Mean Fourier Parameters

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

Feature Selection for Emotion Recognition of Mandarin Speech

Relevance Units Machine Based Dimensional and Continuous Speech Emotion Prediction

Speech emotion recognition using PCA-based spectral features and HMM

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Speech Emotion Recognition Study Based on Short-term and Long-term Features

Manifolds Based Emotion Recognition in Speech.

A Combined Cepstral Distance Method for Emotional Speech Recognition

Affective Voice Interaction and Artificial Intelligence: A Research Study on the Acoustic Features of Gender and the Emotional States of the PAD Model

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Emotion Recognition From Noisy Speech

Prominence Features: Effective Emotional Features for Speech Emotion Recognition.

Emotional Audio-Visual Speech Synthesis Based on PAD

Automatic speech discrete labels to dimensional emotional values conversion method.