Abstract:The paper presents an emotional speech recognition system with the analysis of manifolds of speech. Working with large volumes of high-dimensio nal acoustic features, the researchers confront the problem of dimensionality reduction. Unlike classical techniques, such as Principal Component Analysis (PCA) and Linear Discriminant Analysis (LDA), a new approach, named Enhanced Lipschitz Embedding (ELE) is proposed in the paper to discover the nonlinear degrees of freedom that underlie the emotional speech corpus. ELE adopts geodesic distance to preserve the intrinsic geometry at all scales of speech corpus. Based on geodesic distance estimation, ELE embeds the 64-dimensional acoustic features into a six-dimensional space in which speech data with the same emotional state are generally clustered around one plane and the data distribution feature is beneficial to emotion classification. The compressed testing data is classified into six emotional states (neutral, anger, fear, happiness, sadness and surprise) by a trained linear Support Vector Machine (SVM) system. Considering the perception constancy of humans, ELE is also investigated in terms of its ability to detect the intrinsic geometry of emotional speech corrupted by noise. The performance of the new approach is compared with the methods of feature selection by Sequential Forward Selection (SFS), PCA, LDA, Isomap and Locally Linear Embedding (LLE). Experimental results demonstrate that, compared with other methods, the proposed system gives 9%-26% relative improvement in speaker-indep endent emotion recognition and 5%-20% improvement in speaker-dependent recognition. Meanwhile, the proposed system shows robustness and an improvement of approximately 10% in emotion recognition accuracy when speech is corrupted by increasing noise.

EmoEars: an emotion recognition system for mandarin speech

Emotional Speech Clustering Based Robust Speaker Recognition System

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Emotional speaker recognition based on similar neighbor phenomenon

Cost-Sensitive Learning for Emotion Robust Speaker Recognition

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Mandarin Emotion Recognition Combining Acoustic and Emotional Point Information

Emotion Recognition and Conversion for Mandarin Speech

Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features

Construction and Evaluation of Mandarin Multimodal Emotional Speech Database

Emotion Recognition via Continuous Mandarin Speech

Statistical Feature Selection for Mandarin Speech Emotion Recognition

Affect-insensitive Speaker Recognition Systems Via Emotional Speech Clustering Using Prosodic Features

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model

Attention Based Fully Convolutional Network for Speech Emotion Recognition

Manifolds Based Emotion Recognition in Speech.

A Combined Cepstral Distance Method for Emotional Speech Recognition

MASC: A Speech Corpus in Mandarin for Emotion Analysis and Affective Speaker Recognition

EEG-based Emotion Recognition in Chinese Emotional Words