Abstract:Automatically detecting emotional state in human speech, which plays an effective role in areas of human machine interactions, has been a difficult task for machine learning algorithms. Previous work for emotion recognition have mostly focused on the extraction of carefully hand-crafted and tailored features. Recently, spectrogram representations of emotion speech have achieved competitive performance for automatic speech emotion recognition. In this work we propose a method to tackle the problem of deep features, herein denoted as deep spectrum features, extraction from the spectrogram by leveraging Attention-based Bidirectional Long Short-Term Memory Recurrent Neural Networks with fully convolutional networks. The learned deep spectrum features are then fed into a deep neural network (DNN) to predict the final emotion. The proposed model is then evaluated on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset to validate its effectiveness. Promising results indicate that our deep spectrum representations extracted from the proposed model perform the best, 65.2% for weighted accuracy and 68.0% for unweighted accuracy when compared to other existing methods. We then compare the performance of our deep spectrum features with two standard acoustic feature representations for speech-based emotion recognition. When combined with a support vector classifier, the performance of the deep feature representations extracted are comparable with the conventional features. Moreover, we also investigate the impact of different frequency resolutions of the input spectrogram on the performance of the system.

Application of Improved Spectral Subtraction Algorithm for Speech Emotion Recognition

Deep Spectrum Feature Representations for Speech Emotion Recognition

Applying difference detection and pruning to emotional speaker recognition

Emotional Speech Clustering Based Robust Speaker Recognition System

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

Research on Robustness of Emotion Recognition under Environmental Noise Conditions

Speaker-independent Speech Emotion Recognition Based on Random Forest Feature Selection Algorithm

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Feature extraction algorithms to improve the speech emotion recognition rate

Spectrogram feature extraction algorithm for speech emotion recognition

Speech enhancement based on improved spectral subtraction algorithm

Novel Sub-band Spectral Centroid Weighted Wavelet Packet Features with Importance-Weighted Support Vector Machines for Robust Speech Emotion Recognition

Research of Speech-Sound Enhancement Based on Improved Spectral Subtraction Algorithm

Speech Emotion Recognition Based on EMD in Noisy Environments

Paralinguistic and spectral feature extraction for speech emotion classification using machine learning techniques

Robust Speech Emotion Recognition with Novel Sub-Band Spectral Centroid Weighted Wavelet Packet Feature

Research on the Application of Speech Database based on Emotional Feature Extraction in International Chinese Education and Teaching

Research on Speech Recognition Methods Based on Spectral Subtraction and Improved BP Neural Network Algorithm