Abstract:Automatically detecting emotional state in human speech, which plays an effective role in areas of human machine interactions, has been a difficult task for machine learning algorithms. Previous work for emotion recognition have mostly focused on the extraction of carefully hand-crafted and tailored features. Recently, spectrogram representations of emotion speech have achieved competitive performance for automatic speech emotion recognition. In this work we propose a method to tackle the problem of deep features, herein denoted as deep spectrum features, extraction from the spectrogram by leveraging Attention-based Bidirectional Long Short-Term Memory Recurrent Neural Networks with fully convolutional networks. The learned deep spectrum features are then fed into a deep neural network (DNN) to predict the final emotion. The proposed model is then evaluated on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset to validate its effectiveness. Promising results indicate that our deep spectrum representations extracted from the proposed model perform the best, 65.2% for weighted accuracy and 68.0% for unweighted accuracy when compared to other existing methods. We then compare the performance of our deep spectrum features with two standard acoustic feature representations for speech-based emotion recognition. When combined with a support vector classifier, the performance of the deep feature representations extracted are comparable with the conventional features. Moreover, we also investigate the impact of different frequency resolutions of the input spectrogram on the performance of the system.

Recognition of Word Emotion State in Sentences

Emotion-State conversion for speaker recognition

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Deep Spectrum Feature Representations for Speech Emotion Recognition

MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Fuzzy speech emotion recognition considering semantic awareness

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Emotion Recognition via Environmental Context and Human Body

Real-time Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Emotion Recognition under Consideration of the Emotion Component Process Model

Weighting Assessment of the Effect of Chinese State-Changing Words on Emotions

How Speech is Recognized to Be Emotional - A Study Based on Information Decomposition

Emotion Neural Transducer for Fine-Grained Speech Emotion Recognition

Speech Emotion Recognition And Intensity Estimation

Spontaneous Speech Emotion Recognition Using Multiscale Deep Convolutional LSTM

A multi-modal and multi-scale emotion-enhanced inference model based on fuzzy recognition

CTSM: Combining Trait and State Emotions for Empathetic Response Model

Speech Emotion Recognition Based on Acoustic Segment Model.

EEG-SCMM: Soft Contrastive Masked Modeling for Cross-Corpus EEG-Based Emotion Recognition