Abstract:Automatically detecting emotional state in human speech, which plays an effective role in areas of human machine interactions, has been a difficult task for machine learning algorithms. Previous work for emotion recognition have mostly focused on the extraction of carefully hand-crafted and tailored features. Recently, spectrogram representations of emotion speech have achieved competitive performance for automatic speech emotion recognition. In this work we propose a method to tackle the problem of deep features, herein denoted as deep spectrum features, extraction from the spectrogram by leveraging Attention-based Bidirectional Long Short-Term Memory Recurrent Neural Networks with fully convolutional networks. The learned deep spectrum features are then fed into a deep neural network (DNN) to predict the final emotion. The proposed model is then evaluated on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset to validate its effectiveness. Promising results indicate that our deep spectrum representations extracted from the proposed model perform the best, 65.2% for weighted accuracy and 68.0% for unweighted accuracy when compared to other existing methods. We then compare the performance of our deep spectrum features with two standard acoustic feature representations for speech-based emotion recognition. When combined with a support vector classifier, the performance of the deep feature representations extracted are comparable with the conventional features. Moreover, we also investigate the impact of different frequency resolutions of the input spectrogram on the performance of the system.

Rules Based Feature Modification for Affective Speaker Recognition

Pitch envelope based frame level score reweighed algorithm for emotion robust speaker recognition.

Emotion-State conversion for speaker recognition

Emotional Speech Clustering Based Robust Speaker Recognition System

Cost-Sensitive Learning for Emotion Robust Speaker Recognition

Emotional speaker recognition based on similar neighbor phenomenon

Scores Selection for Emotional Speaker Recognition

Learning Polynomial Function Based Neutral-Emotion Gmm Transformation For Emotional Speaker Recognition

Affect-Insensitive Speaker Recognition by Feature Variety Training

Deep Spectrum Feature Representations for Speech Emotion Recognition

A Preliminary Study on GMM Weight Transformation for Emotional Speaker Recognition

Improving Speaker Recognition by Training on Emotion-Added Models

Affect-insensitive Speaker Recognition Systems Via Emotional Speech Clustering Using Prosodic Features

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

SEC-GAN for robust speaker recognition with emotional state dismatch

Research on Modeling Method of Emotional Speech Recognition

Mismatched Feature Detection with Finer Granularity for Emotional Speaker Recognition.

Emotion-Detecting Based Model Selection For Emotional Speech Recognition

Exploiting the potentialities of features for speech emotion recognition

Multi-level Feature Joint Learning Methods for Emotional Speaker Recognition

From Simulated Speech To Natural Speech, What Are The Robust Features For Emotion Recognition?