Abstract:Automatically detecting emotional state in human speech, which plays an effective role in areas of human machine interactions, has been a difficult task for machine learning algorithms. Previous work for emotion recognition have mostly focused on the extraction of carefully hand-crafted and tailored features. Recently, spectrogram representations of emotion speech have achieved competitive performance for automatic speech emotion recognition. In this work we propose a method to tackle the problem of deep features, herein denoted as deep spectrum features, extraction from the spectrogram by leveraging Attention-based Bidirectional Long Short-Term Memory Recurrent Neural Networks with fully convolutional networks. The learned deep spectrum features are then fed into a deep neural network (DNN) to predict the final emotion. The proposed model is then evaluated on the Interactive Emotional Dyadic Motion Capture (IEMOCAP) dataset to validate its effectiveness. Promising results indicate that our deep spectrum representations extracted from the proposed model perform the best, 65.2% for weighted accuracy and 68.0% for unweighted accuracy when compared to other existing methods. We then compare the performance of our deep spectrum features with two standard acoustic feature representations for speech-based emotion recognition. When combined with a support vector classifier, the performance of the deep feature representations extracted are comparable with the conventional features. Moreover, we also investigate the impact of different frequency resolutions of the input spectrogram on the performance of the system.

Feature Selection and Feature Learning in Arousal Dimension of Music Emotion by Using Shrinkage Methods

Using Psychophysiologicalmeasures to Recognize Personalmusic Emotional Experience

Learning Music Emotion Primitives via Supervised Dynamic Clustering.

Human-centric Music Medical Therapy Exploration System

Emotion-Driven Chinese Folk Music-Image Retrieval Based on De-Svm

Feature Selection Approaches for Optimising Music Emotion Recognition Methods

A New Fuzzy Classifier For Music Emotion Based On Conditional Probability

Deep Spectrum Feature Representations for Speech Emotion Recognition

Digital Empirical Research of Influencing Factors of Musical Emotion Classification Based on Pleasure-Arousal Musical Emotion Fuzzy Model

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Correlation-Based Feature Selection And Regression

User-Adaptive Music Emotion Recognition

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

ADFF: Attention Based Deep Feature Fusion Approach for Music Emotion Recognition

Study on Linguistic Computing for Music Emotion

A Regression Approach to Categorical Music Emotion Recognition

Automatic ECG-Based Emotion Recognition in Music Listening

Exploring User Emotion in Microblogs for Music Recommendation.

Speaker-independent Speech Emotion Recognition Based on Random Forest Feature Selection Algorithm

Music Emotion Prediction Using Recurrent Neural Networks

Effects of Individual Factors on Perceived Emotion and Felt Emotion of Music: Based on Machine Learning Methods