Abstract:The Speech Emotion Recognition (SER) algorithm, which aims to analyze the expressed emotion from a speech, has always been an important topic in speech acoustic tasks. In recent years, the application of deep-learning methods has made great progress in SER. However, the small scale of the emotional speech dataset and the lack of effective emotional feature representation still limit the development of research. In this paper, a novel SER method, combining data augmentation, feature selection and feature fusion, is proposed. First, aiming at the problem that there are inadequate samples in the speech emotion dataset and the number of samples in each category is unbalanced, a speech data augmentation method, Mix-wav, is proposed which is applied to the audio of the same emotion category. Then, on the one hand, a Multi-Head Attention mechanism-based Convolutional Recurrent Neural Network (MHA-CRNN) model is proposed to further extract the spectrum vector from the Log-Mel spectrum. On the other hand, Light Gradient Boosting Machine (LightGBM) is used for feature set selection and feature dimensionality reduction in four emotion global feature sets, and more effective emotion statistical features are extracted for feature fusion with the previously extracted spectrum vector. Experiments are carried out on the public dataset Interactive Emotional Dyadic Motion Capture (IEMOCAP) and Chinese Hierarchical Speech Emotion Dataset of Broadcasting (CHSE-DB). The experiments show that the proposed method achieves 66.44% and 93.47% of the unweighted average test accuracy, respectively. Our research shows that the global feature set after feature selection can supplement the features extracted by a single deep-learning model through feature fusion to achieve better classification accuracy.

A Speech Emotion Recognition Framework for Better Discrimination of Confusions

Attention-Enhanced Connectionist Temporal Classification for Discrete Speech Emotion Recognition

Speech Emotion Recognition Based on Convolutional Neural Network with Attention-Based Bidirectional Long Short-Term Memory Network and Multi-Task Learning

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

Self-attention Transfer Networks for Speech Emotion Recognition

Speech Emotion Recognition by Combining a Unified First-Order Attention Network with Data Balance

Speech emotion recognition based on emotion perception

Speech Emotion Recognition Based on Formant Characteristics Feature Extraction and Phoneme Type Convergence.

Speech Emotion Recognition Based on Clustering Assistance

Speech Emotion Recognition Method Based on Cross-Layer Intersectant Fusion

Improve Accuracy of Speech Emotion Recognition with Attention Head Fusion

Head Fusion: Improving the Accuracy and Robustness of Speech Emotion Recognition on the IEMOCAP and RAVDESS Dataset

Speech Emotion Recognition Exploiting ASR-based and Phonological Knowledge Representations.

Towards Discriminative Representation Learning for Speech Emotion Recognition

Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition

Improving Pre-trained Model-based Speech Emotion Recognition from a Low-level Speech Feature Perspective

MF-AED-AEC: Speech Emotion Recognition by Leveraging Multimodal Fusion, Asr Error Detection, and Asr Error Correction

Speech Emotion Recognition Using Dual-Stream Representation and Cross-Attention Fusion

Speech Emotion Recognition with Multi-level Acoustic and Semantic Information Extraction and Interaction

A Discriminative Feature Representation Method Based on Cascaded Attention Network With Adversarial Strategy for Speech Emotion Recognition

A Feature Fusion Model with Data Augmentation for Speech Emotion Recognition