Abstract:The Speech Emotion Recognition (SER) algorithm, which aims to analyze the expressed emotion from a speech, has always been an important topic in speech acoustic tasks. In recent years, the application of deep-learning methods has made great progress in SER. However, the small scale of the emotional speech dataset and the lack of effective emotional feature representation still limit the development of research. In this paper, a novel SER method, combining data augmentation, feature selection and feature fusion, is proposed. First, aiming at the problem that there are inadequate samples in the speech emotion dataset and the number of samples in each category is unbalanced, a speech data augmentation method, Mix-wav, is proposed which is applied to the audio of the same emotion category. Then, on the one hand, a Multi-Head Attention mechanism-based Convolutional Recurrent Neural Network (MHA-CRNN) model is proposed to further extract the spectrum vector from the Log-Mel spectrum. On the other hand, Light Gradient Boosting Machine (LightGBM) is used for feature set selection and feature dimensionality reduction in four emotion global feature sets, and more effective emotion statistical features are extracted for feature fusion with the previously extracted spectrum vector. Experiments are carried out on the public dataset Interactive Emotional Dyadic Motion Capture (IEMOCAP) and Chinese Hierarchical Speech Emotion Dataset of Broadcasting (CHSE-DB). The experiments show that the proposed method achieves 66.44% and 93.47% of the unweighted average test accuracy, respectively. Our research shows that the global feature set after feature selection can supplement the features extracted by a single deep-learning model through feature fusion to achieve better classification accuracy.

Hybridizing Information Gain and Harmony Search for Feature Selection on Speech Emotion

Hybrid Network Feature Extraction for Depression Assessment from Speech

Multi-Objective Equilibrium Optimizer for Feature Selection in High-Dimensional English Speech Emotion Recognition

Deep Spectrum Feature Representations for Speech Emotion Recognition

Survey on Discriminative Feature Selection for Speech Emotion Recognition

Speech Emotion Recognition Based on Feature Selection and Extreme Learning Machine Decision Tree

Feature selection for fast speech emotion recognition.

A feature selection model for speech emotion recognition using clustering-based population generation with hybrid of equilibrium optimizer and atom search optimization algorithm

Speech Emotion Recognition Based on Linear Discriminant Analysis and Support Vector Machine Decision Tree

Combining Feature Selection And Representation For Speech Emotion Recognition

Speech Emotion Recognition Based on a Fusion of All-Class and Pairwise-Class Feature Selection

Feature Selection for Emotion Recognition of Mandarin Speech

Speaker-independent Speech Emotion Recognition Based on Random Forest Feature Selection Algorithm

Adaptive Algorithm for Feature Selection of Speech Emotion Recognition Based on Genetic Algorithm and SVM

Feature selection enhancement and feature space visualization for speech-based emotion recognition

Emotional feature selection of speaker-independent speech based on correlation analysis and Fisher

Statistical Feature Selection for Mandarin Speech Emotion Recognition

Decision tree SVM model with Fisher feature selection for speech emotion recognition

Exploiting the potentialities of features for speech emotion recognition

A Feature Fusion Model with Data Augmentation for Speech Emotion Recognition

Visual-Audio Emotion Recognition Based on Multi-Task and Ensemble Learning with Multiple Features