Abstract:The Speech Emotion Recognition (SER) algorithm, which aims to analyze the expressed emotion from a speech, has always been an important topic in speech acoustic tasks. In recent years, the application of deep-learning methods has made great progress in SER. However, the small scale of the emotional speech dataset and the lack of effective emotional feature representation still limit the development of research. In this paper, a novel SER method, combining data augmentation, feature selection and feature fusion, is proposed. First, aiming at the problem that there are inadequate samples in the speech emotion dataset and the number of samples in each category is unbalanced, a speech data augmentation method, Mix-wav, is proposed which is applied to the audio of the same emotion category. Then, on the one hand, a Multi-Head Attention mechanism-based Convolutional Recurrent Neural Network (MHA-CRNN) model is proposed to further extract the spectrum vector from the Log-Mel spectrum. On the other hand, Light Gradient Boosting Machine (LightGBM) is used for feature set selection and feature dimensionality reduction in four emotion global feature sets, and more effective emotion statistical features are extracted for feature fusion with the previously extracted spectrum vector. Experiments are carried out on the public dataset Interactive Emotional Dyadic Motion Capture (IEMOCAP) and Chinese Hierarchical Speech Emotion Dataset of Broadcasting (CHSE-DB). The experiments show that the proposed method achieves 66.44% and 93.47% of the unweighted average test accuracy, respectively. Our research shows that the global feature set after feature selection can supplement the features extracted by a single deep-learning model through feature fusion to achieve better classification accuracy.

Mongolian Emotional Speech Synthesis Based on Transfer Learning and Emotional Embedding

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Semi-Supervised Learning for Robust Emotional Speech Synthesis with Limited Data

MsEmoTTS: Multi-scale emotion transfer, prediction, and control for emotional speech synthesis

Fine-Grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesis

Speech Synthesis with Mixed Emotions

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Controllable Multi-Speaker Emotional Speech Synthesis with Emotion Representation of High Generalization Capability

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Synthesis of emotional speech based on prosody parameters

Emotional Audio-Visual Speech Synthesis Based on PAD

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model

Emotional speech synthesis with rich and granularized control

MM-TTS: A Unified Framework for Multimodal, Prompt-Induced Emotional Text-to-Speech Synthesis

EMOTION CONTROLLABLE SPEECH SYNTHESIS USING EMOTION-UNLABELED DATASET WITH THE ASSISTANCE OF CROSS-DOMAIN SPEECH EMOTION RECOGNITION

Emo-Tts:Parallel Transformer-based Text-to-Speech Model with Emotional Awareness

Exemplar-Based Emotive Speech Synthesis

End-to-End Mongolian Text-to-Speech System

A Feature Fusion Model with Data Augmentation for Speech Emotion Recognition

Expressive Speech Driven Talking Avatar Synthesis with DBLSTM Using Limited Amount of Emotional Bimodal Data

Mongolian Text-to-Speech System Based on Deep Neural Network