Abstract:In sophisticated Human-Computer Interfaces (HCI), the emotional state of the user is becoming a crucial component that is closely linked to emotional speech recognition. Spoken expressions, which can be a part of human-machine interaction, are an important source of emotional information. Speech emotion recognition (SER) in deep learning (DL) continues to be a hot topic, especially in the field of emotional computing. Current deep learning (DL) and neural network methods are applied in this highly active field of research. This is as a result of its expanding potential, advancements in algorithms, and practical uses. Quantitative factors such as pitch, intensity, accent and Mel-Frequency Cepstral Coefficients (MFCC) can be employed to model the paralinguistic data contained in human speech. To achieve SER, three key procedures are usually followed: data processing, feature selection/extraction, and classification based on the underlying emotional qualities. The nature of these processes and the peculiarities of human speech lend support to the employment of DL techniques for SER implementation. A variety of DL methods have been used for SER tasks in recent affective computing research works; however, only a small number of them capture the underlying ideas and methodologies that can be used to facilitate the three main steps of SER implementation. With a focus on the three SER implementation processes, we provide a state-of-the-art assessment of research conducted over the last ten years that tackled SER tasks from DL perspectives in this work. Various issues are covered in detail, including the problem of low classification accuracy of Speaker-Independent experiments and the related remedies. The review offers principles for SER evaluation as well, emphasizing indicators that can be experimented with and common baselines.

An ongoing review of speech emotion recognition

A Comprehensive Review of Speech Emotion Recognition Systems

A State-of-arts Review of Deep Learning Techniques for Speech Emotion Recognition

Self-attention Transfer Networks for Speech Emotion Recognition

Speech Emotion Recognition Systems: A Comprehensive Review on Different Methodologies

A Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

Speech emotion recognition approaches in human computer interaction

Speech Emotion Recognition Based on Formant Characteristics Feature Extraction and Phoneme Type Convergence.

A Hybrid Time-Distributed Deep Neural Architecture for Speech Emotion Recognition

Development of Techniques for Speech Emotion Recognition (SER) In the Context of Deep Learning

Speech Emotion Recognition Based on Convolutional Neural Network with Attention-Based Bidirectional Long Short-Term Memory Network and Multi-Task Learning

A survey of speech emotion recognition in human computer interaction

EMO-SUPERB: An In-depth Look at Speech Emotion Recognition

Deep Cross-Corpus Speech Emotion Recognition: Recent Advances and Perspectives

Speech Emotion Recognition Using Convolutional Neural Networks with Attention Mechanism

Speech Emotion Recognition: A Comprehensive Survey

A Comparison of Machine Learning Algorithms and Feature Sets for Automatic Vocal Emotion Recognition in Speech

Speech emotion recognition via graph-based representations

Improved Speech Emotion Classification Using Deep Neural Network