Abstract:In this paper, we introduce an innovative investigation in speech emotion recognition (SER). The proposed model combines deep learning-based and handcrafted audio features to achieve optimal accuracy. The proposed model employs an iterative feature selection and majority voting pipeline to obtain better results by fusing deep learning-based and handcrafted features. The wav2vec2 model and the openSmile audio processing library are used in order to extract audio features from audio data. Then the feature selection and majority voting techniques are used to identify the optimal feature selection methods for diverse feature sets and to combine their strengths. The experiments are performed using a diverse and extensive corpus to ensure the robustness of the proposed method. In the construction of this multi-corpus dataset, we used four well-known benchmark datasets, namely Ravdess, Savee, Crema-D, and Tess. All of these datasets are publicly available. These datasets are combined on six common emotions: sadness, happiness, fear, anger, surprise, and disgust. The resultant dataset comprises 11,511 samples across these categories. The proposed method has been shown to achieve results comparable to those reported in the existing literature. The experimental results indicate that the proposed pipeline leads to a 3 % improvement in classification accuracy. The highest achieved accuracy on the multi-corpus dataset is 92.55 %.

Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech dataset

SER_AMPEL: a multi-source dataset for speech emotion recognition of Italian older adults

Real-Time Svm-Based Emotion Recognition Algorithm

Semi-supervised cross-lingual speech emotion recognition

Speaker-Independent Speech Emotion Recognition Based On Cnn-Blstm And Multiple Svms

Speaker to Emotion: Domain Adaptation for Speech Emotion Recognition with Residual Adapters.

Speech Emotion Recognition Based on Meta-Transfer Learning with Domain Adaption

Is Everything Fine, Grandma? Acoustic and Linguistic Modeling for Robust Elderly Speech Emotion Recognition

Cross-Corpus Speech Emotion Recognition Based on Hybrid Neural Networks

Speech Emotion Recognition Based on Convolutional Neural Network with Attention-Based Bidirectional Long Short-Term Memory Network and Multi-Task Learning

Cross-Lingual Cross-Age Group Adaptation for Low-Resource Elderly Speech Emotion Recognition

Embedded Emotions -- A Data Driven Approach to Learn Transferable Feature Representations from Raw Speech Input for Emotion Recognition

Speech emotion recognition via graph-based representations

Cross lingual speech emotion recognition via triple attentive asymmetric convolutional neural network

Unsupervised Cross-Lingual Speech Emotion Recognition Using DomainAdversarial Neural Network

Enhancing speech emotion recognition through deep learning and handcrafted feature fusion

Domain adaptive dual-relaxation regression for speech emotion recognition

Multilingual Speech Emotion Recognition With Multi-Gating Mechanism and Neural Architecture Search

Multi-Path and Group-Loss-Based Network for Speech Emotion Recognition in Multi-Domain Datasets

Unsupervised Cross-Corpus Speech Emotion Recognition Using Domain-Adaptive Subspace Learning

Towards Interpretable and Transferable Speech Emotion Recognition: Latent Representation Based Analysis of Features, Methods and Corpora