Abstract:Recognizing speech emotions is indeed a crucial aspect of human–computer interaction. However, developing a model that can accurately process multiple languages is one of the challenging tasks. The feature selection process plays a vital role in multilingual speech emotion recognition because it helps to reduce irrelevant features from each language, ultimately enhancing the performance of the model. This research aims to address this task in a more precise way. It achieves this by employing Grid Search based Principal Component Analysis and an ensemble voting classifier for multilingual speech emotion recognition. Here we mention three essential steps of recognizing emotion from a multilingual dataset. The first step involves feature extraction from speech signals, such as MFCC, root-mean-square, ZCR, flux, roll-off, Centroid, bandwidth, chroma, and fundamental frequency. The second step entails the selection of an essential feature subset by removing redundant and unnecessary features using Principal Component Analysis. We also utilize the Grid Search technique to determine the feature subset that would yield the highest accuracy. The third step encompasses SVM and Random Forest, that are widely recognized classifiers. Additionally, we propose an ensemble voting classifier. Our study compares the performance of these classifiers on three distinct corpora—RAVDESS, EMOVO, and SUBESCO with and without the feature selection strategy. The accuracy for RAVDESS EMOVO and SUBESCO dataset 74.30%, 79.66%, 87.64%, respectively. After comparing our proposed approach with other approaches mentioned in the literature survey, it became evident that our approach outperforms the rest.

MFCC Global Features Selection in Improving Speech Emotion Recognition Rate

Speech emotion recognition using combination of features

Scores Selection for Emotional Speaker Recognition

Speech Emotion Recognition Based on Syllable-Level Feature Extraction

Paralinguistic and spectral feature extraction for speech emotion classification using machine learning techniques

Evaluating Gammatone Frequency Cepstral Coefficients with Neural Networks for Emotion Recognition from Speech

Speaker-independent Speech Emotion Recognition Based on Random Forest Feature Selection Algorithm

Feature extraction algorithms to improve the speech emotion recognition rate

Speech emotion recognition using a novel feature set

GCF2-Net: global-aware cross-modal feature fusion network for speech emotion recognition

Statistical Feature Selection for Mandarin Speech Emotion Recognition

Features extraction and selection for emotional speech classification

Feature Selection for Emotion Recognition of Mandarin Speech

DNN-HMM based Speaker Adaptive Emotion Recognition using Proposed Epoch and MFCC Features

MFCC in audio signal processing for voice disorder: a review

A New Fuzzy Cognitive Map Learning Algorithm for Speech Emotion Recognition

Fusion Of Global Statistical And Segmental Spectral Features For Speech Emotion Recognition

Extraction of Novel Features for Emotion Recognition

Exploiting the potentialities of features for speech emotion recognition

An Improved MSER using Grid Search based PCA and Ensemble Voting Technique

Speech emotion recognition using multimodal feature fusion with machine learning approach