Abstract:Speech emotion recognition (SER) tasks are conducted to extract emotional features from speech signals. The characteristic parameters are analyzed, and the speech emotional states are judged. At present, SER is an important aspect of artificial psychology and artificial intelligence, as it is widely implemented in many applications in the human-computer interface, medical, and entertainment fields. In this work, six transforms, namely, the synchrosqueezing transform, fractional Stockwell transform (FST), K-sine transform-dependent integrated system (KSTDIS), flexible analytic wavelet transform (FAWT), chirplet transform, and superlet transform, are initially applied to speech emotion signals. Once the transforms are applied and the features are extracted, the essential features are selected using three techniques: the Overlapping Information Feature Selection (OIFS) technique followed by two biomimetic intelligence-based optimization techniques, namely, Harris Hawks Optimization (HHO) and the Chameleon Swarm Algorithm (CSA). The selected features are then classified with the help of ten basic machine learning classifiers, with special emphasis given to the extreme learning machine (ELM) and twin extreme learning machine (TELM) classifiers. An experiment is conducted on four publicly available datasets, namely, EMOVO, RAVDESS, SAVEE, and Berlin Emo-DB. The best results are obtained as follows: the Chirplet + CSA + TELM combination obtains a classification accuracy of 80.63% on the EMOVO dataset, the FAWT + HHO + TELM combination obtains a classification accuracy of 85.76% on the RAVDESS dataset, the Chirplet + OIFS + TELM combination obtains a classification accuracy of 83.94% on the SAVEE dataset, and, finally, the KSTDIS + CSA + TELM combination obtains a classification accuracy of 89.77% on the Berlin Emo-DB dataset.

Speech Emotion Recognition Using openSMILE and GPT 3.5 Transformer

Self-attention Transfer Networks for Speech Emotion Recognition

Speech Emotion Recognition Using Deep Neural Networks, Transfer Learning, and Ensemble Classification Techniques

Improving Computer Assisted Speech Therapy Through Speech Based Emotion Recognition

Emotion-Aware Transformer Encoder for Empathetic Dialogue Generation

Personalized Speech Emotion Recognition in Human-Robot Interaction using Vision Transformers

Transformer Based Multimodal Speech Emotion Recognition with Improved Neural Networks

Emotion Classification In Software Engineering Texts: A Comparative Analysis of Pre-trained Transformers Language Models

Modulated Fusion using Transformer for Linguistic-Acoustic Emotion Recognition

Dawn of the transformer era in speech emotion recognition: closing the valence gap

Transformer based neural networks for emotion recognition in conversations

A Methodical Framework Utilizing Transforms and Biomimetic Intelligence-Based Optimization with Machine Learning for Speech Emotion Recognition

EmT: A Novel Transformer for Generalized Cross-subject EEG Emotion Recognition

Speech Emotion Recognition Using Mel-Frequency Cepstral Coefficients & Convolutional Neural Networks

MelTrans: Mel-Spectrogram Relationship-Learning for Speech Emotion Recognition via Transformers

A Comparison of Machine Learning Algorithms and Feature Sets for Automatic Vocal Emotion Recognition in Speech

Speech Emotion Recognition Using Deep Learning

Multi-Scale Temporal Transformer For Speech Emotion Recognition

Silent Speech and Emotion Recognition from Vocal Tract Shape Dynamics in Real-Time MRI

Emotion Recognition System from Speech and Visual Information based on Convolutional Neural Networks

Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models