Abstract:In the realm of consumer technology, Artificial Intelligence (AI)-based Speech Emotion Recognition (SER) has rapidly gained traction and integration into smart home systems. Its precision in recognition has become a pivotal factor significantly impacting user experience. However, the intricate task of selecting suitable features has emerged as a daunting challenge due to the variances in speech features induced by emotional nuances. Present research predominantly concentrates on localized speech characteristics, neglecting the broader contextual cues inherent in speech signals. This oversight contributes to relatively diminished accuracy in emotion recognition within smart home systems. To tackle this challenge, this paper introduces an enhanced Speech Emotion Recognition approach named TF-Mix. This methodology enriches emotional prediction from speech by leveraging audio data augmentation and embracing multiple features, thereby achieving superior performance in emotion recognition. To augment the model's adaptability, TF-Mix adeptly amalgamates various feature extraction techniques, encompassing Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), and Transformer architecture. The synergy among these methodologies culminates in the formulation of three distinct architectural models. The primary architecture is founded on a 1-dimensional Convolutional Neural Network (CNN), closely followed by a Fully Connected Network (FCN). Subsequent architectures, notably BiLSTM-FCN and BiLSTM-Transformer-FCN, retain their respective structures while incorporating CNNs. Moreover, the amalgamation of individual models into an ensemble model, designated as D, via weighted averaging, further amplifies the efficacy of emotion recognition. Experimental outcomes showcase exceptional performance across all four models in the SER task. The ensemble Model D achieves noteworthy accuracy across multiple datasets: 87.513% on RAVDESS, 86.233% on SAVEE, 99.857% on TESS, 82.295% on CREMA-D, and 97.546% on the TOTAL dataset.

A Method of Privacy-Friendly Gait Date Acquisition and Emotion Recognition

A Multi-Head Pseudo Nodes Based Spatial–temporal Graph Convolutional Network for Emotion Perception from GAIT

G-GCSN: Global Graph Convolution Shrinkage Network for Emotion Perception from Gait

Real-Time Svm-Based Emotion Recognition Algorithm

Cgan Based Facial Expression Recognition for Human-Robot Interaction

Emotion Recognition From Gait Analyses: Current Research and Future Directions

Human Gait Recognition Based on Frame-by-Frame Gait Energy Images and Convolutional Long Short-Term Memory

Human Gait Recognition Based on Self-Adaptive Hidden Markov Model

Emotion Recognition via Environmental Context and Human Body

Motion Gait: Gait Recognition via Motion Excitation

Non-local Gait Feature Extraction and Human Identification

Multi-User Activity Recognition In A Smart Home

Identifying Emotion from Natural Walking

Research on Human Behavior Intention Perception Method Based on Wearable Sensors

Looking into Gait for Perceiving Emotions via Bilateral Posture and Movement Graph Convolutional Networks

ST-Gait++: Leveraging spatio-temporal convolutions for gait-based emotion recognition on videos

Hierarchical-Attention-Based Neural Network for Gait Emotion Recognition

GaitFFDA: Feature Fusion and Dual Attention Gait Recognition Model

Recognizing Multi-User Activities Using Wearable Sensors in a Smart Home

On Learning Disentangled Representations for Gait Recognition

Design of smart home system speech emotion recognition model based on ensemble deep learning and feature fusion