Abstract:In the realm of consumer technology, Artificial Intelligence (AI)-based Speech Emotion Recognition (SER) has rapidly gained traction and integration into smart home systems. Its precision in recognition has become a pivotal factor significantly impacting user experience. However, the intricate task of selecting suitable features has emerged as a daunting challenge due to the variances in speech features induced by emotional nuances. Present research predominantly concentrates on localized speech characteristics, neglecting the broader contextual cues inherent in speech signals. This oversight contributes to relatively diminished accuracy in emotion recognition within smart home systems. To tackle this challenge, this paper introduces an enhanced Speech Emotion Recognition approach named TF-Mix. This methodology enriches emotional prediction from speech by leveraging audio data augmentation and embracing multiple features, thereby achieving superior performance in emotion recognition. To augment the model's adaptability, TF-Mix adeptly amalgamates various feature extraction techniques, encompassing Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), and Transformer architecture. The synergy among these methodologies culminates in the formulation of three distinct architectural models. The primary architecture is founded on a 1-dimensional Convolutional Neural Network (CNN), closely followed by a Fully Connected Network (FCN). Subsequent architectures, notably BiLSTM-FCN and BiLSTM-Transformer-FCN, retain their respective structures while incorporating CNNs. Moreover, the amalgamation of individual models into an ensemble model, designated as D, via weighted averaging, further amplifies the efficacy of emotion recognition. Experimental outcomes showcase exceptional performance across all four models in the SER task. The ensemble Model D achieves noteworthy accuracy across multiple datasets: 87.513% on RAVDESS, 86.233% on SAVEE, 99.857% on TESS, 82.295% on CREMA-D, and 97.546% on the TOTAL dataset.

AI-based English teaching cross-cultural fusion mechanism

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

MFDR: Multiple-stage Fusion and Dynamically Refined Network for Multimodal Emotion Recognition

Visual-Audio Emotion Recognition Based on Multi-Task and Ensemble Learning with Multiple Features

Speech Emotion Recognition Based on Multi-feature and Multi-lingual Fusion

Constructing multi-modal emotion recognition model based on convolutional neural network

Analysis of English classroom teaching behavior and strategies under adaptive deep learning under cognitive psychology

GCF2-Net: global-aware cross-modal feature fusion network for speech emotion recognition

Multi-Modal Fusion Emotion Recognition Method of Speech Expression Based on Deep Learning

Simulation of English speech emotion recognition based on transfer learning and CNN neural network

Emotion recognition and achievement prediction for foreign language learners under the background of network teaching

Construction and Evaluation of College English Translation Teaching Model Based on Multimodal Integration

Speech emotion recognition based on multi-dimensional feature extraction and multi-scale feature fusion

Graph-based multi-Feature fusion method for speech emotion recognition

Multimodal Emotion Recognition From EEG Signals and Facial Expressions

Learning Fine-Grained Cross Modality Excitement for Speech Emotion Recognition

An autoencoder-based feature level fusion for speech emotion recognition

Design of smart home system speech emotion recognition model based on ensemble deep learning and feature fusion

Ms-senet: Enhancing Speech Emotion Recognition Through Multi-scale Feature Fusion With Squeeze-and-excitation Blocks

Facial Micro-Expression Recognition Enhanced by Score Fusion and a Hybrid Model from Convolutional LSTM and Vision Transformer

Cross-cultural O2O English teaching based on AI emotion recognition and neural network algorithm