Abstract:Due to its potential use in evaluating mental health and enhancing patient care, emotion recognition using physiological signals, such as EEG, ECG, and EMG, has drawn a lot of attention in the healthcare industry. However, better neural network architecture and training parameter optimization is needed to achieve accurate and dependable emotion classification. This research aims to investigate the impact of various configurations of neural network architectures, proposed multimodal fusion network and training parameters on the classification performance of emotion recognition systems utilizing EEG, ECG, and EMG signals. Nine experiments were conducted, each representing a unique combination of hyperparameters, including EEG filters, kernel sizes, pooling sizes, ECG filters, EMG filters, LSTM units, dropout rates, epochs, and batch sizes. The experiments were designed to systematically explore the effects of these hyperparameters on classification accuracy, robustness, and computational efficiency. The experiments revealed that the choice of hyperparameters significantly influences the performance of emotion recognition systems. Proposed model achieved higher average accuracies, with Experiment 3 exhibiting the highest accuracy of 87.83%. However, the model also incurred higher computational costs in terms of training time and memory usage. Additionally, experiments with higher dropout rates demonstrated a slight decrease in accuracy compared to those with lower dropout rates, emphasizing the importance of balancing regularization and model complexity. The findings underscore the importance of fine-tuning hyperparameters and selecting appropriate neural network architectures to optimize the performance of emotion recognition systems. Advanced deep learning techniques and physiological signal processing, healthcare providers can develop robust and accurate emotion recognition systems to enhance patient care and support personalized interventions. Further research may focus on exploring novel architectures and refining training strategies to continue improving the efficacy and efficiency of AI-driven emotional intelligence solutions in healthcare delivery.

Digital Twin Model: A Real-Time Emotion Recognition System for Personalized Healthcare

Intelligent Wearable System with Motion and Emotion Recognition Based on Digital Twin Technology

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

The novel emergency hospital services for patients using digital twins

Artificial Intelligence Empowered Digital Twins for ECG Monitoring in a Smart Home

Personalized Emotion Detection using IoT and Machine Learning

Real-Time Emotion Recognition using Deep Facial Expression Analysis on Mobile Devices

Emotion recognition models for companion robots

Multimodal emotion recognition based on the fusion of vision, EEG, ECG, and EMG signals

A real time face emotion classification and recognition using deep learning model

An Empirical Analysis of Multimodal Affective Computing Approaches for Advancing Emotional Intelligence in Artificial Intelligence for Healthcare

Enhanced V-Net approach for the emotion recognition and sentiment analysis in the healthcare data

Real Time Emotion Analysis Using Deep Learning for Education, Entertainment, and Beyond

Real-time emotional health detection using fine-tuned transfer networks with multimodal fusion

Human emotion recognition by analyzing facial expressions, heart rate and blogs using deep learning method

Personalized Heart Disease Detection via ECG Digital Twin Generation

Emotion Recognition System via Facial Expressions and Speech Using Machine Learning and Deep Learning Techniques

Improved Digital Therapy for Developmental Pediatrics Using Domain-Specific Artificial Intelligence: Machine Learning Study

Emotion Recognition for Healthcare Surveillance Systems Using Neural Networks: A Survey

Novel multimodal emotion detection method using Electroencephalogram and Electrocardiogram signals

Emotion Recognition for Challenged People Facial Appearance in Social using Neural Network