Abstract:Background and objective: Emotion is an important factor affecting a person's physical and mental health, but there are few ways to detect a patient's emotions in daily life. Negative emotions not only affect recovery after treatment, but also cause poor health. Current emotion classification research based on EEG image recognition is highly accurate, making the development of an emotion detector feasible. Using emotion data from the SEED, this study trained a detection model using the residual neural network ResNet-50 with a SAM and SE-block double attention mechanism, and used quantitative parameters based on the Russell emotion cycle model to construct a human-computer interactive health detector for emotion recognition in EEG images induced by environmental stimuli. Methods: Images of 61 environmental scenes were collected and divided into three categories according to the visual characteristics of the environment. Eight volunteers were recruited to collect a total of 488 EEG image data. The trained ResNet-50 model was used to automatically analyze the characteristics of the collected EEG images and classify emotions. The model was compared the support vector machine (SVM), transfer component analysis (TCA), dynamic graph convolutional neural network (DGCNN), and DAN methods. Results: The accuracy of the ResNet-50 model trained in this study is 85.11% and its variance is 7.91. Through the verification of EEG images induced by environmental stimuli, the results are improved by 2.01% and the variance is reduced by 0.04 compared with the model's training results. The model is more accurate in identifying negative and neutral emotions, indicating that the ResNet-50 architecture better recognizes motions in EEG images induced by environmental stimuli. Compared with other algorithm models, the proposed model has the lowest variance and highest stability. The comparison of various algorithms revealed that environmental scenes with different visual features induce different emotions. Conclusion: The proposed monitor can collect EEG images of patients induced by environmental stimuli in daily life in real time, automatically analyze and identify emotional characteristics, and provide quantitative parameters and visualization. It not only enables patients to conveniently monitor their emotional state and make timely adjustments, but also assists doctors in clinical diagnosis.

The Study Of Images Emotion Based On Fmri

Gender Differences in the Processing of Standard Emotional Visual Stimuli: Integrating ERP and Fmri Results

An Image Retrieval System with Color Emotion Query

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Study of Emotional Brain Mechanism Based on Functional Magnetic Resonance Imaging

A study of neural mechanism in emotion regulation by simultaneous recording of EEG and fMRI based on ICA

Multi-modal emotion analysis from facial expressions and electroencephalogram.

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Emotional Brain State Classification on fMRI Data Using Deep Residual and Convolutional Networks

Feature Fusion Analysis of Simultaneously Recorded EEG-fMRI in Emotion Cognitive Reappraisal

Cross-Subject Emotion Recognition Brain–Computer Interface Based on fNIRS and DBJNet

EEG and fNIRS Signal-Based Emotion Identification by Means of Machine Learning Algorithms During Visual Stimuli Exposure

A study on the combination of functional connection features and Riemannian manifold in EEG emotion recognition

Dental treatment in young handicapped patients

Image-Evoked Emotion Recognition for Hearing-Impaired Subjects with EEG Signals

ResNet-50 based technique for EEG image characterization due to varying environmental stimuli

Decoding six basic emotions from brain functional connectivity patterns

Emotion Based Image Musicalization

Spatial representation of multidimensional information in emotional faces revealed by fMRI

Attention-based multi-level image and text sentiment analysis