Abstract:Introduction: Recently, the microstate analysis method has been widely used to investigate the temporal and spatial dynamics of electroencephalogram (EEG) signals. However, most studies have focused on EEG at resting state, and few use microstate analysis to study emotional EEG. This paper aims to investigate the temporal and spatial patterns of EEG in emotional states, and the specific neurophysiological significance of microstates during the emotion cognitive process, and further explore the feasibility and effectiveness of applying the microstate analysis to emotion recognition. Methods: We proposed a KLGEV-criterion-based microstate analysis method, which can automatically and adaptively identify the optimal number of microstates in emotional EEG. The extracted temporal and spatial microstate features then served as novel feature sets to improve the performance of EEG emotion recognition. We evaluated the proposed method on two publicly available emotional EEG datasets: the SJTU Emotion EEG Dataset (SEED) and the Database for Emotion Analysis using Physiological Signals (DEAP). Results: For the SEED dataset, 10 microstates were identified using the proposed method. These temporal and spatial features were fed into AutoGluon, an open-source automatic machine learning model, yielding an average three-class accuracy of 70.38% (±8.03%) in subject-dependent emotion recognition. For the DEAP dataset, the method identified 9 microstates. The average accuracy in the arousal dimension was 74.33% (±5.17%) and 75.49% (±5.70%) in the valence dimension, which were competitive performance compared to some previous machine-learning-based studies. Based on these results, we further discussed the neurophysiological relationship between specific microstates and emotions, which broaden our knowledge of the interpretability of EEG microstates. In particular, we found that arousal ratings were positively correlated with the activity of microstate C (anterior regions of default mode network) and negatively correlated with the activity of microstate D (dorsal attention network), while valence ratings were positively correlated with the activity of microstate B (visual network) and negatively correlated with the activity of microstate D (dorsal attention network). Discussion: In summary, the findings in this paper indicate that the proposed KLGEV-criterion-based method can be employed to research emotional EEG signals effectively, and the microstate features are promising feature sets for EEG-based emotion recognition.

Emotional State Decoding Using EEG-based Microstates of Functional Connectivity

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

Emotion recognition based on microstate analysis from temporal and spatial patterns of electroencephalogram

Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition

Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Feature extraction based on microstate sequences for EEG–based emotion recognition

Dynamic differential entropy and brain connectivity features based EEG emotion recognition

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Dual-Threshold-Based Microstate Analysis on Characterizing Temporal Dynamics of Affective Process and Emotion Recognition From EEG Signals

Electroencephalogram Emotion Recognition Based on Dispersion Entropy Feature Extraction Using Random Oversampling Imbalanced Data Processing

Electroencephalogram Emotion Recognition Using Variational Modal Decomposition Based Dispersion Entropy Feature Extraction

EEG decoding for musical emotion with functional connectivity features

Cross-subject emotion EEG signal recognition based on source microstate analysis

Identifying valence and arousal levels via connectivity between EEG channels

Investigating EEG-based functional connectivity patterns for multimodal emotion recognition

Emotion Recognition Using Dynamic Graph Metrics Based on Functional Integration and Separation of EEG Brain Network

Electroencephalogram Emotion Recognition Using Combined Features in Variational Mode Decomposition Domain

A model for electroencephalogram emotion recognition: Residual block-gated recurrent unit with attention mechanism

Emotional Brain State Classification on fMRI Data Using Deep Residual and Convolutional Networks

Design and Implementation of an Emotion Analysis System Based on EEG Signals