Abstract:Introduction: Recently, the microstate analysis method has been widely used to investigate the temporal and spatial dynamics of electroencephalogram (EEG) signals. However, most studies have focused on EEG at resting state, and few use microstate analysis to study emotional EEG. This paper aims to investigate the temporal and spatial patterns of EEG in emotional states, and the specific neurophysiological significance of microstates during the emotion cognitive process, and further explore the feasibility and effectiveness of applying the microstate analysis to emotion recognition. Methods: We proposed a KLGEV-criterion-based microstate analysis method, which can automatically and adaptively identify the optimal number of microstates in emotional EEG. The extracted temporal and spatial microstate features then served as novel feature sets to improve the performance of EEG emotion recognition. We evaluated the proposed method on two publicly available emotional EEG datasets: the SJTU Emotion EEG Dataset (SEED) and the Database for Emotion Analysis using Physiological Signals (DEAP). Results: For the SEED dataset, 10 microstates were identified using the proposed method. These temporal and spatial features were fed into AutoGluon, an open-source automatic machine learning model, yielding an average three-class accuracy of 70.38% (±8.03%) in subject-dependent emotion recognition. For the DEAP dataset, the method identified 9 microstates. The average accuracy in the arousal dimension was 74.33% (±5.17%) and 75.49% (±5.70%) in the valence dimension, which were competitive performance compared to some previous machine-learning-based studies. Based on these results, we further discussed the neurophysiological relationship between specific microstates and emotions, which broaden our knowledge of the interpretability of EEG microstates. In particular, we found that arousal ratings were positively correlated with the activity of microstate C (anterior regions of default mode network) and negatively correlated with the activity of microstate D (dorsal attention network), while valence ratings were positively correlated with the activity of microstate B (visual network) and negatively correlated with the activity of microstate D (dorsal attention network). Discussion: In summary, the findings in this paper indicate that the proposed KLGEV-criterion-based method can be employed to research emotional EEG signals effectively, and the microstate features are promising feature sets for EEG-based emotion recognition.

Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching

Exploiting EEG signals and audiovisual feature fusion for video emotion recognition

Inter-Brain EEG Feature Extraction and Analysis for Continuous Implicit Emotion Tagging During Video Watching

Emotional State Decoding Using EEG-based Microstates of Functional Connectivity

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

EEG Microstates and Fnirs Metrics Reveal the Spatiotemporal Joint Neural Processing Features of Human Emotions

Emotion recognition based on microstate analysis from temporal and spatial patterns of electroencephalogram

The EEG Microstate Representation of Discrete Emotions.

Identifying valence and arousal levels via connectivity between EEG channels

Electroencephalography Amplitude Modulation Analysis for Automated Affective Tagging of Music Video Clips

DRS-Net: A Spatial–temporal Affective Computing Model Based on Multichannel EEG Data

Examining the Relationship between EEG Dynamics and Emotion Ratings during Video Watching using Adaptive Mixture Independent Component Analysis.

Using electroencephalogram for emotion recognition based on filter-bank long short-term memory networks

Feature extraction based on microstate sequences for EEG–based emotion recognition

Dual-Threshold-Based Microstate Analysis on Characterizing Temporal Dynamics of Affective Process and Emotion Recognition From EEG Signals

A Study on Frequency Domain Microstate Feature Fusion for EEG Emotion Recognition

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Impact of Affective Multimedia Content on the Electroencephalogram and Facial Expressions

DEAP: A Database for Emotion Analysis ;Using Physiological Signals

Hybrid video emotional tagging using users’ EEG and video content

[An improved electroencephalogram feature extraction algorithm and its application in emotion recognition]