Abstract:Introduction: Recently, the microstate analysis method has been widely used to investigate the temporal and spatial dynamics of electroencephalogram (EEG) signals. However, most studies have focused on EEG at resting state, and few use microstate analysis to study emotional EEG. This paper aims to investigate the temporal and spatial patterns of EEG in emotional states, and the specific neurophysiological significance of microstates during the emotion cognitive process, and further explore the feasibility and effectiveness of applying the microstate analysis to emotion recognition. Methods: We proposed a KLGEV-criterion-based microstate analysis method, which can automatically and adaptively identify the optimal number of microstates in emotional EEG. The extracted temporal and spatial microstate features then served as novel feature sets to improve the performance of EEG emotion recognition. We evaluated the proposed method on two publicly available emotional EEG datasets: the SJTU Emotion EEG Dataset (SEED) and the Database for Emotion Analysis using Physiological Signals (DEAP). Results: For the SEED dataset, 10 microstates were identified using the proposed method. These temporal and spatial features were fed into AutoGluon, an open-source automatic machine learning model, yielding an average three-class accuracy of 70.38% (±8.03%) in subject-dependent emotion recognition. For the DEAP dataset, the method identified 9 microstates. The average accuracy in the arousal dimension was 74.33% (±5.17%) and 75.49% (±5.70%) in the valence dimension, which were competitive performance compared to some previous machine-learning-based studies. Based on these results, we further discussed the neurophysiological relationship between specific microstates and emotions, which broaden our knowledge of the interpretability of EEG microstates. In particular, we found that arousal ratings were positively correlated with the activity of microstate C (anterior regions of default mode network) and negatively correlated with the activity of microstate D (dorsal attention network), while valence ratings were positively correlated with the activity of microstate B (visual network) and negatively correlated with the activity of microstate D (dorsal attention network). Discussion: In summary, the findings in this paper indicate that the proposed KLGEV-criterion-based method can be employed to research emotional EEG signals effectively, and the microstate features are promising feature sets for EEG-based emotion recognition.

Dual-Threshold-Based Microstate Analysis on Characterizing Temporal Dynamics of Affective Process and Emotion Recognition From EEG Signals

Emotion recognition based on microstate analysis from temporal and spatial patterns of electroencephalogram

Feature extraction based on microstate sequences for EEG–based emotion recognition

A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals

A Study on Frequency Domain Microstate Feature Fusion for EEG Emotion Recognition

Electroencephalogram Emotion Recognition Based on Empirical Mode Decomposition and Optimal Feature Selection.

Emotional State Decoding Using EEG-based Microstates of Functional Connectivity

Cross-subject emotion EEG signal recognition based on source microstate analysis

Exploring EEG Microstates for Affective Computing: Decoding Valence and Arousal Experiences During Video Watching

Dynamic-Attention-based EEG State Transition Modeling for Emotion Recognition

Improving Emotion Analysis For Speech-Induced Eegs Through Eemd-Hht-Based Feature Extraction And Electrode Selection

Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals.

DRS-Net: A Spatial–temporal Affective Computing Model Based on Multichannel EEG Data

Emotional State Classification from EEG Data Using Machine Learning Approach

Recognition of Emotional States Using Multiscale Information Analysis of High Frequency EEG Oscillations

Towards a dynamical understanding of microstate analysis of M/EEG data

Multi-Domain Encoding of Spatiotemporal Dynamics in EEG for Emotion Recognition

[An improved electroencephalogram feature extraction algorithm and its application in emotion recognition]

A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals

Eeg-Based Emotion Recognition in Music Listening

A novel methodology for emotion recognition through 62-lead EEG signals: multilevel heterogeneous recurrence analysis