Abstract:Introduction: Recently, the microstate analysis method has been widely used to investigate the temporal and spatial dynamics of electroencephalogram (EEG) signals. However, most studies have focused on EEG at resting state, and few use microstate analysis to study emotional EEG. This paper aims to investigate the temporal and spatial patterns of EEG in emotional states, and the specific neurophysiological significance of microstates during the emotion cognitive process, and further explore the feasibility and effectiveness of applying the microstate analysis to emotion recognition. Methods: We proposed a KLGEV-criterion-based microstate analysis method, which can automatically and adaptively identify the optimal number of microstates in emotional EEG. The extracted temporal and spatial microstate features then served as novel feature sets to improve the performance of EEG emotion recognition. We evaluated the proposed method on two publicly available emotional EEG datasets: the SJTU Emotion EEG Dataset (SEED) and the Database for Emotion Analysis using Physiological Signals (DEAP). Results: For the SEED dataset, 10 microstates were identified using the proposed method. These temporal and spatial features were fed into AutoGluon, an open-source automatic machine learning model, yielding an average three-class accuracy of 70.38% (±8.03%) in subject-dependent emotion recognition. For the DEAP dataset, the method identified 9 microstates. The average accuracy in the arousal dimension was 74.33% (±5.17%) and 75.49% (±5.70%) in the valence dimension, which were competitive performance compared to some previous machine-learning-based studies. Based on these results, we further discussed the neurophysiological relationship between specific microstates and emotions, which broaden our knowledge of the interpretability of EEG microstates. In particular, we found that arousal ratings were positively correlated with the activity of microstate C (anterior regions of default mode network) and negatively correlated with the activity of microstate D (dorsal attention network), while valence ratings were positively correlated with the activity of microstate B (visual network) and negatively correlated with the activity of microstate D (dorsal attention network). Discussion: In summary, the findings in this paper indicate that the proposed KLGEV-criterion-based method can be employed to research emotional EEG signals effectively, and the microstate features are promising feature sets for EEG-based emotion recognition.

Recognition of the Cognitive State in the Visual Search Task

Single-Trial Electrical Perception Recognition via Single-Channel Electroencephalogram

Sustained Attention States Recognition with EEG and Eye-Tracking in the GradCPT.

Mental State Recognition via Wearable EEG

Analysis of Complex Cognitive Task and Pattern Recognition Using Distributed Patterns of EEG Signals with Cognitive Functions

Automatic brain cognitive control detection method

Cognitive Activity Recognition Based on Self-supervised Learning from EEG Signals.

Decoding Subject-Driven Cognitive States from EEG Signals for Cognitive Brain–Computer Interface

Emotion Perception and Recognition: an Exploration of Cultural Differences and Similarities

The Automatic Detection of Cognition Using EEG and Facial Expressions

Pattern Recognition Of Motor Imagery Eeg Signal In Noninvasive Brain-Computer Interface

Research on Human-Computer Interaction Intention Recognition Based on EEG and Eye Movement

Electroencephalography (EEG) classification of cognitive tasks based on task engagement index

Cultural Differences and Similarities in Emotion Recognition

Brain-computer Control Interface Design for Virtual Household Appliances Based on Steady-State Visually Evoked Potential Recognition

Emotion recognition based on microstate analysis from temporal and spatial patterns of electroencephalogram

Emotion-Related Consciousness Detection in Patients With Disorders of Consciousness Through an EEG-Based BCI System

EEG Based Topography Analysis in String Recognition Task

A Comparison Study on EEG Signal Processing Techniques Using Motor Imagery EEG Data

Mental EEG analysis based on independent component analysis