Abstract:For patients with disorders of consciousness (DOC), such as vegetative state (VS) and minimally conscious state (MCS), detecting and assessing the residual cognitive functions of the brain remain challenging. Emotion-related cognitive functions are difficult to detect in patients with DOC using motor response-based clinical assessment scales such as the Coma Recovery Scale-Revised (CRS-R) because DOC patients have motor impairments and are unable to provide sufficient motor responses for emotion-related communication. In this study, we proposed an EEG-based brain-computer interface (BCI) system for emotion recognition in patients with DOC. Eight patients with DOC (5 VS and 3 MCS) and eight healthy controls participated in the BCI-based experiment. During the experiment, two movie clips flashed (appearing and disappearing) eight times with a random interstimulus interval between flashes to evoke P300 potentials. The subjects were instructed to focus on the crying or laughing movie clip and to count the flashes of the corresponding movie clip cued by instruction. The BCI system performed online P300 detection to determine which movie clip the patients responsed to and presented the result as feedback. Three of the eight patients and all eight healthy controls achieved online accuracies based on P300 detection that were significantly greater than chance level. P300 potentials were observed in the EEG signals from the three patients. These results indicated the three patients had abilities of emotion recognition and command following. Through spectral analysis, common spatial pattern (CSP) and differential entropy (DE) features in the delta, theta, alpha, beta, and gamma frequency bands were employed to classify the EEG signals during the crying and laughing movie clips. Two patients and all eight healthy controls achieved offline accuracies significantly greater than chance levels in the spectral analysis. Furthermore, stable topographic distribution patterns of CSP and DE features were observed in both the healthy subjects and these two patients. Our results suggest that cognitive experiments may be conducted using BCI systems in patients with DOC despite the inability of such patients to provide sufficient behavioral responses.

Biological Computation Indexes of Brain Oscillations in Unattended Facial Expression Processing Based on Event-Related Synchronization/Desynchronization

Multimodal Affective State Assessment Using fNIRS + EEG and Spontaneous Facial Expression

An Investigation into the Use of Six Facially Encoded Emotions in Brain-Computer Interfacing

An EEG-Based Brain Computer Interface for Emotion Recognition and Its Application in Patients with Disorder of Consciousness

An EEG-Based Brain-Computer Interface for Emotion Recognition.

Naturalistic Emotion Recognition Using EEG and Eye Movements

Exploratory Cross-Frequency Coupling and Scaling Analysis of Neuronal Oscillations Stimulated by Emotional Images: an Evidence from EEG

Temporal Convolutional Network-Enhanced Real-Time Implicit Emotion Recognition with an Innovative Wearable fNIRS-EEG Dual-Modal System

Event-related Potential of Facial Expression Processing

EEG-based Approach for Recognizing Human Social Emotion Perception

Emotion Recognition from EEG Using Rhythm Synchronization Patterns with Joint Time-Frequency-Space Correlation.

Stylized faces enhance ERP features used for the detection of emotional responses

Event-related brain potential markers of visual and auditory perception: A useful tool for brain computer interface systems

Human brain EEG indices of emotions: Delineating responses to affective vocalizations by measuring frontal theta event-related synchronization

Investigating Oscillatory Activity in Cerebral Cortex during Affective Picture Processing

Face preference detection task based on EEG energy analysis in the source domain.

Design and Implementation of an Emotion Analysis System Based on EEG Signals

Emotion-Related Consciousness Detection in Patients With Disorders of Consciousness Through an EEG-Based BCI System

Eeg-based Emotion Recognition with Brain Network Using Independent Components Analysis and Granger Causality

EEG Microstates and Fnirs Metrics Reveal the Spatiotemporal Joint Neural Processing Features of Human Emotions

Analyzing Emotional Oscillatory Brain Network for Valence and Arousal-Based Emotion Recognition Using EEG Data.