Abstract:For patients with disorders of consciousness (DOC), such as vegetative state (VS) and minimally conscious state (MCS), detecting and assessing the residual cognitive functions of the brain remain challenging. Emotion-related cognitive functions are difficult to detect in patients with DOC using motor response-based clinical assessment scales such as the Coma Recovery Scale-Revised (CRS-R) because DOC patients have motor impairments and are unable to provide sufficient motor responses for emotion-related communication. In this study, we proposed an EEG-based brain-computer interface (BCI) system for emotion recognition in patients with DOC. Eight patients with DOC (5 VS and 3 MCS) and eight healthy controls participated in the BCI-based experiment. During the experiment, two movie clips flashed (appearing and disappearing) eight times with a random interstimulus interval between flashes to evoke P300 potentials. The subjects were instructed to focus on the crying or laughing movie clip and to count the flashes of the corresponding movie clip cued by instruction. The BCI system performed online P300 detection to determine which movie clip the patients responsed to and presented the result as feedback. Three of the eight patients and all eight healthy controls achieved online accuracies based on P300 detection that were significantly greater than chance level. P300 potentials were observed in the EEG signals from the three patients. These results indicated the three patients had abilities of emotion recognition and command following. Through spectral analysis, common spatial pattern (CSP) and differential entropy (DE) features in the delta, theta, alpha, beta, and gamma frequency bands were employed to classify the EEG signals during the crying and laughing movie clips. Two patients and all eight healthy controls achieved offline accuracies significantly greater than chance levels in the spectral analysis. Furthermore, stable topographic distribution patterns of CSP and DE features were observed in both the healthy subjects and these two patients. Our results suggest that cognitive experiments may be conducted using BCI systems in patients with DOC despite the inability of such patients to provide sufficient behavioral responses.

A novel oddball paradigm for affective BCIs using emotional faces as stimuli

Gender Differences in the Processing of Standard Emotional Visual Stimuli: Integrating ERP and Fmri Results

Progress in Brain-computer Interface Based on Cortical Evoked Potential

Happy emotion cognition of bimodal audiovisual stimuli optimizes the performance of the P300 speller

Stylized faces enhance ERP features used for the detection of emotional responses

Investigation of Visual Stimulus With Various Colors and the Layout for the Oddball Paradigm in Evoked Related Potential-Based Brain–Computer Interface

Effects of Emotional Stimulations on the Online Operation of a P300-Based Brain-Computer Interface

Reconfiguration of Brain Network between Resting-state and Oddball Paradigm

The Use of Happy Faces as Visual Stimuli Improves the Performance of the Hybrid SSVEP+P300 Brain Computer Interface

Author Response for "single Stimulus Location for Two Inputs: A Combined Brain‐computer Interface Based on Steady State Visual Evoked Potential (SSVEP)"

A Rapid Face Recognition Bci System Using Single-Trial Erp

The Performance of A Novel P300 Brain-Computer Interface Paradigm with Electrical and Vibration Modes

Emotional Influence on SSVEP Based BCI

Effect of inverted faces as visual stimuli on the performance of the hybrid SSVEP + P300 brain computer interface

Evaluation of Different Types of Stimuli in an Event-Related Potential-Based Brain–Computer Interface Speller under Rapid Serial Visual Presentation

A novel visual brain-computer interfaces paradigm based on evoked related potentials evoked by weak and small number of stimuli

A Novel Hybrid Brain-Computer Interface Combining the Illusion-Induced VEP and SSVEP

Real brains in virtual worlds: Validating a novel oddball paradigm in virtual reality

Employing an active mental task to enhance the performance of auditory attention-based brain-computer interfaces.

Interaction between facial expression and color in modulating ERP P3

Emotion-Related Consciousness Detection in Patients With Disorders of Consciousness Through an EEG-Based BCI System