Abstract:OBJECTIVE: Covert aspects of ongoing user mental states provide key context information for user-aware human computer interactions. In this paper, we focus on the problem of estimating the vigilance of users using EEG and EOG signals.APPROACH: The PERCLOS index as vigilance annotation is obtained from eye tracking glasses. To improve the feasibility and wearability of vigilance estimation devices for real-world applications, we adopt a novel electrode placement for forehead EOG and extract various eye movement features, which contain the principal information of traditional EOG. We explore the effects of EEG from different brain areas and combine EEG and forehead EOG to leverage their complementary characteristics for vigilance estimation. Considering that the vigilance of users is a dynamic changing process because the intrinsic mental states of users involve temporal evolution, we introduce continuous conditional neural field and continuous conditional random field models to capture dynamic temporal dependency.MAIN RESULTS: We propose a multimodal approach to estimating vigilance by combining EEG and forehead EOG and incorporating the temporal dependency of vigilance into model training. The experimental results demonstrate that modality fusion can improve the performance compared with a single modality, EOG and EEG contain complementary information for vigilance estimation, and the temporal dependency-based models can enhance the performance of vigilance estimation. From the experimental results, we observe that theta and alpha frequency activities are increased, while gamma frequency activities are decreased in drowsy states in contrast to awake states.SIGNIFICANCE: The forehead setup allows for the simultaneous collection of EEG and EOG and achieves comparative performance using only four shared electrodes in comparison with the temporal and posterior sites.

An Integrated Gaussian Mixture Model to Estimate Vigilance Level Based on EEG Recordings

An Approach for Vigilance Assessment using Hidden Markov Model

Vigilance estimation based on statistic learning with one ICA component of EEG signal

Gaussian mixture model based on genetic algorithm for brain-computer interface

A multimodal approach to estimating vigilance in SSVEP-based BCI

Vigilance Estimation Based on EEG Signals

Assessment of Vigilance Level during Work: Fitting a Hidden Markov Model to Heart Rate Variability

Estimating Vigilance in Driving Simulation Using Probabilistic PCA.

[Brain Vigilance Analysis Based on the Measure of Complexity].

Vigilance Estimating in SSVEP-Based BCI Using Multimodal Signals

Estimating vigilance from EEG using manifold clustering guided by instantaneous lapse rate

A multimodal approach to estimating vigilance using EEG and forehead EOG

Investigating EEG-based Cross-Session and Cross-Task Vigilance Estimation in BCI Systems.

Eeg-Based Vigilance Estimation Using Extreme Learning Machines

Gaussian Mixture Modeling In Stroke Patients' Rehabilitation Eeg Data Analysis

A Regression Method With Subnetwork Neurons for Vigilance Estimation Using EOG and EEG

Contrastive fine-grained domain adaptation network for EEG-based vigilance estimation

Estimate Vigilance in Driving Simulation Based on Detection of Light Drowsiness.

VIGILANCE ANALYSIS BASED ON EEG SIGNALS: SEEKING FOR SUITABLE FEATURES

Multimodal Vigilance Estimation Using Deep Learning

Vigilance Detection Based on Sparse Representation of EEG.