Abstract:Deep neural networks have recently been successfully extended to EEG-based driving fatigue detection. Nevertheless, most existing models fail to reveal the intrinsic inter-channel relations that are known to be beneficial for EEG-based classification. Additionally, these models require substantial data for training, which is often impractical due to the high cost of data collection. To simultaneously address these two issues, we propose a Self-Attentive Channel-Connectivity Capsule Network (SACC-CapsNet) for EEG-based driving fatigue detection in this paper. SACC-CapsNet starts with a temporal-channel attention module to investigate the critical temporal information and important channels for driving fatigue detection, refining the input EEG signals. Subsequently, the refined EEG data are transformed into a channel covariance matrix to capture the inter-channel relations, followed by selective kernel attention to extract the highly discriminative channel-connectivity features. Finally, a capsule neural network is employed to effectively learn the relationships between connectivity features, which is more suitable for limited data. To confirm the effectiveness of SACC-CapsNet, we collected 24-channel EEG data from 31 subjects (mean age=23.13±2.68 years, male/female=18/13) in a simulated fatigue driving environment. Extensive experiments were conducted with the acquired data, and the comparison results show that our proposed model outperforms state-of-the-art methods. Additionally, the channel covariance matrix learned from SACC-CapsNet reveals that the frontal pole is most informative for detecting driving fatigue, followed by the parietal and central regions. Intriguingly, the temporal-channel attention module can enhance the significance of these critical regions, and the reconstructed channel covariance matrix generated by the decoder network of SACC-CapsNet can effectively preserve valuable information about them.

Residual Attention Capsule Network for Multimodal EEG- and EOG-Based Driver Vigilance Estimation

Capsule Attention for Multimodal EEG-EOG Representation Learning With Application to Driver Vigilance Estimation

An improved CapsNet based on data augmentation for driver vigilance estimation with forehead single-channel EEG

A Regression Method With Subnetwork Neurons for Vigilance Estimation Using EOG and EEG

Self-Attentive Channel-Connectivity Capsule Network for EEG-Based Driving Fatigue Detection

EEG-Fest: Few-shot based Attention Network for Driver's Vigilance Estimation with EEG Signals

Multimodal Vigilance Estimation Using Deep Learning

Faster Single Model Vigilance Detection Based on Deep Learning

Deep Coupling Recurrent Auto-Encoder with Multi-Modal EEG and EOG for Vigilance Estimation.

Driver Drowsiness Detection Using EEG and EOG with an Attention-CNN Framework

Driving Cognitive Alertness Detecting Using Evoked Multimodal Physiological Signals Based on Uncertain Self-Supervised Learning

Attention-Guided Multi-scale Convolutional Neural Network for Driving Fatigue Detection

A Hybrid Vigilance Monitoring Study for Mental Fatigue and Its Neural Activities

Driver Fatigue Detection Based on Residual Channel Attention Network and Head Pose Estimation

Driver Vigilance Detection from EEG Signals Using Transformer Networks

Optimizing Driver Vigilance Recognition: Examining the Characterization and Cumulative Effect of Physiological Signals Across Manual and Automated Driving and Durations

EEG Based Driver Inattention Identification via Feature Profiling and Dimensionality Reduction

Vigilance Detection Based on Sparse Representation of EEG.

Driver vigilance detection based on limited EEG signals

EEG-Based Spatio-Temporal Convolutional Neural Network for Driver Fatigue Evaluation

E3GCAPS: Efficient EEG-based multi-capsule framework with dynamic attention for cross-subject cognitive state detection