Abstract:Deep neural networks have recently been successfully extended to EEG-based driving fatigue detection. Nevertheless, most existing models fail to reveal the intrinsic inter-channel relations that are known to be beneficial for EEG-based classification. Additionally, these models require substantial data for training, which is often impractical due to the high cost of data collection. To simultaneously address these two issues, we propose a Self-Attentive Channel-Connectivity Capsule Network (SACC-CapsNet) for EEG-based driving fatigue detection in this paper. SACC-CapsNet starts with a temporal-channel attention module to investigate the critical temporal information and important channels for driving fatigue detection, refining the input EEG signals. Subsequently, the refined EEG data are transformed into a channel covariance matrix to capture the inter-channel relations, followed by selective kernel attention to extract the highly discriminative channel-connectivity features. Finally, a capsule neural network is employed to effectively learn the relationships between connectivity features, which is more suitable for limited data. To confirm the effectiveness of SACC-CapsNet, we collected 24-channel EEG data from 31 subjects (mean age=23.13±2.68 years, male/female=18/13) in a simulated fatigue driving environment. Extensive experiments were conducted with the acquired data, and the comparison results show that our proposed model outperforms state-of-the-art methods. Additionally, the channel covariance matrix learned from SACC-CapsNet reveals that the frontal pole is most informative for detecting driving fatigue, followed by the parietal and central regions. Intriguingly, the temporal-channel attention module can enhance the significance of these critical regions, and the reconstructed channel covariance matrix generated by the decoder network of SACC-CapsNet can effectively preserve valuable information about them.

E3GCAPS: Efficient EEG-based multi-capsule framework with dynamic attention for cross-subject cognitive state detection

Two-dimensional discrete feature based spatial attention CapsNet For sEMG signal recognition

JDAT: Joint-Dimension-Aware Transformer with Strong Flexibility for EEG Emotion Recognition

Multi-view Domain-Adaptive Representation Learning for EEG-based Emotion Recognition

Capsule Attention for Multimodal EEG-EOG Representation Learning With Application to Driver Vigilance Estimation

An improved CapsNet based on data augmentation for driver vigilance estimation with forehead single-channel EEG

EEG emotion recognition based on the attention mechanism and pre-trained convolution capsule network

DA-CapsNet: A multi-branch capsule network based on adversarial domain adaption for cross-subject EEG emotion recognition

Emotion recognition from EEG based on multi-task learning with capsule network and attention mechanism

Self-Attentive Channel-Connectivity Capsule Network for EEG-Based Driving Fatigue Detection

ICaps-ResLSTM: Improved Capsule Network and Residual LSTM for EEG Emotion Recognition.

A Novel Capsule Neural Network Based Model for Drowsiness Detection Using Electroencephalography Signals

Know Your Mind: Adaptive Cognitive Activity Recognition with Reinforced CNN

Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network

MES-CTNet: A Novel Capsule Transformer Network Base on a Multi-Domain Feature Map for Electroencephalogram-Based Emotion Recognition

EEG-fNIRS-Based Emotion Recognition Using Graph Convolution and Capsule Attention Network

Decoding Subject-Driven Cognitive States from EEG Signals for Cognitive Brain–Computer Interface

A novel AI-driven EEG generalized classification model for cross-subject and cross-scene analysis

Feature Fusion-Based Capsule Network for Cross-Subject Mental Workload Classification

Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation

TC-Net: A Transformer Capsule Network for EEG-based emotion recognition