Abstract:Driver fatigue is a critical factor that lead to traffic accidents with a high fatality rate. Electroencephalogram (EEG) is one of the most reliable indicators to objectively assess fatigue status, but recognizing fatigue driving status from it is still an essential and challenging problem. In this paper, we propose a multiscale global prompt Transformer (MsGPT) deep learning model, which can automatically recognize driver fatigue end-to-end. First, we construct an intra-inter-scale cascade framework based on Transformer with a multiscale convolutional patch embedding (MC-PatchEmbed), and guide global-local feature interaction by adding a global prompt token throughout. Second, to efficiently integrate intra-scale and inter-scale feature information, we design a mixed token by aggregating the output from the intra-scale, which includes rich low-level feature information for multiscale. Moreover, a novel learnable query is introduced into multi-head self-attention (MSA) to reduce the computational complexity to linear level. Experiments are conducted on the SEED-VIG dataset and the SADT dataset with both intra-subject and inter-subject settings to evaluate the performance of MsGPT, and the results show that MsGPT greatly outperforms various methods in terms of the classification evaluation metrics of EEG-based fatigue driving. Note to Practitioners —This paper considers the use of raw EEG data to recognize the driver fatigue state. Existing methods mainly rely on manually extracted EEG features and convolutional neural network (CNN) based inference. However, the large intra-individual and inter-individual differences greatly limit the extraction of EEG fatigue features. This paper suggests a multiscale global prompt Transformer (MsGPT) deep learning model. This model leverages a shared weighting mechanism to construct an inter-to intra-scale multiscale framework that can capture refined fatigue features not achievable at a single scale, we incorporate a new Transformer of the global prompt mechanism, which facilitates multiscale local-to-global fusion of long-term physiological signals. Our experiments demonstrate the superiority of our method on two datasets with intra-subject and inter-subject settings. The proposed method can be readily deployed in the automatic driving assistance system to alert drivers to avoid or reduce traffic accidents caused by excessive fatigue.

PSSS-EEG: A Probabilistic-masking Self-Supervised Swin-transformer model for EEG-based drowsiness recognition

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

Subject-Independent Drowsiness Recognition from Single-Channel EEG with an Interpretable CNN-LSTM Model

Boosting Transfer Learning Improves Performance of Driving Drowsiness Classification Using EEG

Cross-subject Drowsiness Recognition Model Based on the Multi-scale Parallel Convolution of EEG Channels

Self-Supervised Electroencephalogram Representation Learning for Automatic Sleep Staging: Model Development and Evaluation Study

Dynamic threshold distribution domain adaptation network: a cross-subject fatigue recognition method based on EEG signals

Drowsiness Detection Using Joint EEG-ECG Data With Deep Learning

Efficient Generalized Electroencephalography-Based Drowsiness Detection Approach with Minimal Electrodes

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

Multiscale Global Prompt Transformer for EEG-Based Driver Fatigue Recognition

Selective Transfer Learning for EEG-Based Drowsiness Detection

Algorithm for drowsiness detection based on hybrid brain network parameter optimization

Customized deep learning algorithm for drowsiness detection using single-channel EEG signal

Single-channel EEG sleep staging based on data augmentation and cross-subject discrepancy alleviation

EEGNet classification of sleep EEG for individual specialization based on data augmentation

Self-Supervised Transformer Model Training for a Sleep-EEG Foundation Model

Self-supervised EEG Representation Learning for Automatic Sleep Staging

Convolutional Neural Network for Drowsiness Detection Using EEG Signals

Benchmarking EEG-based Cross-dataset Driver Drowsiness Recognition with Deep Transfer Learning

Self-supervised Contrastive Learning for EEG-based Sleep Staging