Abstract:Driver fatigue is a critical factor that lead to traffic accidents with a high fatality rate. Electroencephalogram (EEG) is one of the most reliable indicators to objectively assess fatigue status, but recognizing fatigue driving status from it is still an essential and challenging problem. In this paper, we propose a multiscale global prompt Transformer (MsGPT) deep learning model, which can automatically recognize driver fatigue end-to-end. First, we construct an intra-inter-scale cascade framework based on Transformer with a multiscale convolutional patch embedding (MC-PatchEmbed), and guide global-local feature interaction by adding a global prompt token throughout. Second, to efficiently integrate intra-scale and inter-scale feature information, we design a mixed token by aggregating the output from the intra-scale, which includes rich low-level feature information for multiscale. Moreover, a novel learnable query is introduced into multi-head self-attention (MSA) to reduce the computational complexity to linear level. Experiments are conducted on the SEED-VIG dataset and the SADT dataset with both intra-subject and inter-subject settings to evaluate the performance of MsGPT, and the results show that MsGPT greatly outperforms various methods in terms of the classification evaluation metrics of EEG-based fatigue driving. Note to Practitioners —This paper considers the use of raw EEG data to recognize the driver fatigue state. Existing methods mainly rely on manually extracted EEG features and convolutional neural network (CNN) based inference. However, the large intra-individual and inter-individual differences greatly limit the extraction of EEG fatigue features. This paper suggests a multiscale global prompt Transformer (MsGPT) deep learning model. This model leverages a shared weighting mechanism to construct an inter-to intra-scale multiscale framework that can capture refined fatigue features not achievable at a single scale, we incorporate a new Transformer of the global prompt mechanism, which facilitates multiscale local-to-global fusion of long-term physiological signals. Our experiments demonstrate the superiority of our method on two datasets with intra-subject and inter-subject settings. The proposed method can be readily deployed in the automatic driving assistance system to alert drivers to avoid or reduce traffic accidents caused by excessive fatigue.

Attention-based Cross-Frequency Graph Convolutional Network for Driver Fatigue Estimation

Linking Attention-Based Multiscale CNN With Dynamical GCN for Driving Fatigue Detection

EEG-Based Spatio-Temporal Convolutional Neural Network for Driver Fatigue Evaluation

Partial Directed Coherence Based Graph Convolutional Neural Networks for Driving Fatigue Detection

Attention-Guided Multi-scale Convolutional Neural Network for Driving Fatigue Detection

Attention-based multi-semantic dynamical graph convolutional network for eeg-based fatigue detection

Two-dimensional phase lag index image representation of electroencephalography for automated recognition of driver fatigue using convolutional neural network

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Multiscale Global Prompt Transformer for EEG-Based Driver Fatigue Recognition

A Recurrence Network-Based Convolutional Neural Network for Fatigue Driving Detection from EEG.

Research on Fatigue Driving Detection Technology Based on CA-ACGAN

A TSK-Type Convolutional Recurrent Fuzzy Network for Predicting Driving Fatigue

A Lightweight Attention-Based Multi-Frequency Topology Learning Framework for Driving Fatigue Detection

AGL-Net: An Efficient Neural Network for EEG-Based Driver Fatigue Detection

LDGCN: An Edge-End Lightweight Dual GCN Based on Single-Channel EEG for Driver Drowsiness Monitoring

Self-Attentive Channel-Connectivity Capsule Network for EEG-Based Driving Fatigue Detection

A Driving Performance Forecasting System Based on Brain Dynamic State Analysis Using 4-D Convolutional Neural Networks

A Novel Approach for Automatic Detection of Driver Fatigue Using EEG Signals Based on Graph Convolutional Networks

Exploring the fatigue affecting electroencephalography based functional brain networks during real driving in young males

EEG-based Prediction of Driver's Cognitive Performance by Deep Convolutional Neural Network

A Generative Adaptive Convolutional Neural Network with Attention Mechanism for Driver Fatigue Detection with Class-imbalanced and Insufficient Data