Abstract:The detection of unfavorable driving states (UDS) of drivers based on electroencephalogram (EEG) measures has received continuous attention from extensive scholars on account of directly reflecting brain neural activity with high temporal resolution and low risk of being deceived. However, the existing EEG-based driver UDS detection methods involve limited exploration of the functional connectivity patterns and interaction relationships within the brain network. Therefore, there is still room for improvement in the accuracy of detection. In this project, we propose three pretrained convolutional neural network (CNN)-based automatic detection frameworks for UDS of drivers with 30-channel EEG signals. The frameworks are investigated by adjusting the learning rate and choosing the optimization solver, etc. Two different conditions of driving experiments are performed, collecting EEG signals from sixteen subjects. The acquired 1-dimensional 30-channel EEG signals are converted into 2-dimensional matrices by the Granger causality (GC) method to form the functional connectivity graphs of the brain (FCGB). Then, the FCGB are fed into pretrained deep learning models that employed transfer learning strategy for feature extraction and judgment of different EEG signal types. Furthermore, we adopt two visualization interpretability techniques, named, activation visualization and gradient-weighted class activation mapping (Grad-CAM) for better visualizing and understanding the predictions of the pretrained models after fine-tuning. The experimental outcomes show that Resnet 18 model yields the highest average recognition accuracy of 90% using the rmsprop optimizer with a learning rate of 1e − 3. The overall outcomes suggest that cooperating of biologically inspired functional connectivity graphs of the brain and pretrained transfer learning algorithms is a prospective approach in reducing the rate of major traffic accidents caused by driver unfavorable driving states.

A novel approach for cross-subject unfavorable driving state detection by cooperation between phase-based functional connectivity and convolutional neural network

Convolutional neural network with transfer learning approach for detection of unfavorable driving state using phase coherence image

Deep Learning Approach for Detection of Unfavorable Driving State Based on Multiple Phase Synchronization Between Multi-Channel EEG Signals

A Transfer Learning-Based CNN Deep Learning Model for Unfavorable Driving State Recognition

Avoiding subject-specific model selection via highway networks in EEG signals

Subject Matching for Cross-Subject EEG-based Recognition of Driver States Related to Situation Awareness.

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

Two-dimensional phase lag index image representation of electroencephalography for automated recognition of driver fatigue using convolutional neural network

A Hybrid Approach for Driving Behavior Recognition: Integration of CNN and Transformer-Encoder with EEG Data

Transfer Components Between Subjects for EEG-based Driving Fatigue Detection.

Exploring the fatigue affecting electroencephalography based functional brain networks during real driving in young males

Assessment of Driver Drowsiness Using Electroencephalogram Signals Based on Multiple Functional Brain Networks.

Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals

Partial Directed Coherence Based Graph Convolutional Neural Networks for Driving Fatigue Detection

EEG Driving Fatigue Detection With PDC-Based Brain Functional Network

Cross-subject Drowsiness Recognition Model Based on the Multi-scale Parallel Convolution of EEG Channels

Toward practical driving fatigue detection using three frontal EEG channels: a proof-of-concept study

Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation

Detecting Unfavorable Driving States in Electroencephalography Based on a PCA Sample Entropy Feature and Multiple Classification Algorithms.

Cross-Subject Seizure Detection via Unsupervised Domain-Adaptation

Multi-source signal alignment and efficient multi-dimensional feature classification in the application of EEG-based subject-independent drowsiness detection