Abstract:The detection of unfavorable driving states (UDS) of drivers based on electroencephalogram (EEG) measures has received continuous attention from extensive scholars on account of directly reflecting brain neural activity with high temporal resolution and low risk of being deceived. However, the existing EEG-based driver UDS detection methods involve limited exploration of the functional connectivity patterns and interaction relationships within the brain network. Therefore, there is still room for improvement in the accuracy of detection. In this project, we propose three pretrained convolutional neural network (CNN)-based automatic detection frameworks for UDS of drivers with 30-channel EEG signals. The frameworks are investigated by adjusting the learning rate and choosing the optimization solver, etc. Two different conditions of driving experiments are performed, collecting EEG signals from sixteen subjects. The acquired 1-dimensional 30-channel EEG signals are converted into 2-dimensional matrices by the Granger causality (GC) method to form the functional connectivity graphs of the brain (FCGB). Then, the FCGB are fed into pretrained deep learning models that employed transfer learning strategy for feature extraction and judgment of different EEG signal types. Furthermore, we adopt two visualization interpretability techniques, named, activation visualization and gradient-weighted class activation mapping (Grad-CAM) for better visualizing and understanding the predictions of the pretrained models after fine-tuning. The experimental outcomes show that Resnet 18 model yields the highest average recognition accuracy of 90% using the rmsprop optimizer with a learning rate of 1e − 3. The overall outcomes suggest that cooperating of biologically inspired functional connectivity graphs of the brain and pretrained transfer learning algorithms is a prospective approach in reducing the rate of major traffic accidents caused by driver unfavorable driving states.

A Hybrid Approach for Driving Behavior Recognition: Integration of CNN and Transformer-Encoder with EEG Data

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

A Transfer Learning-Based CNN Deep Learning Model for Unfavorable Driving State Recognition

Driver Vigilance Detection from EEG Signals Using Transformer Networks

EEG-based emotion recognition for road accidents in a simulated driving environment

A Driving Performance Forecasting System Based on Brain Dynamic State Analysis Using 4-D Convolutional Neural Networks

Driving Fatigue Detection with Three Non-Hair-Bearing EEG Channels and Modified Transformer Model

An abnormal driving behavior recognition algorithm based on the temporal convolutional network and soft thresholding

Brain Driving: Personalizing Vehicle Speed with DR-EEG Decoding and Situational Embeddings

E-Key: an EEG-Based Biometric Authentication and Driving Fatigue Detection System

Driving Behavior Recognition Using EEG Data from a Simulated Car-Following Experiment.

EEG and ECG-Based Multi-Sensor Fusion Computing for Real-Time Fatigue Driving Recognition Based on Feedback Mechanism

Study on Driver Cross-Subject Emotion Recognition Based on Raw Multi-Channels EEG Data

Masked EEG Modeling for Driving Intention Prediction

Driver State Recognition with Physiological Signals: Based on Deep Feature Fusion and Feature Selection Techniques

A Unified Multi-scale and Multi-task Learning Framework for Driver Behaviors Reasoning

Driving Behavior Recognition Based on EEG Data From a Driver Taking Over Experiment on a Simulated Autonomous Vehicle

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

EEG-Based Spatio-Temporal Convolutional Neural Network for Driver Fatigue Evaluation

AIMSafe: EEG-Based Driver Behavior Understanding Via Attention and Incremental Learning Mechanisms

A Driving Behavior Recognition Model with Bi-LSTM and Multi-Scale CNN