Abstract:Driver distraction diverting drivers' attention to unrelated tasks and decreasing the ability to control vehicles, has aroused widespread concern about driving safety. Previous studies have found that driving performance decreases after distraction and have used vehicle behavioral features to detect distraction. But how brain activity changes while distraction remains unknown. Electroencephalography (EEG), a reliable indicator of brain activities has been widely employed in many fields. However, challenges still exist in mining the distraction information of EEG in realistic driving scenarios with uncertain information. In this paper, we propose a novel framework based on Multi-scale entropy (MSE) in a sliding window and Bidirectional Long Short-term Memory Network (BiLSTM) to explore the distraction information of EEG to detect driver distraction based on multi-modality signals in real traffic. Firstly, MSE with sliding window is implemented to extract the EEG features to determine the distraction position. Statistical analysis of vehicle behavioral data is then performed to validate driving performance indeed changes around distraction position. Finally, we use BiLSTM to detect driver distraction with MSE and other traditional features. Our results show that MSE notably decreases after distraction. Consistent with the result of MSE, driving performance significantly deviates from the normal state after distraction. Besides, BiLSTM performance of MSE outperforms other entropy-based methods and is better than behavioral features. Additionally, the accuracy is improved again after adding MSE feature to behavioral features with a 3% increasement. The proposed framework is useful for mining brain activity information and driver distraction detection applications in realistic driving scenarios.

Using EEG to detect drivers' emotion with Bayesian Networks

Using Bayesian Networks with Human Personality and Situation Information to Detect Emotion States from EEG

EEG Emotion Recognition Based on Self-attention Dynamic Graph Neural Networks

EEG-based emotion recognition for road accidents in a simulated driving environment

Electroencephalogram-Based Driver Emotional State Detection with Manifold Learning

Driver Emotion Recognition Of Multiple-Ecg Feature Fusion Based On Bp Network And D-S Evidence

Emotion Recognition from EEG Based on Bayesian Networks

Cognitive Aspect of Emotion Estimation of a Driver

Driver Distraction Detection Using Bidirectional Long Short-Term Network Based on Multiscale Entropy of EEG

An Experimental Study on Physiological Parameters Toward Driver Emotion Recognition

Driver Emotion Recognition Involving Multimodal Signals: Electrophysiological Response, Nasal-Tip Temperature, and Vehicle Behavior

A Complex Network-Based Broad Learning System for Detecting Driver Fatigue from EEG Signals

Study on Driver Cross-Subject Emotion Recognition Based on Raw Multi-Channels EEG Data

A Bayesian Network (BN) Based Probabilistic Solution to Enhance Emotional Ontology

Driver Fatigue Evaluation Model with Integration of Multi-Indicators Based on Dynamic Bayesian Network

Detecting Emergency Situations by Monitoring Drivers' States from EEG

A Convolution Bidirectional Long Short-Term Memory Neural Network for Driver Emotion Recognition

Assessment of Driver Drowsiness Using Electroencephalogram Signals Based on Multiple Functional Brain Networks.

A Hybrid Approach for Driving Behavior Recognition: Integration of CNN and Transformer-Encoder with EEG Data

Driver emotion recognition based on attentional convolutional network

A Driver Model Based on Emotion.