Abstract:Transportation Research Record, Ahead of Print. With the development of conditionally automated driving, drivers will be allowed to perform non-driving-related tasks. Under such circumstances, continuous monitoring of driver cognitive load will play an increasingly important role in ensuring that drivers have sufficient mental resources to take over control of the vehicle should the driving automation fail. However, estimation of cognitive load is challenging because of the difficulties in identifying high-level feature representation and accounting for interindividual differences. Physiological measures are believed to be promising candidates for cognitive load estimation in partially automated vehicles. However, current estimation methods are mainly based on the manual feature extraction of time- or frequency-domain indicators from physiological signals, which may not adapt to dynamic driving conditions. With the development of deep learning, the neural network has shown good performance in automatically capturing high-level features from input data. Inspired by this, we adopted a novel approach to classify driver cognitive load based on electrocardiogram (ECG) spectrograms, in which the driver's ECG signal was collected and transformed into a 2D spectrogram by a short-time Fourier transform. A squeeze-and-excitation network-based deep-learning framework that can capture high-level features and pays more attention to the cognition-related features of the spectrogram was proposed for classification. Experiments on a publicly available dataset demonstrated that our model achieved an accuracy of 96.76% in differentiating two levels of cognitive load for a within-subject evaluation and 71.50% accuracy with an across-subjects evaluation. The results demonstrated the feasibility of detecting drivers' cognitive load through deep learning using ECG spectrogram alone.

An Electro-Oculogram (EOG) Sensor's Ability to Detect Driver Hypovigilance Using Machine Learning

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

An EOG-based Vigilance Estimation Method Applied for Driver Fatigue Detection

Association of Visual-Based Signals with Electroencephalography Patterns in Enhancing the Drowsiness Detection in Drivers with Obstructive Sleep Apnea

Estimate Vigilance in Driving Simulation Based on Detection of Light Drowsiness.

A Hybrid Vigilance Monitoring Study for Mental Fatigue and Its Neural Activities

Driver fatigue detection from electroencephalogram spectrum after electrooculography artefact removal

Drowsiness Detection Using Ocular Indices from EEG Signal

Online vigilance analysis combining video and electrooculography features

A Novel Approach To Driving Fatigue Detection Using Forehead Eog

Human Computer Interface Using Electroencephalography for Driver Behavior Classification

A Novel Fatigue Driving State Recognition and Warning Method Based on EEG and EOG Signals

Optimizing Driver Vigilance Recognition: Examining the Characterization and Cumulative Effect of Physiological Signals Across Manual and Automated Driving and Durations

Faster Single Model Vigilance Detection Based on Deep Learning

Driver Drowsiness Detection using Machine Learning and Deep Learning

Detecting Slow Eye Movement for Recognizing Driver's Sleep Onset Period with EEG Features.

Detection of Driving Fatigue by Using Noncontact EMG and ECG Signals Measurement System

Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network

Fatigue driving detection based on electrooculography: a review

Fatigue driving detection technology based on EEG signal

EEG and Forehead EOG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks.