Abstract:Transportation Research Record, Ahead of Print. With the development of conditionally automated driving, drivers will be allowed to perform non-driving-related tasks. Under such circumstances, continuous monitoring of driver cognitive load will play an increasingly important role in ensuring that drivers have sufficient mental resources to take over control of the vehicle should the driving automation fail. However, estimation of cognitive load is challenging because of the difficulties in identifying high-level feature representation and accounting for interindividual differences. Physiological measures are believed to be promising candidates for cognitive load estimation in partially automated vehicles. However, current estimation methods are mainly based on the manual feature extraction of time- or frequency-domain indicators from physiological signals, which may not adapt to dynamic driving conditions. With the development of deep learning, the neural network has shown good performance in automatically capturing high-level features from input data. Inspired by this, we adopted a novel approach to classify driver cognitive load based on electrocardiogram (ECG) spectrograms, in which the driver's ECG signal was collected and transformed into a 2D spectrogram by a short-time Fourier transform. A squeeze-and-excitation network-based deep-learning framework that can capture high-level features and pays more attention to the cognition-related features of the spectrogram was proposed for classification. Experiments on a publicly available dataset demonstrated that our model achieved an accuracy of 96.76% in differentiating two levels of cognitive load for a within-subject evaluation and 71.50% accuracy with an across-subjects evaluation. The results demonstrated the feasibility of detecting drivers' cognitive load through deep learning using ECG spectrogram alone.

Harnessing Electrocardiography Signals for Driver State Classification Using Multi-layered Neural Networks

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

Assessment of Driver Drowsiness Using Electroencephalogram Signals Based on Multiple Functional Brain Networks.

A Multi-Model Analysis for Driving Fatigue Detection using EEG Signals

EEG_DMNet: A Deep Multi-Scale Convolutional Neural Network for Electroencephalography-Based Driver Drowsiness Detection

Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data

Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network

Heavy Truck Driver's Drowsiness Detection Method Using Wearable EEG Based on Convolution Neural Network

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System

Recognizing drowsiness in young men during real driving based on electroencephalography using an end-to-end deep learning approach

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

A Driving Performance Forecasting System Based on Brain Dynamic State Analysis Using 4-D Convolutional Neural Networks

Classification of Drowsiness Levels Based on a Deep Spatio-Temporal Convolutional Bidirectional LSTM Network Using Electroencephalography Signals

Classification of Driver Cognitive Load in Conditionally Automated Driving: Utilizing Electrocardiogram-Based Spectrogram with Lightweight Neural Network

EEG-based Classification of Drivers Attention using Convolutional Neural Network

Deep Learning for Detecting Multi-Level Driver Fatigue Using Physiological Signals: A Comprehensive Approach

EEG Based Driver Inattention Identification via Feature Profiling and Dimensionality Reduction

Deep Learning-based EEG Detection of Mental Alertness States from Drivers under Ethical Aspects.

A Study on Drowsy Driving State Based on EEG Signals

Linking Attention-Based Multiscale CNN With Dynamical GCN for Driving Fatigue Detection

DrowzEE-G-Mamba: Leveraging EEG and State Space Models for Driver Drowsiness Detection