Abstract:Driver fatigue detection is one of the essential tools to reduce accidents and improve traffic safety. Its main challenge lies in the problem of how to identify the driver's fatigue state accurately. Existing detection methods include yawning and blinking based on facial expressions and physiological signals. Still, lighting and the environment affect the detection results based on facial expressions. In contrast, the electroencephalographic (EEG) signal is a physiological signal that directly responds to the human mental state, thus reducing the impact on the detection results. This paper proposes a log-Mel spectrogram and Convolution Recurrent Neural Network (CRNN) model based on EEG to implement driver fatigue detection. This structure allows the advantages of the different networks to be exploited to overcome the disadvantages of using them individually. The process is as follows: first, the original EEG signal is subjected to a one-dimensional convolution method to achieve a Short Time Fourier Transform (STFT) and passed through a Mel filter bank to obtain a logarithmic Mel spectrogram, and then the resulting logarithmic Mel spectrogram is fed into a fatigue detection model to complete the fatigue detection task for the EEG signals. The fatigue detection model consists of a 6-layer convolutional neural network (CNN), bi-directional recurrent neural networks (Bi-RNNs), and a classifier. In the modeling phase, spectrogram features are transported to the 6-layer CNN to automatically learn high-level features, thereby extracting temporal features in the bi-directional RNN to obtain spectrogram-temporal information. Finally, the alert or fatigue state is obtained by a classifier consisting of a fully connected layer, a ReLU activation function, and a softmax function. Experiments were conducted on publicly available datasets in this study. The results show that the method can accurately distinguish between alert and fatigue states with high stability. In addition, the performance of four existing methods was compared with the results of the proposed method, all of which showed that the proposed method could achieve the best results so far.

Driver Sleepiness Detection from EEG and EOG Signals Using GAN and LSTM Networks

Driving Drowsiness Detection With Eeg Using A Modified Hierarchical Extreme Learning Machine Algorithm With Particle Swarm Optimization: A Pilot Study

Detecting Driver Sleepiness from EEG Alpha Wave During Daytime Driving.

Driver Drowsiness Detection Using EEG and EOG with an Attention-CNN Framework

EOG-based drowsiness detection using convolutional neural networks

Vehicle driver drowsiness detection method using wearable EEG based on convolution neural network

Driver Drowsiness Recognition via 3D Conditional GAN and Two-Level Attention Bi-LSTM

Detecting slow eye movements with bimodal-LSTM for recognizing drivers’ sleep onset period

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Heavy Truck Driver's Drowsiness Detection Method Using Wearable EEG Based on Convolution Neural Network

Cascaded Convolutional Neural Network with Attention Mechanism for Mobile EEG-based Driver Drowsiness Detection System

EEG_DMNet: A Deep Multi-Scale Convolutional Neural Network for Electroencephalography-Based Driver Drowsiness Detection

Detecting Driver Drowsiness as an Anomaly Using LSTM Autoencoders

DrowzEE-G-Mamba: Leveraging EEG and State Space Models for Driver Drowsiness Detection

A Compact and Interpretable Convolutional Neural Network for Cross-Subject Driver Drowsiness Detection from Single-Channel EEG

A Study on Drowsy Driving State Based on EEG Signals

EEG brain signals to detect the sleep health of a driver: An automated framework system based on deep learning

Multimodal System to Detect Driver Fatigue Using EEG, Gyroscope, and Image Processing

Recognizing drowsiness in young men during real driving based on electroencephalography using an end-to-end deep learning approach

EEG and Forehead EOG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks.

Assessment of Driver Drowsiness Using Electroencephalogram Signals Based on Multiple Functional Brain Networks.