Abstract:Driver fatigue detection is one of the essential tools to reduce accidents and improve traffic safety. Its main challenge lies in the problem of how to identify the driver's fatigue state accurately. Existing detection methods include yawning and blinking based on facial expressions and physiological signals. Still, lighting and the environment affect the detection results based on facial expressions. In contrast, the electroencephalographic (EEG) signal is a physiological signal that directly responds to the human mental state, thus reducing the impact on the detection results. This paper proposes a log-Mel spectrogram and Convolution Recurrent Neural Network (CRNN) model based on EEG to implement driver fatigue detection. This structure allows the advantages of the different networks to be exploited to overcome the disadvantages of using them individually. The process is as follows: first, the original EEG signal is subjected to a one-dimensional convolution method to achieve a Short Time Fourier Transform (STFT) and passed through a Mel filter bank to obtain a logarithmic Mel spectrogram, and then the resulting logarithmic Mel spectrogram is fed into a fatigue detection model to complete the fatigue detection task for the EEG signals. The fatigue detection model consists of a 6-layer convolutional neural network (CNN), bi-directional recurrent neural networks (Bi-RNNs), and a classifier. In the modeling phase, spectrogram features are transported to the 6-layer CNN to automatically learn high-level features, thereby extracting temporal features in the bi-directional RNN to obtain spectrogram-temporal information. Finally, the alert or fatigue state is obtained by a classifier consisting of a fully connected layer, a ReLU activation function, and a softmax function. Experiments were conducted on publicly available datasets in this study. The results show that the method can accurately distinguish between alert and fatigue states with high stability. In addition, the performance of four existing methods was compared with the results of the proposed method, all of which showed that the proposed method could achieve the best results so far.

A Generative Adaptive Convolutional Neural Network with Attention Mechanism for Driver Fatigue Detection with Class-imbalanced and Insufficient Data

Fatigue Driving Facial Feature Detection Based on Lightweight Convolutional Neural Network

Research on Fatigue Driving Detection Technology Based on CA-ACGAN

Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion

Driving Fatigue Detection Based on the Combination of Multi-Branch 3D-CNN and Attention Mechanism

A Comprehensive Vision-Based Model for Commercial Truck Driver Fatigue Detection.

Efficient detection of driver fatigue state based on all-weather illumination scenarios

Linking Attention-Based Multiscale CNN With Dynamical GCN for Driving Fatigue Detection

A Recurrence Network-Based Convolutional Neural Network for Fatigue Driving Detection from EEG.

Attention-Guided Multi-scale Convolutional Neural Network for Driving Fatigue Detection

Mfdd: Multi-scale Attention Fatigue and Distracted Driving Detector Based on Facial Features

Convolutional Two-Stream Network Using Multi-Facial Feature Fusion for Driver Fatigue Detection

Attention-based Cross-Frequency Graph Convolutional Network for Driver Fatigue Estimation

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Driver Fatigue Detection Based on Residual Channel Attention Network and Head Pose Estimation

A New Algorithm Based on Cascaded Convolutional Neural Network for Driver Fatigue Detection

Driver Drowsiness Recognition via 3D Conditional GAN and Two-Level Attention Bi-LSTM

Driver Fatigue Detection Based on Facial Key Points and LSTM.

Adaptive multi-branch CNN of integrating manual features and functional network for driver fatigue detection

Attention-based multi-semantic dynamical graph convolutional network for eeg-based fatigue detection

Research on Fatigue Driving Detection Method Based on Lightweight Convolutional Neural Network