Abstract:Driver fatigue detection is one of the essential tools to reduce accidents and improve traffic safety. Its main challenge lies in the problem of how to identify the driver's fatigue state accurately. Existing detection methods include yawning and blinking based on facial expressions and physiological signals. Still, lighting and the environment affect the detection results based on facial expressions. In contrast, the electroencephalographic (EEG) signal is a physiological signal that directly responds to the human mental state, thus reducing the impact on the detection results. This paper proposes a log-Mel spectrogram and Convolution Recurrent Neural Network (CRNN) model based on EEG to implement driver fatigue detection. This structure allows the advantages of the different networks to be exploited to overcome the disadvantages of using them individually. The process is as follows: first, the original EEG signal is subjected to a one-dimensional convolution method to achieve a Short Time Fourier Transform (STFT) and passed through a Mel filter bank to obtain a logarithmic Mel spectrogram, and then the resulting logarithmic Mel spectrogram is fed into a fatigue detection model to complete the fatigue detection task for the EEG signals. The fatigue detection model consists of a 6-layer convolutional neural network (CNN), bi-directional recurrent neural networks (Bi-RNNs), and a classifier. In the modeling phase, spectrogram features are transported to the 6-layer CNN to automatically learn high-level features, thereby extracting temporal features in the bi-directional RNN to obtain spectrogram-temporal information. Finally, the alert or fatigue state is obtained by a classifier consisting of a fully connected layer, a ReLU activation function, and a softmax function. Experiments were conducted on publicly available datasets in this study. The results show that the method can accurately distinguish between alert and fatigue states with high stability. In addition, the performance of four existing methods was compared with the results of the proposed method, all of which showed that the proposed method could achieve the best results so far.

Detecting Fatigue Status of Pilots Based on Deep Learning Network Using EEG Signals

Pilots’ Fatigue Status Recognition Using Deep Contractive Autoencoder Network

Recognition of Fatigue Status of Pilots Based on Deep Contractive Auto-Encoding Network

Recognition of Fatigue Status of Pilots Based on Deep Contractive Sparse Auto-Encoding Network

Decoding Fatigue Levels of Pilots Using EEG Signals with Hybrid Deep Neural Networks

Identification of Pilots' Fatigue Status Based on Electrocardiogram Signals

Driver Fatigue Detection Through Deep Transfer Learning in an Electroencephalogram-based System

Modeling and analysis of fatigue detection with multi-channel data fusion

Automatic Detection of Driver Fatigue Based on EEG Signals Using a Developed Deep Neural Network

Electroencephalography Based Fatigue Detection Using a Novel Feature Fusion and Extreme Learning Machine

Driver fatigue state detection based on EEG and EOG feature fusion and deep learning

Fatigue Driving State Detection Based on Spatial Characteristics of EEG Signals

Single-channel EEG-based mental fatigue detection based on deep belief network

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Nonparametric Bayesian Prior Inducing Deep Network for Automatic Detection of Cognitive Status

EEG and Forehead EOG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks.

CEEMDAN Fuzzy Entropy Based Fatigue Driving Detection Using Single-Channel EEG

Self-Paced Dynamic Infinite Mixture Model for Fatigue Evaluation of Pilots' Brains

Deep Learning for Detecting Multi-Level Driver Fatigue Using Physiological Signals: A Comprehensive Approach

EEG-based mental fatigue detection using linear prediction cepstral coefficients and Riemann spatial covariance matrix

A Recurrence Network-Based Convolutional Neural Network for Fatigue Driving Detection from EEG.