Abstract:Driver fatigue detection is one of the essential tools to reduce accidents and improve traffic safety. Its main challenge lies in the problem of how to identify the driver's fatigue state accurately. Existing detection methods include yawning and blinking based on facial expressions and physiological signals. Still, lighting and the environment affect the detection results based on facial expressions. In contrast, the electroencephalographic (EEG) signal is a physiological signal that directly responds to the human mental state, thus reducing the impact on the detection results. This paper proposes a log-Mel spectrogram and Convolution Recurrent Neural Network (CRNN) model based on EEG to implement driver fatigue detection. This structure allows the advantages of the different networks to be exploited to overcome the disadvantages of using them individually. The process is as follows: first, the original EEG signal is subjected to a one-dimensional convolution method to achieve a Short Time Fourier Transform (STFT) and passed through a Mel filter bank to obtain a logarithmic Mel spectrogram, and then the resulting logarithmic Mel spectrogram is fed into a fatigue detection model to complete the fatigue detection task for the EEG signals. The fatigue detection model consists of a 6-layer convolutional neural network (CNN), bi-directional recurrent neural networks (Bi-RNNs), and a classifier. In the modeling phase, spectrogram features are transported to the 6-layer CNN to automatically learn high-level features, thereby extracting temporal features in the bi-directional RNN to obtain spectrogram-temporal information. Finally, the alert or fatigue state is obtained by a classifier consisting of a fully connected layer, a ReLU activation function, and a softmax function. Experiments were conducted on publicly available datasets in this study. The results show that the method can accurately distinguish between alert and fatigue states with high stability. In addition, the performance of four existing methods was compared with the results of the proposed method, all of which showed that the proposed method could achieve the best results so far.

3‐3: Invited Paper: Prediction Model for Visual Fatigue Caused by Smartphone Display Based on EEG Multi‐dimensional Features

Atlsmms Network: an Attentional-Bilstm Based Multi-Model Prediction for Smartphone Visual Fatigue

Physiological Signals Based Fatigue Prediction Model for Motion Sensing Games

EEG-Based 3D Visual Fatigue Evaluation Using CNN

Evaluating 3D Visual Fatigue Induced by VR Headset Using EEG and Self-attention CNN

Mental Fatigue Prediction Model Based on Multimodal Fusion

Visual Fatigue Assessment Model Based on Eye-Related Data in Virtual Reality

Mental fatigue recognition study based on 1D convolutional neural network and short-term ECG signals

Assessment of Eye Fatigue Caused by Head-Mounted Displays Using Eye-Tracking

Assessment visual fatigue of watching 3DTV using EEG power spectral parameters.

Machine vision detection to daily facial fatigue with a nonlocal 3D attention network

EEG Signal and Feature Interaction Modeling-Based Eye Behavior Prediction Research

Evaluation of Visual Fatigue Caused by 3D Display

Eye Fatigue Assessment Method for Naked Eye 3D Display Based on Multiple Eye Movements

Eye Fatigue Assessment Using Unobtrusive Eye Tracker.

Study of Objective Parameters of 3D Visual Fatigue Based on Analysis of Salient Area.

A novel deep-learning model based on τ-shaped convolutional network (τNet) with long short-term memory (LSTM) for physiological fatigue detection from EEG and EOG signals

EEG driving fatigue detection based on log-Mel spectrogram and convolutional recurrent neural networks

Detecting Dynamic Behavior of Brain Fatigue Through 3-D-CNN-LSTM

Remote Photoplethysmography and Motion Tracking Convolutional Neural Network with Bidirectional Long Short-Term Memory: Non-Invasive Fatigue Detection Method Based on Multi-Modal Fusion

Cognitive Load Prediction from Multimodal Physiological Signals Using Multiview Learning.