Abstract:In recent years, deep learning-based driver fatigue detection algorithms have been increasingly used. However, traditional fatigue detection algorithms cannot effectively correlate contextual information of image frames. They perform better in individual image frames. Also, the accuracy and robustness of these algorithms are limited because they only consider particular frames. Therefore, a fatigue detection method based on integrated facial features and Gate Recurrent Unit (GRU) judgment neural network is proposed in this paper. We use a neural network including a GRU layer to efficiently distinguish the contextual information present in multiple image frames arranged in chronological order. Besides, we designed a multi-task convolutional neural network (MTCNN) model to extract comprehensive facial features. After obtaining the facial feature points' positions, we can calculate the aspect ratio between the upper and lower eyelids, the upper and lower lips, and the eyebrows to the chin. In addition to the above three features, we can also obtain the subject's three head pose angles by comparing the facial features with the typical 3D face model. Finally, we input the change curves of 6 features in 20 consecutive frames into the judgment network to learn the change rule and create a judgment network. After the learning is completed, the judgment network model will judge the six feature curves in the newly input 20 frames in real-time and output the driver's fatigue status. This fatigue detection method can take a real-time detection at 55 FPS on the workstation platform (TensorFlow 2.3.0, RTX2070s). On the Nvidia Jetson Xavier AGX embedded platform (TensorFlow lite, ARM 8-cores CPU), the method can take a real-time detection at 26 FPS. The accuracy of this fatigue detection method can reach 97.47%.

Driver's Gaze Zone Estimation Method: A Four-channel Convolutional Neural Network Model.

Continuous Driver'S Gaze Zone Estimation Using Rgb-D Camera

PerimetryNet: A Multiscale Fine Grained Deep Network for Three-Dimensional Eye Gaze Estimation Using Visual Field Analysis

Driver Gaze Zone Estimation via Head Pose Fusion Assisted Supervision and Eye Region Weighted Encoding

Driver’s Head Pose and Gaze Zone Estimation Based on Multi-Zone Templates Registration and Multi-Frame Point Cloud Fusion

A Multi-Modal Approach for Driver Gaze Prediction to Remove Identity Bias.

Single Camera Face Position-Invariant Driver's Gaze Zone Classifier Based on Frame-Sequence Recognition Using 3D Convolutional Neural Networks

A Nonintrusive and Real-Time Classification Method for Driver’s Gaze Region Using an RGB Camera

Head Pose-Free Eye Gaze Prediction for Driver Attention Study

Gaze Estimation Based on the Improved Xception Network

Dual-Cameras-Based Driver's Eye Gaze Tracking System with Non-Linear Gaze Point Refinement

A 3D Driver Head Pose Estimation Method Based on Depth Image

Gaze Estimation Using Neural Network And Logistic Regression

Self-calibrated Driver Gaze Estimation Via Gaze Pattern Learning

Driver Attention Tracking and Analysis

Driver Fatigue Detection Based on Residual Channel Attention Network and Head Pose Estimation

Model-Based 3D Gaze Estimation Using a TOF Camera

Driver fatigue detection based on comprehensive facial features and gated recurrent unit

Driver Fatigue Detection Based on Parallel Neural Network

Frequency-spatial Interaction Network for Gaze Estimation

Fast Driver Distraction and Fatigue Detection Systems Based on Multiple Facial Behavior