Abstract:Fatigue driving behavior recognition in all-weather real driving environments is a challenging task. Accurate recognition of fatigue driving behavior is helpful to improve traffic safety. The facial landmark detector is crucial to fatigue driving recognition. However, existing facial landmark detectors are mainly aimed at stable front face color images instead of side face gray images, which is difficult to adapt to the fatigue driving behavior recognition in real dynamic scenes. To maximize the driver's facial feature information and temporal characteristics, a fatigue driving behavior recognition method based on a multi-scale facial landmark detector (MSFLD) is proposed. First, a spatial pyramid pooling and multi-scale feature output (SPP-MSFO) detection model is built to obtain a face region image. The MSFLD is a lightweight facial landmark detector, which is composed of convolution layers, inverted bottleneck blocks, and multi-scale full connection layers to achieve accurate detection of 23 key points on the face. Second, the aspect ratios of the left eye, right eye and mouth are calculated in accordance with the coordinates of the key points to form a fatigue parameter matrix. Finally, the combination of adaptive threshold and statistical threshold is used to avoid misjudgment of fatigue driving recognition. The adaptive threshold is dynamic, which solves the problem of the difference in the aspect ratio of the eyes and mouths of different drivers. The statistical threshold is a supplement to solve the problem of driver's low eye threshold and high mouth threshold. The proposed methods are evaluated on the Hunan University Fatigue Detection (HNUFDD) dataset. The proposed MSFLD achieves a normalized mean error value of 5.4518%, and the accuracy of the fatigue driving recognition method based on MSFLD achieves 99.1329%, which outperforms that of state-of-the-art methods.

Research on Deep Learning-based Driver Fatigue Driving Behavior Recognition Methods

Driver fatigue detection method based on facial features using deep learning

Real-time detection method of driver fatigue state based on deep learning of face video

Driver fatigue detection based on deeply-learned facial expression representation

Research Progress on the Development of Fatigue Driving Detection Based on Deep Learning

Researching Driver Fatigue Detection Using Video Technology

Real-Time Detection of Fatigue Driving Based on Face Recognition

Research on Driver Fatigue Monitoring Algorithm Based on Deep Learning

Fatigue Driving Detection Based on Deep Learning and Multi-Index Fusion

Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features

A systematic review for the fatigue driving behavior recognition method

Real-time Monitoring of Driver Fatigue Based on Eye State Recognition

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

Fatigue driving detection based on facial state recognition

A Novel Fatigue Driving State Recognition and Warning Method Based on EEG and EOG Signals

Adaptive Driver Face Feature Fatigue Detection Algorithm Research

An fNIRS labeling image feature-based customized driving fatigue detection method

Detection of driver fatigue driving behaviour based on deep learning algorithm from the perspective of traffic psychology

A Driver Fatigue Recognition Algorithm Based on Spatio-Temporal Feature Sequence

Fatigue driving recognition based on deep learning and graph neural network