Abstract:Fatigue driving behavior recognition in all-weather real driving environments is a challenging task. Accurate recognition of fatigue driving behavior is helpful to improve traffic safety. The facial landmark detector is crucial to fatigue driving recognition. However, existing facial landmark detectors are mainly aimed at stable front face color images instead of side face gray images, which is difficult to adapt to the fatigue driving behavior recognition in real dynamic scenes. To maximize the driver's facial feature information and temporal characteristics, a fatigue driving behavior recognition method based on a multi-scale facial landmark detector (MSFLD) is proposed. First, a spatial pyramid pooling and multi-scale feature output (SPP-MSFO) detection model is built to obtain a face region image. The MSFLD is a lightweight facial landmark detector, which is composed of convolution layers, inverted bottleneck blocks, and multi-scale full connection layers to achieve accurate detection of 23 key points on the face. Second, the aspect ratios of the left eye, right eye and mouth are calculated in accordance with the coordinates of the key points to form a fatigue parameter matrix. Finally, the combination of adaptive threshold and statistical threshold is used to avoid misjudgment of fatigue driving recognition. The adaptive threshold is dynamic, which solves the problem of the difference in the aspect ratio of the eyes and mouths of different drivers. The statistical threshold is a supplement to solve the problem of driver's low eye threshold and high mouth threshold. The proposed methods are evaluated on the Hunan University Fatigue Detection (HNUFDD) dataset. The proposed MSFLD achieves a normalized mean error value of 5.4518%, and the accuracy of the fatigue driving recognition method based on MSFLD achieves 99.1329%, which outperforms that of state-of-the-art methods.

Eye Location in Face Images for Driver Fatigue Monitoring

Locatization of Human Eyes Based on a Series of Binary Images

Real-Time Eye Locating And Tracking For Driver Fatigue Detection

Real-time Monitoring of Driver Fatigue Based on Eye State Recognition

Driver's Eye Region Location Algorithm

Train Driver Fatigue Detection Using Eye Feature Vector and Support Vector Machine

Real-time Driver Fatigue Detection Based on Face Alignment

A Fast Method For Monitoring Driver Fatigue Using Monocular Camera

Detection method of eyes opening and closing ratio for driver's fatigue monitoring

A practical driver fatigue detection algorithm based on eye state

Detection Method for Driver Fatigue with Computerized Vision

Research on Eye Location Algorithm Robust to Driver's Pose and Illumination

Real-Time System for Driver Fatigue Detection by RGB-D Camera

Design and Implementation of a Real-Time Eye Tracking System

Machine vision based fatigue driving monitoring method and system

Driver Drowsiness Recognition Based on Computer Vision Technology

Eye Localization Based On Face Alignment

Study on the Detection of Locomotive Driver Fatigue Based on Image

Research on key technologies of intelligent transportation based on image recognition and anti-fatigue driving

Real-Time Detection of Fatigue Driving Based on Face Recognition

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector