Abstract:Fatigue driving behavior recognition in all-weather real driving environments is a challenging task. Accurate recognition of fatigue driving behavior is helpful to improve traffic safety. The facial landmark detector is crucial to fatigue driving recognition. However, existing facial landmark detectors are mainly aimed at stable front face color images instead of side face gray images, which is difficult to adapt to the fatigue driving behavior recognition in real dynamic scenes. To maximize the driver's facial feature information and temporal characteristics, a fatigue driving behavior recognition method based on a multi-scale facial landmark detector (MSFLD) is proposed. First, a spatial pyramid pooling and multi-scale feature output (SPP-MSFO) detection model is built to obtain a face region image. The MSFLD is a lightweight facial landmark detector, which is composed of convolution layers, inverted bottleneck blocks, and multi-scale full connection layers to achieve accurate detection of 23 key points on the face. Second, the aspect ratios of the left eye, right eye and mouth are calculated in accordance with the coordinates of the key points to form a fatigue parameter matrix. Finally, the combination of adaptive threshold and statistical threshold is used to avoid misjudgment of fatigue driving recognition. The adaptive threshold is dynamic, which solves the problem of the difference in the aspect ratio of the eyes and mouths of different drivers. The statistical threshold is a supplement to solve the problem of driver's low eye threshold and high mouth threshold. The proposed methods are evaluated on the Hunan University Fatigue Detection (HNUFDD) dataset. The proposed MSFLD achieves a normalized mean error value of 5.4518%, and the accuracy of the fatigue driving recognition method based on MSFLD achieves 99.1329%, which outperforms that of state-of-the-art methods.

Fatigue driving detection based on facial state recognition

Fatigue Driving Facial Feature Detection Based on Lightweight Convolutional Neural Network

Research on Driver Fatigue State Detection Method Based on Deep Learning

Real-Time Detection of Fatigue Driving Based on Face Recognition

A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion

Fatigue State Detection Based on Multi-Index Fusion and State Recognition Network

A Practical Eye State Recognition Based Driver Fatigue Detection Method

A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7.

Driver fatigue detection based on deeply-learned facial expression representation

A New Method for Driver Fatigue Detection Based on Eye State

Research on Fatigued-Driving Detection Method by Integrating Lightweight YOLOv5s and Facial 3D Keypoints

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector

Revolutionizing Road Safety: YOLOv8-Powered Driver Fatigue Detection

Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features

Real-time detection method of driver fatigue state based on deep learning of face video

Research on Driver Fatigue Detection

Researching Driver Fatigue Detection Using Video Technology

Fatigue Detection Based on Facial Feature Correction and Fusion

Multi-parameter Fusion Driver Fatigue Detection Method Based on Facial Fatigue Features

Fatigue Driving Detection Based on Deep Learning and Multi-Index Fusion

Advancing driver fatigue detection in diverse lighting conditions for assisted driving vehicles with enhanced facial recognition technologies