Abstract:In response to the problem of high computational and parameter requirements of fatigued-driving detection models, as well as weak facial-feature keypoint extraction capability, this paper proposes a lightweight and real-time fatigued-driving detection model based on an improved YOLOv5s and Attention Mesh 3D keypoint extraction method. The main strategies are as follows: (1) Using Shufflenetv2_BD to reconstruct the Backbone network to reduce parameter complexity and computational load. (2) Introducing and improving the fusion method of the Cross-scale Aggregation Module (CAM) between the Backbone and Neck networks to reduce information loss in shallow features of closed-eyes and closed-mouth categories. (3) Building a lightweight Context Information Fusion Module by combining the Efficient Multi-Scale Module (EAM) and Depthwise Over-Parameterized Convolution (DoConv) to enhance the Neck network's ability to extract facial features. (4) Redefining the loss function using Wise-IoU (WIoU) to accelerate model convergence. Finally, the fatigued-driving detection model is constructed by combining the classification detection results with the thresholds of continuous closed-eye frames, continuous yawning frames, and PERCLOS (Percentage of Eyelid Closure over the Pupil over Time) of eyes and mouth. Under the premise that the number of parameters and the size of the baseline model are reduced by 58% and 56.3%, respectively, and the floating point computation is only 5.9 GFLOPs, the average accuracy of the baseline model is increased by 1%, and the Fatigued-recognition rate is 96.3%, which proves that the proposed algorithm can achieve accurate and stable real-time detection while lightweight. It provides strong support for the lightweight deployment of vehicle terminals.

Research on Eye Location Algorithm Robust to Driver's Pose and Illumination

Driver's Eye Region Location Algorithm

Facial Feature Localization Using Robust Active Shape Model and POEM Descriptors

Robust Three-step Facial Landmark Localization under the Complicated Condition via ASM and POEM.

Real-Time System for Driver Fatigue Detection by RGB-D Camera

A Research on the Algorithm for Driver's Eye Positioning and Tracking

A practical driver fatigue detection algorithm based on eye state

Driver Drowsiness Recognition Based on Computer Vision Technology

Real-Time Eye Locating And Tracking For Driver Fatigue Detection

Estimation of Head Orientation for Safe Driving

Optical flow and driver's kinematics analysis for state of alert sensing

Real-time Driver Fatigue Detection Based on Face Alignment

Driver Motion Detection Using Online Sequential Learning

Driver Drowsiness Detection by Using Front Camera of the Mobile Phone

A Real-Time Adaptive Learning Method for Driver Eye Detection

Improving automatic detection of driver fatigue and distraction using machine learning

Towards Evaluating Driver Fatigue with Robust Deep Learning Models

Real-time Monitoring of Driver Fatigue Based on Eye State Recognition

Research on Fatigued-Driving Detection Method by Integrating Lightweight YOLOv5s and Facial 3D Keypoints

Lightweight YOLOv8 Networks for Driver Profile Face Drowsiness Detection

Driver fatigue detection method based on multi-feature empirical fusion model