Abstract:In response to the problem of high computational and parameter requirements of fatigued-driving detection models, as well as weak facial-feature keypoint extraction capability, this paper proposes a lightweight and real-time fatigued-driving detection model based on an improved YOLOv5s and Attention Mesh 3D keypoint extraction method. The main strategies are as follows: (1) Using Shufflenetv2_BD to reconstruct the Backbone network to reduce parameter complexity and computational load. (2) Introducing and improving the fusion method of the Cross-scale Aggregation Module (CAM) between the Backbone and Neck networks to reduce information loss in shallow features of closed-eyes and closed-mouth categories. (3) Building a lightweight Context Information Fusion Module by combining the Efficient Multi-Scale Module (EAM) and Depthwise Over-Parameterized Convolution (DoConv) to enhance the Neck network's ability to extract facial features. (4) Redefining the loss function using Wise-IoU (WIoU) to accelerate model convergence. Finally, the fatigued-driving detection model is constructed by combining the classification detection results with the thresholds of continuous closed-eye frames, continuous yawning frames, and PERCLOS (Percentage of Eyelid Closure over the Pupil over Time) of eyes and mouth. Under the premise that the number of parameters and the size of the baseline model are reduced by 58% and 56.3%, respectively, and the floating point computation is only 5.9 GFLOPs, the average accuracy of the baseline model is increased by 1%, and the Fatigued-recognition rate is 96.3%, which proves that the proposed algorithm can achieve accurate and stable real-time detection while lightweight. It provides strong support for the lightweight deployment of vehicle terminals.

A Real-Time and Lightweight Driver Fatigue Detection Model Using Anchor-Free and Visual-Attention Mechanisms

Real-time detection method of driver fatigue state based on deep learning of face video

Driver fatigue detection based on convolutional neural network and face alignment for edge computing device

Research on Fatigued-Driving Detection Method by Integrating Lightweight YOLOv5s and Facial 3D Keypoints

Researching Driver Fatigue Detection Using Video Technology

Research on a Real-Time Driver Fatigue Detection Algorithm Based on Facial Video Sequences

Driver fatigue detection method based on multi-feature empirical fusion model

Mfdd: Multi-scale Attention Fatigue and Distracted Driving Detector Based on Facial Features

A Real-Time System for Monitoring Driver Fatigue

Real-time Driver Fatigue Detection Based on Simplified Landmarks of AAM

A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion

A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image

Driving Fatigue Detection Based on the Combination of Multi-Branch 3D-CNN and Attention Mechanism

Real-time Driver Fatigue Detection Based on Face Alignment

Driver Fatigue Detection Based on Residual Channel Attention Network and Head Pose Estimation

A New Method to Detect Driver Fatigue Based on EMG and ECG Collected by Portable Non-Contact Sensors

Driver Fatigue Detection Using Improved Deep Learning and Personalized Framework

Fatigue Driving Detection Based on Deep Learning and Multi-Index Fusion

Driver Emotion and Fatigue State Detection Based on Time Series Fusion

Revolutionizing Road Safety: YOLOv8-Powered Driver Fatigue Detection

Research on Driver Fatigue State Detection Method Based on Deep Learning