Abstract:Fatigue driving behavior recognition in all-weather real driving environments is a challenging task. Accurate recognition of fatigue driving behavior is helpful to improve traffic safety. The facial landmark detector is crucial to fatigue driving recognition. However, existing facial landmark detectors are mainly aimed at stable front face color images instead of side face gray images, which is difficult to adapt to the fatigue driving behavior recognition in real dynamic scenes. To maximize the driver's facial feature information and temporal characteristics, a fatigue driving behavior recognition method based on a multi-scale facial landmark detector (MSFLD) is proposed. First, a spatial pyramid pooling and multi-scale feature output (SPP-MSFO) detection model is built to obtain a face region image. The MSFLD is a lightweight facial landmark detector, which is composed of convolution layers, inverted bottleneck blocks, and multi-scale full connection layers to achieve accurate detection of 23 key points on the face. Second, the aspect ratios of the left eye, right eye and mouth are calculated in accordance with the coordinates of the key points to form a fatigue parameter matrix. Finally, the combination of adaptive threshold and statistical threshold is used to avoid misjudgment of fatigue driving recognition. The adaptive threshold is dynamic, which solves the problem of the difference in the aspect ratio of the eyes and mouths of different drivers. The statistical threshold is a supplement to solve the problem of driver's low eye threshold and high mouth threshold. The proposed methods are evaluated on the Hunan University Fatigue Detection (HNUFDD) dataset. The proposed MSFLD achieves a normalized mean error value of 5.4518%, and the accuracy of the fatigue driving recognition method based on MSFLD achieves 99.1329%, which outperforms that of state-of-the-art methods.

FPN-D-Based Driver Smoking Behavior Detection Method

A Slight Smoke Perceptual Network.

Smart Education Case: a Detection Method of the Driver's Smoking Behavior

Driver identification and fatigue detection algorithm based on deep learning

Driver Distraction Behavior Detection Method Based on Deep Learning

Smoking Behavior Detection Based on Hand Trajectory Tracking and Mouth Saturation Changes

FDAN: Fuzzy deep attention networks for driver behavior recognition

An fNIRS labeling image feature-based customized driving fatigue detection method

Smoking Behavior Recognition Based on a Two-Level Attention Fine-Grained Model and EfficientDet Network.

RFDANet: an FMCW and TOF radar fusion approach for driver activity recognition using multi-level attention based CNN and LSTM network

Fatigue Driving Recognition Method Based on Multi-Scale Facial Landmark Detector

FPIRST: Fatigue Driving Recognition Method Based on Feature Parameter Images and a Residual Swin Transformer

Smoking behavior detection algorithm based on YOLOv8-MNC

Research on Lightweight-Based Algorithm for Detecting Distracted Driving Behaviour

Application of Deep Learning Methods in Driver Behavior Recognition

Human-Factors-in-Driving-Loop: Driver Identification and Verification via a Deep Learning Approach using Psychological Behavioral Data

SMWE-GFPNNet: A High-precision and Robust Method for Forest Fire Smoke Detection

Smoking-YOLOv8: a novel smoking detection algorithm for chemical plant personnel

Driver behavior recognition based on deep convolutional neural networks

Driver fatigue detection method based on facial features using deep learning

A driver’s dangerous driving behavior detection method based on the YOLOV5-CA network