Abstract:The continuously increasing number of traffic accidents necessitates addressing distracted driving, which is responsible for numerous fatalities. Enhancing driver behavior recognition, particularly through developing a highly reliable Advanced Driver Assistance System (ADAS), holds substantial potential for cultivating safer transportation systems. Inspired by the success of Convolutional Neural Networks (CNNs), various networks have been proposed to enhance the detection accuracy of distracting behaviors. However, existing models have too many parameters and rely heavily on extensive labeled data, leading to time-consuming labeling and large models. To address these limitations, we propose a distracted behavior detection method based on a lightweight vision transformer trained using pseudo-label-based semi-supervised learning to learn discriminative representations from labeled and unlabeled data while ensuring a small model and speedy inference. Specifically, we create strong and weak augmented versions of the input minibatch and employ a hybrid lightweight transformer model in a teacher-student network. Pseudo-labels are generated from the teacher's predictions on weakly augmented data. The student model aligns with these labels on strongly augmented input, with teacher parameters evolving through exponential moving average. Our method presents a real-time, accurate solution for distracted driver detection, with the potential to significantly enhance road safety by reducing accidents. The effectiveness of the proposed approach is demonstrated through a comparative evaluation against alternative fully-supervised and semi-supervised methods. Furthermore, our method is evaluated in naturalistic driving settings with varying lighting and complex backgrounds. Experiments conducted on two publicly available driver distraction detection datasets show that our method outperforms current state-of-the-art approaches.

A lightweight model combining convolutional neural network and Transformer for driver distraction recognition

Multimodal driver distraction detection using dual-channel network of CNN and Transformer

Model Lightweighting for Real-time Distraction Detection on Resource-Limited Devices

Toward Extremely Lightweight Distracted Driver Recognition With Distillation-Based Neural Architecture Search and Knowledge Transfer

Driver Distraction Detection Using Semi-Supervised Lightweight Vision Transformer

FPT: Fine-Grained Detection of Driver Distraction Based on the Feature Pyramid Vision Transformer.

Distracted Driving Detection by Combining ViT and CNN

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

MCANet: Hierarchical cross-fusion lightweight transformer based on multi-ConvHead attention for object detection

CTAFFNet: CNN–Transformer Adaptive Feature Fusion Object Detection Algorithm for Complex Traffic Scenarios

TransConvNet: Perform Perceptually Relevant Driver’s Visual Attention Predictions

TransConvNet: Perform perceptually relevant driver's visual attention predictions

Driver Distraction Recognition Based on CBAM Attention Mechanism.

A Lightweight Attention-Based Network towards Distracted Driving Behavior Recognition

Driver attention prediction based on convolution and transformers

Mfdd: Multi-scale Attention Fatigue and Distracted Driving Detector Based on Facial Features

Attention-based deep neural network for driver behavior recognition

Improving real-time driver distraction detection via constrained attention mechanism

Driver Distraction Recognition Based on Transfer Learning and Feature Fusion

L-TLA: A Lightweight Driver Distraction Detection Method Based on Three-Level Attention Mechanisms

CMNet: A Connect-and-Merge Convolutional Neural Network for Fast Vehicle Detection in Urban Traffic Surveillance.