Abstract:The continuously increasing number of traffic accidents necessitates addressing distracted driving, which is responsible for numerous fatalities. Enhancing driver behavior recognition, particularly through developing a highly reliable Advanced Driver Assistance System (ADAS), holds substantial potential for cultivating safer transportation systems. Inspired by the success of Convolutional Neural Networks (CNNs), various networks have been proposed to enhance the detection accuracy of distracting behaviors. However, existing models have too many parameters and rely heavily on extensive labeled data, leading to time-consuming labeling and large models. To address these limitations, we propose a distracted behavior detection method based on a lightweight vision transformer trained using pseudo-label-based semi-supervised learning to learn discriminative representations from labeled and unlabeled data while ensuring a small model and speedy inference. Specifically, we create strong and weak augmented versions of the input minibatch and employ a hybrid lightweight transformer model in a teacher-student network. Pseudo-labels are generated from the teacher's predictions on weakly augmented data. The student model aligns with these labels on strongly augmented input, with teacher parameters evolving through exponential moving average. Our method presents a real-time, accurate solution for distracted driver detection, with the potential to significantly enhance road safety by reducing accidents. The effectiveness of the proposed approach is demonstrated through a comparative evaluation against alternative fully-supervised and semi-supervised methods. Furthermore, our method is evaluated in naturalistic driving settings with varying lighting and complex backgrounds. Experiments conducted on two publicly available driver distraction detection datasets show that our method outperforms current state-of-the-art approaches.

TransConvNet: Perform perceptually relevant driver's visual attention predictions

Driver attention prediction based on convolution and transformers

How Do Drivers Allocate Their Potential Attention? Driving Fixation Prediction via Convolutional Neural Networks

Prediction of the driver's focus of attention based on feature visualization of a deep autonomous driving model

A lightweight model combining convolutional neural network and Transformer for driver distraction recognition

FPT: Fine-Grained Detection of Driver Distraction Based on the Feature Pyramid Vision Transformer.

Multimodal driver distraction detection using dual-channel network of CNN and Transformer

Distracted Driving Detection by Combining ViT and CNN

Improving real-time driver distraction detection via constrained attention mechanism

VisionNet: A Drivable-space-based Interactive Motion Prediction Network for Autonomous Driving

FAM: Improving columnar vision transformer with feature attention mechanism

Driving Visual Saliency Prediction of Dynamic Night Scenes Via a Spatio-Temporal Dual-Encoder Network

FBLNet: FeedBack Loop Network for Driver Attention Prediction

Driver Distraction Detection Using Semi-Supervised Lightweight Vision Transformer

KVT: K-Nn Attention for Boosting Vision Transformers.

Driver Distraction Behavior Detection Using a Vision Transformer Model Based on Transfer Learning Strategy

Research on Visual Perception Technology of Autonomous Driving Based on Improved Convolutional Neural Network

Double Attention Convolutional Neural Network for Driver Action Recognition

Convolution-enhanced Evolving Attention Networks

Next-ViT: Next Generation Vision Transformer for Efficient Deployment in Realistic Industrial Scenarios