Abstract:Driver distraction causes a significant number of traffic accidents every year, resulting in economic losses and casualties. Currently, the level of automation in commercial vehicles is far from completely unmanned, and drivers still play an important role in operating and controlling the vehicle. Therefore, driver distraction behavior detection is crucial for road safety. At present, driver distraction detection primarily relies on traditional convolutional neural networks (CNN) and supervised learning methods. However, there are still challenges such as the high cost of labeled datasets, limited ability to capture high-level semantic information, and weak generalization performance. In order to solve these problems, this paper proposes a new self-supervised learning method based on masked image modeling for driver distraction behavior detection. Firstly, a self-supervised learning framework for masked image modeling (MIM) is introduced to solve the serious human and material consumption issues caused by dataset labeling. Secondly, the Swin Transformer is employed as an encoder. Performance is enhanced by reconfiguring the Swin Transformer block and adjusting the distribution of the number of window multi-head self-attention (W-MSA) and shifted window multi-head self-attention (SW-MSA) detection heads across all stages, which leads to model more lightening. Finally, various data augmentation strategies are used along with the best random masking strategy to strengthen the model's recognition and generalization ability. Test results on a large-scale driver distraction behavior dataset show that the self-supervised learning method proposed in this paper achieves an accuracy of 99.60%, approximating the excellent performance of advanced supervised learning methods. Our code is publicly available at <a class="link-external link-http" href="http://github.com/Rocky1salady-killer/SL-DDBD" rel="external noopener nofollow">this http URL</a>.

Multimodal driver distraction detection using dual-channel network of CNN and Transformer

FPT: Fine-Grained Detection of Driver Distraction Based on the Feature Pyramid Vision Transformer.

A lightweight model combining convolutional neural network and Transformer for driver distraction recognition

ViT-DD: Multi-Task Vision Transformer for Semi-Supervised Driver Distraction Detection

DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification

L-TLA: A Lightweight Driver Distraction Detection Method Based on Three-Level Attention Mechanisms

Fast Driver Distraction and Fatigue Detection Systems Based on Multiple Facial Behavior

Multi-scale space-time transformer for driving behavior detection

Double Attention Convolutional Neural Network for Driver Action Recognition

Applying Spatiotemporal Attention to Identify Distracted and Drowsy Driving with Vision Transformers

All in One Network for Driver Attention Monitoring

A Novel Driver Distraction Behavior Detection Method Based on Self-supervised Learning with Masked Image Modeling

Driver stress detection via multimodal fusion using attention-based CNN-LSTM

A multi-aware graph convolutional network for driver drowsiness detection

Multimodal Polynomial Fusion for Detecting Driver Distraction

TransConvNet: Perform perceptually relevant driver's visual attention predictions

Toward Extremely Lightweight Distracted Driver Recognition With Distillation-Based Neural Architecture Search and Knowledge Transfer

Domain Adaptive Driver Distraction Detection Based on Partial Feature Alignment and Confusion-Minimized Classification

Driver Distraction Recognition Based on CBAM Attention Mechanism.

Enhancing Road Safety: Real-Time Detection of Driver Distraction through Convolutional Neural Networks

Recongnition of Distracted Driving Behavior Based on Improved Bi-LSTM Model and Attention Mechanism