Abstract:Driver distraction causes a significant number of traffic accidents every year, resulting in economic losses and casualties. Currently, the level of automation in commercial vehicles is far from completely unmanned, and drivers still play an important role in operating and controlling the vehicle. Therefore, driver distraction behavior detection is crucial for road safety. At present, driver distraction detection primarily relies on traditional convolutional neural networks (CNN) and supervised learning methods. However, there are still challenges such as the high cost of labeled datasets, limited ability to capture high-level semantic information, and weak generalization performance. In order to solve these problems, this paper proposes a new self-supervised learning method based on masked image modeling for driver distraction behavior detection. Firstly, a self-supervised learning framework for masked image modeling (MIM) is introduced to solve the serious human and material consumption issues caused by dataset labeling. Secondly, the Swin Transformer is employed as an encoder. Performance is enhanced by reconfiguring the Swin Transformer block and adjusting the distribution of the number of window multi-head self-attention (W-MSA) and shifted window multi-head self-attention (SW-MSA) detection heads across all stages, which leads to model more lightening. Finally, various data augmentation strategies are used along with the best random masking strategy to strengthen the model's recognition and generalization ability. Test results on a large-scale driver distraction behavior dataset show that the self-supervised learning method proposed in this paper achieves an accuracy of 99.60%, approximating the excellent performance of advanced supervised learning methods. Our code is publicly available at <a class="link-external link-http" href="http://github.com/Rocky1salady-killer/SL-DDBD" rel="external noopener nofollow">this http URL</a>.

L-TLA: A Lightweight Driver Distraction Detection Method Based on Three-Level Attention Mechanisms

Driver Distraction Detection Using Semi-Supervised Lightweight Vision Transformer

Event-based Driver Distraction Detection and Action Recognition

A New Unsupervised Deep Learning Algorithm for Fine-Grained Detection of Driver Distraction

Fine-Grained Detection of Driver Distraction Based on Neural Architecture Search

Driver Distraction Detection Using Advanced Deep Learning Technologies Based on Images

Improving real-time driver distraction detection via constrained attention mechanism

Toward Extremely Lightweight Distracted Driver Recognition With Distillation-Based Neural Architecture Search and Knowledge Transfer

Domain Adaptive Driver Distraction Detection Based on Partial Feature Alignment and Confusion-Minimized Classification

Driver Distraction Detection Using Octave-Like Convolutional Neural Network

A Novel Driver Distraction Behavior Detection Method Based on Self-supervised Learning with Masked Image Modeling

Driver Distraction Behavior Detection Method Based on Deep Learning

SWAM: Driver Distraction Recognition Based on Attention Mechanism.

Multimodal driver distraction detection using dual-channel network of CNN and Transformer

Fast Driver Distraction and Fatigue Detection Systems Based on Multiple Facial Behavior

Attention-based deep neural network for driver behavior recognition

FPT: Fine-Grained Detection of Driver Distraction Based on the Feature Pyramid Vision Transformer.

A Nonintrusive and Real-Time Classification Method for Driver’s Gaze Region Using an RGB Camera

A Lightweight Attention-Based Network towards Distracted Driving Behavior Recognition

Driver Distraction Behavior Detection Using a Vision Transformer Model Based on Transfer Learning Strategy

Distracted Driving Detection by Combining ViT and CNN