Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Enhancing Cross-Dataset Performance of Distracted Driving Detection With Score Softmax Classifier And Dynamic Gaussian Smoothing Supervision

Domain Adaptive Driver Distraction Detection Based on Partial Feature Alignment and Confusion-Minimized Classification

A Multimodal Data-Driven Approach for Driving Risk Assessment

Improving real-time driver distraction detection via constrained attention mechanism

Driver Distraction Detection Using Advanced Deep Learning Technologies Based on Images

Keep Your AI-es on the Road: Tackling Distracted Driver Detection with Convolutional Neural Networks and Targeted Data Augmentation

Optimizing Road Safety: Advancements in Lightweight YOLOv8 Models and GhostC2f Design for Real-Time Distracted Driving Detection

Improving automatic detection of driver fatigue and distraction using machine learning

Benchmarking EEG-based Cross-dataset Driver Drowsiness Recognition with Deep Transfer Learning

Dynamic threshold distribution domain adaptation network: a cross-subject fatigue recognition method based on EEG signals

Driving Fatigue Detection Based on the Combination of Multi-Branch 3D-CNN and Attention Mechanism

A Novel Driver Distraction Behavior Detection Method Based on Self-supervised Learning with Masked Image Modeling

DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification

Adaptive Driver Face Feature Fatigue Detection Algorithm Research

Posture and Appearance Fusion Network for Driver Distraction Recognition

Driver fatigue detection method based on multi-feature empirical fusion model

Recongnition of Distracted Driving Behavior Based on Improved Bi-LSTM Model and Attention Mechanism

Distracted Driver Detection Based on a CNN With Decreasing Filter Size

Advancing driver fatigue detection in diverse lighting conditions for assisted driving vehicles with enhanced facial recognition technologies

DSDCLA: driving style detection via hybrid CNN-LSTM with multi-level attention fusion