Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Estimation of the Pavement Skid Resistance by Automated Vehicle Based on One-Dimensional Convolutional Neural Network

Road Condition Estimation for Automotive Anti-Skid Control System Based on BP Neural Network

Effective pavement skid resistance measurement using multi‐scale textures and deep fusion network

Road Adhesion Coefficient Estimation Based on Vehicle-Road Coordination and Deep Learning

Road adhesion coefficient Estimation: Physics-informed deep learning method with vehicle dynamics model

Vehicle Dynamics Estimator Utilizing LSTM-Ensembled Adaptive Kalman Filter

A machine learning-based approach to assess impacts of autonomous vehicles on pavement roughness

A Multimodal Data-Driven Approach for Driving Risk Assessment

Study on Prediction of Skid Resistance of Asphalt Pavement Based on Genetic Neural Network

Pavement surface defect recognition method based on vehicle system vibration data and feedforward neural network

Real-Time Estimation Of Vehicle'S Lateral Dynamics At Inclined Road Employing Extended Kalman Filter

Improved MobileNet V3-Based Identification Method for Road Adhesion Coefficient

Deep-Neural-Network-Based Modelling of Longitudinal-Lateral Dynamics to Predict the Vehicle States for Autonomous Driving

Assessment of Deep Convolutional Neural Networks for Road Surface Classification

Identification of pedestrian motion feature in mixed traffic conditions and anti-collision algorithm of autonomous vehicle

Estimation And Prediction Of Vehicle Dynamics States Based On Fusion Of Openstreetmap And Vehicle Dynamics Models

Data-driven multi-dimension driving safety evaluation for real-world electric vehicles

Road Friction Estimation Based on Vision for Safe Autonomous Driving

A Data-Driven, Kinematic Feature-Based, Near Real-Time Algorithm for Injury Severity Prediction of Vehicle Occupants

Road Roughness Estimation Using Machine Learning

VehSense: Slippery Road Detection Using Smartphones