Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Prediction Failure Risk-Aware Decision-Making for Autonomous Vehicles on Signalized Intersections

Prediction-Uncertainty-Aware Decision-Making for Autonomous Vehicles

Multimodal Vehicular Trajectory Prediction with Inverse Reinforcement Learning and Risk Aversion at Urban Unsignalized Intersections

A Multimodal Data-Driven Approach for Driving Risk Assessment

Intention-based and Risk-Aware Trajectory Prediction for Autonomous Driving in Complex Traffic Scenarios

Interactive Prediction and Decision-Making for Autonomous Vehicles: Online Active Learning with Traffic Entropy Minimization

Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarios

Uncertainty-Aware Decision-Making for Autonomous Driving at Uncontrolled Intersections

An Integrating Comprehensive Trajectory Prediction with Risk Potential Field Method for Autonomous Driving

A Scenario-Adaptive Driving Behavior Prediction Approach to Urban Autonomous Driving

Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

Self-Aware Trajectory Prediction for Safe Autonomous Driving

Failure Prediction for Autonomous Driving

Safety-Assured Speculative Planning with Adaptive Prediction

Interactive Trajectory Prediction Using a Driving Risk Map-Integrated Deep Learning Method for Surrounding Vehicles on Highways

DACR-AMTP: Adaptive Multi-Modal Vehicle Trajectory Prediction for Dynamic Drivable Areas Based on Collision Risk

Decision‐Making and Planning Methods for Autonomous Vehicles Based on Multistate Estimations and Game Theory

Physics-informed multi-step real-time conflict-based vehicle safety prediction

Prediction-Based Reachability for Collision Avoidance in Autonomous Driving

Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving

Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections