Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Assessing Unknown Hazards for SOTIF Based on Twin Scenarios Empowered Autonomous Driving

SOTIF Entropy: Online SOTIF Risk Quantification and Mitigation for Autonomous Driving

A Multimodal Data-Driven Approach for Driving Risk Assessment

Runtime unknown unsafe scenarios identification for SOTIF of autonomous vehicles

Adaptive Mining of Failure Scenarios for Autonomous Driving Systems Based on Multi-population Genetic Algorithm

Genetic Algorithm-Based SOTIF Scenario Construction for Complex Traffic Flow

Discovery of Perception Performance Limiting Triggering Conditions in Automated Driving

A Survey on an Emerging Safety Challenge for Autonomous Vehicles: Safety of the Intended Functionality

SOTIF Risk Mitigation Based on Unified ODD Monitoring for Autonomous Vehicles

A quantitative blind area risks assessment method for safe driving assistance

Risk Assessment of Roundabout Scenarios in Virtual Testing Based on an Improved Driving Safety Field

Study on the Impacts of Hazardous Behaviors on Autonomous Vehicle Collision Rates Based on Humanoid Scenario Generation in CARLA

A spatiotemporal learning approach to safety‐oriented individualized driving risk assessment in a vehicle‐to‐everything (V2X) environment

Risk Scenario Generation for Autonomous Driving Systems based on Causal Bayesian Networks

Identification of Challenging Highway-Scenarios for the Safety Validation of Automated Vehicles Based on Real Driving Data

Identifying and Explaining Safety-critical Scenarios for Autonomous Vehicles via Key Features

Few-Shot Testing of Autonomous Vehicles with Scenario Similarity Learning

Graph Structure-Based Implicit Risk Reasoning for Long-Tail Scenarios of Automated Driving

Uncertainties in Onboard Algorithms for Autonomous Vehicles: Challenges, Mitigation, and Perspectives.

Online Safety Verification of Autonomous Driving Decision-Making Based on Dynamic Reachability Analysis

Situational Assessments Based on Uncertainty-Risk Awareness in Complex Traffic Scenarios