Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Risk Assessment Based Collision Avoidance Decision-Making for Autonomous Vehicles in Multi-Scenarios

Decision-making of active collision avoidance system based on comprehensive evaluation method of dangerous scenarios

Behavioral decision‐making model of the intelligent vehicle based on driving risk assessment

An Adaptive Collision Avoidance Decision Method for Various Driving Conditions

A Multimodal Data-Driven Approach for Driving Risk Assessment

A Method for Vehicle Collision Risk Assessment through Inferring Driver's Braking Actions in Near-Crash Situations

Multi-level decision framework collision avoidance algorithm in emergency scenarios

Multi-Ship Collision Avoidance Decision-Making Based on Collision Risk Index

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

A Prediction-Uncertainty-Aware Safety Decision-Making Algorithm Towards Injury Risk Minimization under Safety-Critical Scenarios

Risk-informed decision-making and control strategies for autonomous vehicles in emergency situations

Effect of Driving Experience on Collision Avoidance Braking: an Experimental Investigation and Computational Modelling

Risk-anticipatory autonomous driving strategies considering vehicles' weights, based on hierarchical deep reinforcement learning

A probabilistic risk assessment framework considering lane-changing behavior interaction

Decision-Making and Planning Method for Autonomous Vehicles Based on Motivation and Risk Assessment

Reachability-Based Confidence-Aware Probabilistic Collision Detection in Highway Driving

Risk Assessment of Roundabout Scenarios in Virtual Testing Based on an Improved Driving Safety Field

An Authority Allocation Strategy for Shared Control in Human-Machine Cooperative Driving Via Lane-Based Probabilistic Collision Risk Assessment

Occlusion-Aware Risk Assessment for Autonomous Driving in Urban Environments

Driving risk assessment based on naturalistic driving study and driver attitude questionnaire analysis

An Active Safety Control Method of Collision Avoidance for Intelligent Connected Vehicle Based on Driving Risk Perception