Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Real-time driving risk assessment based on the psycho-physical field

Integrated driving risk surrogate model and car-following behavior for freeway risk assessment

A Multimodal Data-Driven Approach for Driving Risk Assessment

A Driving Risk Surrogate and Its Application in Car-Following Scenario at Expressway

Subjective Driving Risk Prediction Based on Spatiotemporal Distribution Features of Human Driver’s Cognitive Risk

Driving risk assessment based on naturalistic driving study and driver attitude questionnaire analysis

A probabilistic risk assessment framework considering lane-changing behavior interaction

An integrated methodology for real-time driving risk status prediction using naturalistic driving data

RCP‐RF: A comprehensive road‐car‐pedestrian risk management framework based on driving risk potential field

Advanced Driving Assistance System Based on Road Risk Assessment

Longitudinal risky driving behavior recognition based on naturalistic driving study

Geometric field model of driver's perceived risk for safe and human-like trajectory planning

A Method for Vehicle Collision Risk Assessment through Inferring Driver's Braking Actions in Near-Crash Situations

SafeDrive: A New Model for Driving Risk Analysis Based on Crash Avoidance

Podar: Modeling Driver's Perceived Risk with Situation Awareness Theory

Quantifying the Individual Differences of Driver' Risk Perception with Just Four Interpretable Parameters

RCP-RF: A Comprehensive Road-car-pedestrian Risk Management Framework based on Driving Risk Potential Field

Risk Assessment of Roundabout Scenarios in Virtual Testing Based on an Improved Driving Safety Field

Rough Set Based Method for Vehicle Collision Risk Assessment Through Inferring Driver's Braking Actions in Near-Crash Situations

Modeling and Analysis of Microscopic Risk Avoidance Behavior of Homogeneous Driver Groups under Risk Scenarios

Integrated Decision-Making and Planning Method for Autonomous Vehicles Based on an Improved Driving Risk Field