Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

A Cognition-Inspired Human-Like Decision-Making Method for Automated Vehicles

To Develop Human-like Automated Driving Strategy Based on Cognitive Construction: Appraisal and Perspective.

From Human Driving to Automated Driving: What Do We Know about Drivers?

Human-Like Decision-Making of Autonomous Vehicles in Dynamic Traffic Scenarios

Human-like decision making for lane change based on the cognitive map and hierarchical reinforcement learning

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Brain-Inspired Modeling and Decision-Making for Human-Like Autonomous Driving in Mixed Traffic Environment

Brain-Inspired Modelling and Decision-making for Human-Like Autonomous Driving in Mixed Traffic Environment

Cognition‐inspired Behavioural Feature Identification and Motion Planning Ways for Human‐like Automated Driving Vehicles

Intuitive Decision-Making Modeling for Self-Driving Vehicles

Human-like Behavior Decision Making Method for Intelligent Vehicle Considering Driver Characteristics

A Multimodal Data-Driven Approach for Driving Risk Assessment

Human-like Decision-making and Control for Automated Driving

Driving Behavior Modeling and Characteristic Learning for Human-like Decision-Making in Highway

Human-Like Decision Making of Artificial Drivers in Intelligent Transportation Systems: An End-to-End Driving Behavior Prediction Approach

Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approach

An interpretable decision-making model for autonomous driving

A Fuzzy Logic-Based Approach for Humanized Driver Modelling

Planning Automated Driving with Accident Experience Referencing and Common-sense Inferencing

Driving Maneuvers Prediction Based on Cognition-Driven and Data-Driven Method.

Study on Autonomous Vehicles’ Bio-Inspired Decision-Making under Complex Dynamics Environments