Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

REAL-SAP: Real-time Evidence Aware Liable Safety Assessment for Perception in Autonomous Driving

Real-Time Evaluation of Perception Uncertainty and Validity Verification of Autonomous Driving

A Multimodal Data-Driven Approach for Driving Risk Assessment

Verisimilar Percept Sequences Tests for Autonomous Driving Intelligent Agent Assessment

PNNUAD: Perception Neural Networks Uncertainty Aware Decision-Making for Autonomous Vehicle

Task-Aware Risk Estimation of Perception Failures for Autonomous Vehicles

Perception simplex: Verifiable collision avoidance in autonomous vehicles amidst obstacle detection faults

Online Safety Verification of Autonomous Driving Decision-Making Based on Dynamic Reachability Analysis

Planning Automated Driving with Accident Experience Referencing and Common-sense Inferencing

Real-time Hazard Detection in Autonomous Vehicles: Deep Learning Approaches for Enhancing Road Safety

Closed-loop Analysis of Vision-based Autonomous Systems: A Case Study

How Safe Am I Given What I See? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy

Towards Safe Autonomous Driving: Decision Making with Observation-Robust Reinforcement Learning

Exploring Credibility Scoring Metrics of Perception Systems for Autonomous Driving

Road to safe autonomy with data and formal reasoning

Neural Bridge Sampling for Evaluating Safety-Critical Autonomous Systems

Self-Awareness Safety of Deep Reinforcement Learning in Road Traffic Junction Driving

Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving

Safety benefit evaluation of intelligent driving systems based on multisource data mining

Verifiable Obstacle Detection

An Efficient Approach to Generate Safe Drivable Space by LiDAR-Camera-HDmap Fusion