Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Modeling Vehicle-Pedestrian Encountering Risks in the Natural Driving Environment Using Machine Learning Algorithms

A Multimodal Data-Driven Approach for Driving Risk Assessment

Real-Time Pedestrian Conflict Prediction Model at the Signal Cycle Level Using Machine Learning Models

Research on Pedestrian Crossing Decision Models and Predictions Based on Machine Learning

Driver Behavior Analysis in Simulated Jaywalking and Accident Prediction Using Machine Learning Algorithms

Identification of pedestrian motion feature in mixed traffic conditions and anti-collision algorithm of autonomous vehicle

Pedestrian Moving Patterns during Potential Conflicts with 110 On-Road Driving Vehicles

Vision‐based Approach for Predicting the Probability of Vehicle–pedestrian Collisions at Intersections

Prediction of pedestrian crossing behaviour at unsignalized intersections using machine learning algorithms: analysis and comparison

Enhancing autonomous vehicle hyperawareness in busy traffic environments: A machine learning approach

Prediction of Pedestrian Spatial-Temporal Risk Levels for Intelligent Vehicles: A Data-driven Approach

How Do Human-Driven Vehicles Avoid Pedestrians in Interactive Environments? A Naturalistic Driving Study

Application of Explainable Machine Learning for Real-Time Safety Analysis Toward a Connected Vehicle Environment.

A novel model for real-time risk evaluation of vehicle-pedestrian interactions at intersections

Prediction of Pedestrian Spatiotemporal Risk Levels for Intelligent Vehicles: A Data-driven Approach

A game-theoretic approach for modelling pedestrian–vehicle conflict resolutions in uncontrolled traffic environments

Predicting and Analyzing Pedestrian Crossing Behavior at Unsignalized Crossings

Application of Machine Learning in Ethical Design of Autonomous Driving Crash Algorithms

Intentions of Vulnerable Road Users - Detection and Forecasting by Means of Machine Learning

Real-time Hazard Detection in Autonomous Vehicles: Deep Learning Approaches for Enhancing Road Safety

Modeling the Behavior of Pedestrians in a Group at Signalized Intersections Using Dynamic Bayesian Method