Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Identification of dangerous area within vehicles operation for driver assistance

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

A Hybrid Deep Learning Approach for Driver Anomalous Lane Changing Identification

A Multimodal Data-Driven Approach for Driving Risk Assessment

A quantitative blind area risks assessment method for safe driving assistance

Abnormal Driving Detection Based on Normalized Driving Behavior

Driver intention recognition method based on comprehensive lane-change environment assessment

mm-DSF: A Method for Identifying Dangerous Driving Behaviors Based on the Lateral Fusion of Micro-Doppler Features Combined

Driver Danger-Level Monitoring System Using Multi-Sourced Big Driving Data

A probabilistic risk assessment framework considering lane-changing behavior interaction

A Method for Vehicle Collision Risk Assessment through Inferring Driver's Braking Actions in Near-Crash Situations

A spatiotemporal learning approach to safety‐oriented individualized driving risk assessment in a vehicle‐to‐everything (V2X) environment

A Learning-Based Approach for Lane Departure Warning Systems With a Personalized Driver Model

When driving becomes risky: Micro-scale variants of the lane-changing maneuver in highway traffic

A maneuver indicator and ensemble learning-based risky driver recognition approach for highway merging areas

Recognition of Lane Changing Maneuvers for Vehicle Driving Safety

An Optimized Algorithm for Dangerous Driving Behavior Identification Based on Unbalanced Data

An over-the-horizon potential safety threat vehicle identification method based on ETC big data

mmDrive : Passive monitoring of driver's attentiveness using mmWave Sensors

An Emergency Driving Intervention System Designed for Driver Disability Scenarios Based on Emergency Risk Field

Dangerous Prediction by Case-Based Approach on Expressways