Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Recognition of Trip-Based Aggressive Driving: A System Integrated with Gaussian Mixture Model Structured of Factor-Analysis, and Hierarchical Clustering

Dynamic Driving Intention Recognition of Vehicles with Different Driving Styles of Surrounding Vehicles

A Comparative Study of Aggressive Driving Behavior Recognition Algorithms Based on Vehicle Motion Data

A Hybrid Deep Learning Approach for Driver Anomalous Lane Changing Identification

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

A Study on the Recognition Algorithm of Aggressive Driving State

A Recognition Method of Aggressive Driving Behavior Based on Ensemble Learning

A Multimodal Data-Driven Approach for Driving Risk Assessment

Clustering-Based Driving Behavior Recognition Using Inertial Sensors.

Real-Time Driving Behavior Identification Based on Multi-Source Data Fusion

Human-like car-following modeling based on online driving style recognition

A maneuver indicator and ensemble learning-based risky driver recognition approach for highway merging areas

A Hybrid Method Combining Markov Prediction and Fuzzy Classification for Driving Condition Recognition.

Automatic Recognition of Vehicle Differentiated Driving Behaviour in Automatic Driving Scenarios

Driving Behavior Tracking and Recognition Based on Multisensors Data Fusion

Driver identification in intelligent vehicle systems using machine learning algorithms

A dynamic driving-style analysis method based on drivers' interaction with surrounding vehicles

Clustering of Several Typical Behavioral Characteristics of Commercial Vehicle Drivers Based on GPS Data Mining: Case Study of Highways in China

Dangerous Behavior Recognition of Autonomous Vehicles at Intersection Based on Gaussian Mixture Model

Recognition and interpretation of aggressive driving behavior for heavy‐duty vehicles based on artificial neural network and SHAP

An Optimized Algorithm for Dangerous Driving Behavior Identification Based on Unbalanced Data