Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Extraction of Descriptive Driving Patterns from Driving Data Using Unsupervised Algorithms

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

A Hybrid Deep Learning Approach for Driver Anomalous Lane Changing Identification

Exploring Behavioral Patterns of Lane Change Maneuvers for Human-Like Autonomous Driving

A Multimodal Data-Driven Approach for Driving Risk Assessment

DAnoScenE: a driving anomaly scenario extraction framework for autonomous vehicles in urban streets

Driving pattern interpretation based on action phases clustering

Decision-Oriented Driving Scenario Recognition Based on Unsupervised Learning

Leveraging Longitudinal Driving Behaviour Data with Data Mining Techniques for Driving Style Analysis

Clustering of Driving Encounter Scenarios Using Connected Vehicle Trajectories

Multimodal Driver State Modeling through Unsupervised Learning

Driving Style Analysis Using Primitive Driving Patterns With Bayesian Nonparametric Approaches

Automatic Identification of Driving Maneuver Patterns using a Robust Hidden Semi-Markov Models

Unsupervised Driver Behavior Profiling leveraging Recurrent Neural Networks

Real-Time Driving Behavior Identification Based on Multi-Source Data Fusion

Unsupervised Driving Behavior Analysis using Representation Learning and Exploiting Group-based Training

Analysis of Naturalistic Driving Behavior for Personalized Autonomous Vehicle

Understanding the Regular Travel Behavior of Private Vehicles: An Empirical Evaluation and a Semi-Supervised Model

Context-Aware Attention Encoder-Decoder Network for Connected Heavy-Duty Vehicle Aggressive Driving Identification under Naturalistic Driving Conditions

A General Framework of Learning Multi-Vehicle Interaction Patterns from Video

Discovery of Driving Patterns by Trajectory Segmentation