Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

A Review of HMM-Based Approaches of Driving Behaviors Recognition and Prediction

Dynamic Driving Intention Recognition of Vehicles with Different Driving Styles of Surrounding Vehicles

Improved Driving Behaviors Prediction Based on Fuzzy Logic-Hidden Markov Model (FL-HMM)

Applying a WNN-HMM Based Driver Model in Human Driver Simulation: Method and Test.

A Review for the Driving Behavior Recognition Methods Based on Vehicle Multisensor Information

A Multimodal Data-Driven Approach for Driving Risk Assessment

Automatic Identification of Driving Maneuver Patterns using a Robust Hidden Semi-Markov Models

A Hidden Markov Model Based Driver Intention Prediction System

A Driver Behavior Recognition Method Based on a Driver Model Framework

Review of Vehicle Behavior Prediction for Intelligent Driving Systems in Highway Scenarios

A Method for Crash Prediction and Avoidance Using Hidden Markov Models

Driver State Monitoring Technology for Conditionally Automated Vehicles: Review and Future Prospects

A Review on Driving Behavior Models

Deep Learning-based Vehicle Behaviour Prediction For Autonomous Driving Applications: A Review

A Taxonomy and Review of Algorithms for Modeling and Predicting Human Driver Behavior

Autonomous Driving Behavior Prediction Method Based on Improved Hidden Markov Model

A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms

A Driving Behavior Awareness Model Based on a Dynamic Bayesian Network and Distributed Genetic Algorithm.

A driving intention prediction method based on hidden Markov model for autonomous driving

Modelling Intelligent Driving Behaviour Using Machine Learning

Data-driven Steering Torque Behaviour Modelling with Hidden Markov Models