Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Lane Departure Risk Assessment for Hands-free Driving Functions

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

Lane Departure Prediction Based on Closed-Loop Vehicle Dynamics

A Multimodal Data-Driven Approach for Driving Risk Assessment

Decision Making of Autonomous Vehicles in Lane Change Scenarios: Deep Reinforcement Learning Approaches with Risk Awareness

An Advanced Lane-Keeping Assistance System with Switchable Assistance Modes

An integrated framework for driving risk evaluation that combines lane-changing detection and an attention-based prediction model

Human-Road Dual Trust Mechanism in Adaptive Distributed Shared Control Framework under Lane Keeping Scenario

Research on Lane Changing Game and Behavioral Decision Making Based on Driving Styles and Micro-Interaction Behaviors

A Novel Lane-Change Decision-Making With Long-Time Trajectory Prediction for Autonomous Vehicle

Recognition of Lane Changing Maneuvers for Vehicle Driving Safety

A proactive lane-changing risk prediction framework considering driving intention recognition and different lane-changing patterns

Human–Machine Cooperative Control of Intelligent Vehicles for Lane Keeping—Considering Safety of the Intended Functionality

Data-Driven Risk-Sensitive Control for Personalized Lane Change Maneuvers

Personalized Highway Pilot Assist Considering Leading Vehicle's Lateral Behaviours

Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving

Detection and Risk Analysis with Lane-Changing Decision Algorithms for Autonomous Vehicles

A Learning-Based Approach for Lane Departure Warning Systems With a Personalized Driver Model

Lane change trajectory prediction by using recorded human driving data

Creating Driving Scenarios from Recorded Vehicle Data for Validating Lane Centering System in Highway Traffic

Lane Departure Prevention System Adapted to Driver Behavior Characteristics