Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

3D Collaborative Judgment MobileNet Based Intelligent Driving System

Research and Implementation of Networked Cloud-Controlled Autonomous Driving System

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention

An NN-Based Double Parallel Longitudinal and Lateral Driving Strategy for Self-Driving Transport Vehicles in Structured Road Scenarios

Design and Realization of Unmanned Multi‐mode Collaborative Intelligent Driving System

A Multimodal Data-Driven Approach for Driving Risk Assessment

Design of a Deep Learning-Based Autonomous Vehicle Environmental Perception and Decision-Making System

AI-Based Vehicular Network toward 6G and IoT: Deep Learning Approaches

Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles

Driving Assistance System Based on Deep Learning and Traditional Vision

An End-to-end Auto-driving Method Based on 3D Lidar

SDC-Net: End-to-End Multitask Self-Driving Car Camera Cocoon IoT-Based System

Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets With Multi-Stream Inputs

End-to-End Autonomous Driving Through Dueling Double Deep Q-Network

Deep Learning Based Intelligent Inter-Vehicle Distance Control for 6G Enabled Cooperative Autonomous Driving

Vehicle Safety-Assisted Driving Technology Based on Computer Artificial Intelligence Environment

Towards Collaborative Autonomous Driving: Simulation Platform and End-to-End System

Intelligent Driving Task Scheduling Service in Vehicle-Edge Collaborative Networks Based on Deep Reinforcement Learning

SDC-Net++: End-to-End Crash Detection and Action Control for Self-Driving Car Deep-IoT-Based System

DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars