Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Quality control of leucocyte‐depleted platelet concentrates obtained by buffy‐coat method

Driving Behaviour Style Study with a Hybrid Deep Learning Framework Based on GPS Data

The Multimodal Driver Monitoring Database: A Naturalistic Corpus to Study Driver Attention

OpenDriver: An Open-Road Driver State Detection Dataset

A multimodal dataset for various forms of distracted driving

A multimodal driver monitoring benchmark dataset for driver modeling in assisted driving automation

DMD: A Large-Scale Multi-Modal Driver Monitoring Dataset for Attention and Alertness Analysis

A multimodal psychological, physiological and behavioural dataset for human emotions in driving tasks

Multimodal Brain–Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines

Multimodal Dataset Construction and Validation for Driving-Related Anger: A Wearable Physiological Conduction and Vehicle Driving Data Approach

Multimodal Brain-Computer Interface for In-Vehicle Driver Cognitive Load Measurement: Dataset and Baselines

Driving Behavior Recognition Based on EEG Data From a Driver Taking Over Experiment on a Simulated Autonomous Vehicle

A Multimodal Data-Driven Approach for Driving Risk Assessment

A Driver Activity Dataset with Multiple RGB-D Cameras and Mmwave Radars

Driving-Induced Neurological Biomarkers in an Advanced Driver-Assistance System

Topical application of DEET for schistosomiasis.

Multi-channel EEG recordings during a sustained-attention driving task

VTD: Visual and Tactile Database for Driver State and Behavior Perception

Multimodal Driver State Modeling through Unsupervised Learning

A Survey of Recent Advances in Driving Behavior Analysis

MIPD: A Multi-sensory Interactive Perception Dataset for Embodied Intelligent Driving