Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Comparison of Drunk Driving Recognizing Methods Based on KNN and SVM

<italic>DetectDUI</italic>: An In-Car Detection System for Drink Driving and BACs

Support Vector Machine Classification of Drunk Driving Behaviour

Random forest–based feature selection and detection method for drunk driving recognition

Drunk Driving Detection Using Two-Stage Deep Neural Network

Dynamic Driving Intention Recognition of Vehicles with Different Driving Styles of Surrounding Vehicles

An Optimized Approach Using Transfer Learning to Detect Drunk Driving

Classification of Fatigued and Drunk Driving Based on Decision Tree Methods: A Simulator Study

A Comparative Study of Aggressive Driving Behavior Recognition Algorithms Based on Vehicle Motion Data

An Algorithm for Distracted Driving Recognition Based on Pose Features and an Improved KNN

Abnormal Driving Detection Based on Normalized Driving Behavior

An Intelligent Online Drunk Driving Detection System Based on Multi-Sensor Fusion Technology

Leveraging driver vehicle and environment interaction: Machine learning using driver monitoring cameras to detect drunk driving

A Multimodal Data-Driven Approach for Driving Risk Assessment

Detection of Driver Cognitive Distraction: an SVM Based Real-Time Algorithm and Its Comparison Study in Typical Driving Scenarios.

Vision-based Analysis of Driver Activity and Driving Performance Under the Influence of Alcohol

Comparing four algorithms in predicting the risk of driving under the influence of alcohol among individuals with alcohol use disorder

Discrimination of alcohol dependence based on the convolutional neural network

Recognition method of abnormal driving behavior using the bidirectional gated recurrent unit and convolutional neural network

Driver identification in intelligent vehicle systems using machine learning algorithms

On-Board Unit (OBU)-Supported Longitudinal Driving Behavior Monitoring Using Machine Learning Approaches