Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Design and Implementation of On-Device AI for Dangerous Driving Behavior Recognition

A Multimodal Data-Driven Approach for Driving Risk Assessment

AI-Based Vehicular Network toward 6G and IoT: Deep Learning Approaches

Safety Awareness Online Detection System of Driving Behavior Based on Software and Hardware Co-design

Event-based Driver Distraction Detection and Action Recognition

Driver Behavior Recognition via Interwoven Deep Convolutional Neural Nets With Multi-Stream Inputs

Long Short‐term Memory and Convolutional Neural Network for Abnormal Driving Behaviour Recognition

A high-speed driver behavior detection deep learning system using the amount of change in contrast between frames

Deep Learning Enhanced Driving Behavior Evaluation Based on Vehicle-Edge-Cloud Architecture

Lightweight Dangerous Driving Action Recognition Using Graph Convolutional Broad Learning

Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach

Personalizing Driver Safety Interfaces via Driver Cognitive Factors Inference

An Optimized DNN Model for Real-Time Inferencing on an Embedded Device

Deep-Learning-Assisted Sensor with Multiple Perception Capabilities for an Intelligent Driver Assistance Monitoring System

AIMSafe: EEG-Based Driver Behavior Understanding Via Attention and Incremental Learning Mechanisms

SafeDriving: an Effective Abnormal Driving Behavior Detection System Based on EMG Signals

Fine-Grained Abnormal Driving Behaviors Detection and Identification with Smartphones

A Study on Machine Learning-Enhanced Roadside Unit-Based Detection of Abnormal Driving in Autonomous Vehicles

Real-time Hazard Detection in Autonomous Vehicles: Deep Learning Approaches for Enhancing Road Safety

DrivingSense: Dangerous Driving Behavior Identification Based on Smartphone Autocalibration

Application of Deep Learning Methods in Driver Behavior Recognition