Abstract:Real-time assessment and short-term warning of driving risks are critical for AI-assisted vehicles to significantly improve the safety and reliability of mobility. However, existing methods do not comprehensively consider these factors, making it difficult to achieve more accurate risk assessments. Aiming at this problem, this paper proposes a new driving risk assessment framework by integrating multimodal data. First, based on naturalistic driving experiments, we collected multimodal data encompassing human-vehicle-road factors. Then, using the Latent Dirichlet Allocation (LDA) model, we identified three risk levels based on driving behavior features: normal driving, longitudinal risky driving, and lateral risky driving. To better understand the spatiotemporal importance of multiple factors, a spatiotemporal dual-channel neural network based on a multi-layer attention mechanism (MLA-DCNN) is developed. This model has a spatiotemporal dual-channel structure, which can integrate "low-level" historical sequences and "high-level" extract statistical features of multiple features. In addition, it adopts three layers of attention mechanism, respectively used to capture the differences of features in temporal, spatial, and extracted-level dimensions. Results reveal that the LDA model is more effective than traditional clustering methods in uncovering latent patterns of driving risk. The proposed model achieved an impressive accuracy of 91.04%, demonstrating higher risk assessment capabilities than the other alternative models. In addition, the multilayer attention enhances the interpretability of the model and is able to capture the spatiotemporal importance of different factors across various road environments. This method can be applied to connected and automated vehicles (CAVs) using multimodal natural driving data collected by in-vehicle sensors. It enhances the risk warning capabilities of driving assistance systems, and the multidimensional importance analysis also supports decision-making for traffic management authorities.

Research on industrial risk early warning algorithms based on edge computing and multimodal data

A Multimodal Data-Driven Approach for Driving Risk Assessment

Factory Worker Safety Mask Monitoring System Based on Deep Learning and AI Edge Computing

Long-Short-Term-Memory-Based Deep Stacked Sequence-to-Sequence Autoencoder for Health Prediction of Industrial Workers in Closed Environments Based on Wearable Devices

A digital twin-based motion forecasting framework for preemptive risk monitoring

Memory-Enhanced Spatial-Temporal Encoding Framework for Industrial Anomaly Detection System

Deep analytics for workplace risk and disaster management

Intelligent Risk Prediction System in IoT-Based Supply Chain Management in Logistics Sector

To Transmit or Predict: an Efficient Industrial Data Transmission Scheme with Deep Learning and Cloud-Edge Collaboration

End-to-end supply chain resilience management using deep learning, survival analysis, and explainable artificial intelligence

Real-Time Deep Anomaly Detection Framework for Multivariate Time-Series Data in Industrial IoT

Hybrid Cloud-Edge Collaborative Data Anomaly Detection in Industrial Sensor Networks

Collision Risk Prediction for Vehicles with Sensor Data Fusion Through a Machine Learning Pipeline

Safety Application Platform of Energy Production Surveillance Based on Data Flow

Efficient decentralized optimization for edge-enabled smart manufacturing: A federated learning-based framework

An Unsafe Behavior Detection Method Based on Improved YOLO Framework

Real-time fault detection for IIoT facilities using GA-Att-LSTM based on edge-cloud collaboration

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

GSS-RiskAsser: A Multi-Modal Deep-Learning Framework for Urban Gas Supply System Risk Assessment on Business Users

Research on the Prediction of Sustainable Safety Production in Building Construction Based on Text Data

Research on the Prediction of the Operational Risk Field of Intelligent Vehicles Based on Dual Multiline LiDAR