Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

Split Liability Assessment in Car Accident using 3D Convolutional Neural Network

A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention

Design of a Novel Convolutional Deep Network Model for Car Accident Prediction

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

A Multimodal Data-Driven Approach for Driving Risk Assessment

Vehicle Behavior Recognition using Multi-Stream 3D Convolutional Neural Network

Real-time accident anticipation for autonomous driving through monocular depth-enhanced 3D modeling

A Deep Learning Method for Lane Changing Situation Assessment and Decision Making.

AccidentBlip2: Accident Detection With Multi-View MotionBlip2

Prioritizing rear-end crash explanatory factors for injury severity level using deep learning and global sensitivity analysis

Learning spatial patterns and temporal dependencies for traffic accident severity prediction: A deep learning approach

The identification of minor impact collisions in a long video for detecting property damages caused by fleeing vehicles using three-dimensional convolutional neural network

Driver Behavior Extraction from Videos in Naturalistic Driving Datasets with 3D ConvNets

An analytic framework using deep learning for prediction of traffic accident injury severity based on contributing factors

VISION-BASED ACCIDENT IDENTIFICATION IN TRAFFIC VIDEOS USING DEEP LEARNING

BCSSN: Bi-direction Compact Spatial Separable Network for Collision Avoidance in Autonomous Driving

Collision Prediction in an Integrated Framework of Scenario-Based and Data-Driven Approaches

Risky Action Recognition in Lane Change Video Clips using Deep Spatiotemporal Networks with Segmentation Mask Transfer

Accident Impact Prediction based on a deep convolutional and recurrent neural network model

Group Split and Merge Prediction With 3D Convolutional Networks