Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

Vehicle Accident and Traffic Classification Using Deep Convolutional Neural Networks

VISION-BASED ACCIDENT IDENTIFICATION IN TRAFFIC VIDEOS USING DEEP LEARNING

Learning spatial patterns and temporal dependencies for traffic accident severity prediction: A deep learning approach

Deep Convolutional Neural Network for Roadway Incident Surveillance Using Audio Data

Traffic Accident’s Severity Prediction: A Deep-Learning Approach-Based CNN Network

Design of a Novel Convolutional Deep Network Model for Car Accident Prediction

Deep convolutional neural networks architecture for an efficient emergency vehicle classification in real-time traffic monitoring

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

Vehicle Classification Based on Deep Convolutional Neural Networks Model for Traffic Surveillance Systems

Accident Impact Prediction based on a deep convolutional and recurrent neural network model

Vehicle Classification Based on Seismic Signatures Using Convolutional Neural Network

Research on Traffic Accident Prediction Model Based on Convolutional Neural Networks in VANET

Learning Traffic as Images for Incident Detection Using Convolutional Neural Networks

Classification Of Road Traffic Accident Data Using Machine Learning Algorithms

Deep Spatio-Temporal Graph Convolutional Network for Traffic Accident Prediction

Vehicular Traffic Congestion Classification by Visual Features and Deep Learning Approaches: A Comparison

Deep learning model of convolutional neural networks powered by a genetic algorithm for prevention of traffic accidents severity

Road Feature Detection for Advance Driver Assistance System Using Deep Learning

A Study on Classification of Traffic Accident Injury Grade Using CNN and NASS-CDS Data

A Traffic Object Classification Pipeline Based On Cnns

Real-Time Traffic Sign Classification Using Combined Convolutional Neural Networks.