Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

MFN: A Multi-hop Fusion Network for Traffic Accident Risk Prediction.

Network-scale traffic prediction via knowledge transfer and regional MFD analysis

Short-term Traffic Prediction with Deep Neural Networks and Adaptive Transfer Learning

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

DMGF-Net: An Efficient Dynamic Multi-Graph Fusion Network for Traffic Prediction

Spatial-temporal multi-factor fusion graph neural network for traffic prediction

A Multi-Stream Feature Fusion Approach for Traffic Prediction

A multi-feature spatial–temporal fusion network for traffic flow prediction

Urban Traffic Accident Risk Prediction Revisited: Regionality, Proximity, Similarity and Sparsity

Risk Prediction on Traffic Accidents using a Compact Neural Model for Multimodal Information Fusion over Urban Big Data

Efficient Traffic Accident Warning Based on Unsupervised Prediction Framework

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

Mid-term prediction of at-fault crash driver frequency using fusion deep learning with city-level traffic violation data

MFDGCN: Multi-Stage Spatio-Temporal Fusion Diffusion Graph Convolutional Network for Traffic Prediction

A Multifeature Fusion Short-Term Traffic Flow Prediction Model Based on Deep Learnings

Gated Fusion Adaptive Graph Neural Network for Urban Road Traffic Flow Prediction

MF-CNN: Traffic Flow Prediction Using Convolutional Neural Network and Multi-Features Fusion

Multi-View Fusion Neural Network for Traffic Demand Prediction

Traffic Accident Risk Prediction of Tunnel Based on Multi-Source Heterogeneous Data Fusion

Spatial-Temporal Traffic Flow Prediction with Fusion Graph Convolution Network and Enhanced Gated Recurrent Units

MmgFra: A multiscale multigraph learning framework for traffic prediction in smart cities