Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

Multi-Feature Fusion Identification of Important Nodes in Traffic Network

Estimating Traffic Flow in Large Road Networks Based on Multi-Source Traffic Data

Multimedia data fusion method based on wireless sensor network in intelligent transportation system

Identifying Traffic Clusters in Urban Networks Based on Graph Theory Using License Plate Recognition Data

Traffic Node Importance Evaluation Based on Clustering in Represented Transportation Networks

A Multi-Stream Feature Fusion Approach for Traffic Prediction

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

Spatial-temporal multi-factor fusion graph neural network for traffic prediction

MGL2Rank: Learning to Rank the Importance of Nodes in Road Networks Based on Multi-Graph Fusion

Identification of Important Traffic Network Nodes and Analysis of Traffic Breakdown Based on CIPHER

Simulation System Based on Multi-scale Fusion of City Traffic Network Optimization

A Novel Method for Traffic Bottlenecks Identification in Urban Traffic Network

Important node identification for complex networks based on improved Electre Multi-Attribute fusion

Critical Section Identification in Road Traffic Network Based on Spatial and Temporal Features of Traffic Flow

Identifying the Most Influential Roads Based on Traffic Correlation Networks

Urban Fine Management of Multisource Spatial Data Fusion Based on Smart City Construction

An Integrated Network Modeling for Road Maps

Traffic Control Approach Based on Multi‐source Data Fusion

Identifying Spatiotemporal Traffic Patterns in Large-Scale Urban Road Networks Using a Modified Nonnegative Matrix Factorization Algorithm

Freeway Multisensor Data Fusion Approach Integrating Data from Cellphone Probes and Fixed Sensors.