Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

Multi-source urban data fusion for property value assessment: A case study in Philadelphia

Understanding House Price Appreciation Using Multi-Source Big Geo-Data and Machine Learning

Multisource Hyperspectral and LiDAR Data Fusion for Urban Land-Use Mapping based on a Modified Two-Branch Convolutional Neural Network

A Multimodal Data Fusion Model for Accurate and Interpretable Urban Land Use Mapping with Uncertainty Analysis

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

FusionHeightNet: A Multi-Level Cross-Fusion Method from Multi-Source Remote Sensing Images for Urban Building Height Estimation

A Deep-Learning-Based Multimodal Data Fusion Framework for Urban Region Function Recognition

Real Estate Attribute Prediction from Multiple Visual Modalities with Missing Data

A Multisource Dynamic Fusion Network for Urban Functional Zone Identification on Remote Sensing, POI, and Building Footprint

3D building model generation from MLS point cloud and 3D mesh using multi-source data fusion

Urban Fine Management of Multisource Spatial Data Fusion Based on Smart City Construction

A multimodal fusion framework for urban scene understanding and functional identification using geospatial data

Fusion of Google Street View, LiDAR, and Orthophoto Classifications Using Ranking Classes Based on F1 Score for Building Land-Use Type Detection

Integrating Aerial and Street View Images for Urban Land Use Classification

Joint Gated Co-attention Based Multi-modal Networks for Subregion House Price Prediction

Multi-source data fusion method for structural safety assessment of water diversion structures

RHPMF: A context-aware matrix factorization approach for understanding regional real estate market

Deep Citywide Multisource Data Fusion-Based Air Quality Estimation.

An Integrated Model For Urban Subregion House Price Forecasting: A Multi-Source Data Perspective

Multi-Source Information Fusion network for building occupancy estimation

Accurate Estimation of the Proportion of Mixed Land Use at the Street-Block Level by Integrating High Spatial Resolution Images and Geospatial Big Data