Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

Space Matching Fusion Model for Arterial Speed Estimation in ITS.

Traffic State and Emission Estimation for Urban Expressways Based on Heterogeneous Data

An arterial speed estimation model fusing data from stationary and mobile sensors

Traffic Speed Estimation Based on Multi-Source GPS Data and Mixture Model

Adaptive Rolling Smoothing with Heterogeneous Data for Traffic State Estimation and Prediction.

An Urban Traffic Speed Fusion Method Based On Principle Component Analysis And Neural Network

Freeway Travel-Time Estimation Based on Temporal–Spatial Queueing Model

Travel Time Estimation for Urban Arterials Based on the Multi-Source Data

Single-Camera and Inter-Camera Vehicle Tracking and 3D Speed Estimation Based on Fusion of Visual and Semantic Features

Fusion method of road section average speed based on BP neural network and D-S evidence theory

Multimedia data fusion method based on wireless sensor network in intelligent transportation system

Use of Multisensor Data in Reliable Short-Term Travel Time Forecasting for Urban Roads

Bayesian Network Method of Speed Estimation from Single-Loop Outputs

Arterial Travel Time Estimation Using VII Probe Data and Point-Based Detection Data

Research on Method of Speed Estimation from Single Loop Detector

High-resolution large-scale urban traffic speed estimation with multi-source crowd sensing data

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

Speed estimation with single loop detector using typical effective vehicle length

MULTI-SENSOR TRAFFIC DATA FUSION FOR CONGESTION DETECTION AND TRACKING

A Data Fusion Powered Bi-Directional Long Short Term Memory Model for Predicting Multi-Lane Short Term Traffic Flow

A multi-modal spatial–temporal model for accurate motion forecasting with visual fusion