Abstract:As the number of vehicles and the volume of traffic swell in urban centers, cities have experienced a concomitant increase in traffic accidents. Proactively identifying accident-prone hotspots in urban environments holds the promise of preventing traffic mishaps, thereby curtailing the incidence of accidents and reducing property damage. This research introduces the Two-Branch Contextual Feature-Guided Converged Network (TCFGC-Net) utilizing multimodal satellite and street view data. Designed to extract global structural features from satellite imagery and dynamic continuous features from street view imagery, the model aims to improve the accuracy of detecting urban accident hotspots. For the satellite imagery branch, we propose the Contextual Feature Coupled Convolutional Neural Network (Trans-CFCCNN) designed to extract global spatial features and discern feature correlations across adjacent regions. For the street view imagery branch, we develop the Sequential Feature Recurrent Attention Network (SFRAN) to assimilate and integrate dynamic scene features captured from successive street view images. We designed the Multi-Branch Feature Adaptive Fusion Structure (MBFAF) to aggregate different branch features for accurate identification of accident hotspots. Experimental results show that the model performs well, with an overall accuracy of 93.7 %. Ablation studies confirm that relative to standalone street view and satellite branch analyses, implementing multimodal fusion enhances the model's accuracy by 12.05 % and 17.86 %, respectively. The innovative fusion structure proposed herein garners a 4.22 % increase in model accuracy, outpacing conventional feature concatenation techniques. Furthermore, the model outperforms existing deep learning models in terms of overall efficacy. Additionally, to showcase the efficacy of the proposed model structure, we utilize Class Activation Maps (CAM) to provide visual interpretability for the model. These results suggest that the dual-branch fusion model effectively decreases false alarm occurrences and directs the model's focus toward regions more pertinent to accident hotspots. Finally, the code and model used for identifying hotspots of urban traffic accidents in this study are available for access: https://github.com/gwt-ZJU/TCFGC-Net.

FF-CMnet: A CNN-Based Model for Fine-Grained Classification of Car Models Based on Feature Fusion

Fusion of Low-Illuminance Visible and Near-Infrared Images Based on Convolutional Neural Networks

Multi-layer feature fusion and attention enhancement for fine-grained vehicle recognition research

Multi-Path Deep CNNs for Fine-Grained Car Recognition

Fine-Grained Vehicle Model Recognition Using A Coarse-to-Fine Convolutional Neural Network Architecture

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Fusion of Satellite and Street View Data for Urban Traffic Accident Hotspot Identification

Feature fusion network based on few-shot fine-grained classification

A vehicle classification model based on deep active learning

MFNet: Multi-Level Feature Extraction and Fusion Network for Large-Scale Point Cloud Classification

Cross-layer Navigation Convolutional Neural Network for Fine-grained Visual Classification

Graph-Based Progressive Fusion Network for Multi-Modality Vehicle Re-Identification

Multi-branch feature fusion and refinement network for salient object detection

Feature-Decision Level Collaborative Fusion Network for Hyperspectral and LiDAR Classification

Multi-directional guidance network for fine-grained visual classification

Fine-grained vehicle type classification using lightweight convolutional neural network with feature optimization and joint learning strategy

Few-Shot Fine-Grained Image Classification via Multi-Frequency Neighborhood and Double-Cross Modulation

Significant feature suppression and cross-feature fusion networks for fine-grained visual classification

CAM: A fine-grained vehicle model recognition method based on visual attention model

Deep Feature Fusion Classification Model for Identifying Machine Parts