Abstract:Urbanization is progressing at an unprecedented rate in many places around the world. The Sentinel-1 synthetic aperture radar (SAR) and Sentinel-2 MultiSpectral Instrument (MSI) missions, combined with deep learning, offer new opportunities to accurately monitor urbanization at a global scale. Although the joint use of SAR and optical data has recently been investigated for urban change detection, existing data fusion methods rely heavily on the availability of sufficient training labels. Meanwhile, change detection methods addressing label scarcity are typically designed for single-sensor optical data. To overcome these limitations, we propose a semi-supervised urban change detection method that exploits unlabeled Sentinel-1 SAR and Sentinel-2 MSI data. Using bitemporal SAR and optical image pairs as inputs, the proposed multi-modal Siamese network predicts urban changes and performs built-up area segmentation for both timestamps. Additionally, we introduce a consistency loss, which penalizes inconsistent built-up area segmentation across sensor modalities on unlabeled data, leading to more robust features. To demonstrate the effectiveness of the proposed method, the SpaceNet 7 dataset, comprising multi-temporal building annotations from rapidly urbanizing areas across the globe, was enriched with Sentinel-1 SAR and Sentinel-2 MSI data. Subsequently, network performance was analyzed under label-scarce conditions by training the network on different fractions of the labeled training set. The proposed method achieved an F1 score of 0.555 when using all available training labels, and produced reasonable change detection results (F1 score of 0.491) even with as little as 10% of the labeled training data. In contrast, multi-modal supervised methods and semi-supervised methods using optical data failed to exceed an F1 score of 0.402 under this condition. Code and data are made publicly available.

Detecting Urban Dynamics Using Deep Siamese Convolutional Neural Networks

Change Detection between Multimodal Remote Sensing Data Using Siamese CNN

Deep Siamese Networks Based Change Detection with Remote Sensing Images

A Mamba-based Siamese Network for Remote Sensing Change Detection

Urban Change Detection by Fully Convolutional Siamese Concatenate Network with Attention

A Deep Siamese Network with Hybrid Convolutional Feature Extraction Module for Change Detection Based on Multi-sensor Remote Sensing Images

Change Detection in Multi-temporal VHR Images Based on Deep Siamese Multi-scale Convolutional Networks

Change Detection for High-resolution Remote Sensing Images Based on a Siamese Structured UNet3+ Network

Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Model

Deep Siamese Network for annual change detection in Beijing using Landsat satellite data

Semi-Supervised Urban Change Detection Using Multi-Modal Sentinel-1 SAR and Sentinel-2 MSI Data

Urban Change Detection Using a Dual-Task Siamese Network and Semi-Supervised Learning

BUILDINGS CHANGE DETECTION USING HIGH-RESOLUTION REMOTE SENSING IMAGES WITH SELF-ATTENTION KNOWLEDGE DISTILLATION AND MULTISCALE CHANGE-AWARE MODULE

A Hybrid Metaheuristic and Deep Learning Approach for Change Detection in Remote Sensing Data

DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images

Siamese U-net with Attention Mechanism for Building Change Detection in High-Resolution Remote Sensing Images

Deep Multiscale Siamese Network With Parallel Convolutional Structure and Self-Attention for Change Detection

Detecting Building Changes Using Multimodal Siamese Multitask Networks from Very-High-Resolution Satellite Images.

A Siamese Swin-Unet for image change detection

Attention-guided siamese networks for change detection in high resolution remote sensing images

A Siamese Multiscale Attention Decoding Network for Building Change Detection on High-Resolution Remote Sensing Images