Abstract:Change detection (CD) in remote sensing (RS) images is a critical task that has achieved significant success by deep learning. Current networks often employ pixel-based differencing, proportion, classification-based, or feature concatenation methods to represent changes of interest. However, these methods fail to effectively detect the desired changes, as they are highly sensitive to factors such as atmospheric conditions, lighting variations, and phenological variations, resulting in detection errors. Inspired by the transformer structure, we adopt a cross-attention mechanism to more robustly extract feature differences between bitemporal images. The motivation of the method is based on the assumption that if there is no change between image pairs, the semantic features from one temporal image can well be represented by the semantic features from another temporal image. Conversely if there is a change, there are significant reconstruction errors. Therefore, a Cross Swin transformer-based Siamese U-shaped network namely CSTSUNet is proposed for RS CD. CSTSUnet consists of encoder, difference feature extraction, and decoder. The encoder is based on a hierarchical residual network (ResNet) with the Siamese U-net structure, allowing parallel processing of bitemporal images and extraction of multiscale features. The difference feature extraction consists of four difference feature extraction modules that compute difference feature at multiple scales. In this module, Cross Swin transformer is employed in each difference feature extraction module to communicate the information of bitemporal images. The decoder takes in the multiscale difference features as input, injects details and boundaries iteratively level by level, and makes the change map more and more accurate. We conduct experiments on three public datasets, and the experimental results demonstrate that the proposed CSTSUNet outperforms other state-of-the-art methods in terms of both qualitative and quantitative analyses. Our code is available at https://github.com/l7170/CSTSUNet.git.

Crossed Siamese Vision Graph Neural Network for Remote-Sensing Image Change Detection

CSTSUNet: A Cross Swin Transformer-Based Siamese U-Shape Network for Change Detection in Remote Sensing Images

An Unsupervised Remote Sensing Change Detection Method Based on Multiscale Graph Convolutional Network and Metric Learning

MSFF-CDNet: A Multiscale Feature Fusion Change Detection Network for Bi-Temporal High-Resolution Remote Sensing Image

CGFINet: Cross-Scale Guided High-Order Feature Interaction Change Detection Network for Remote Sensing Image

FFPNet: Fine-Grained Feature Perception Network for Semantic Change Detection on Bi-Temporal Remote Sensing Images

A Siamese Multiscale Attention Decoding Network for Building Change Detection on High-Resolution Remote Sensing Images

Remote Sensing Image Change Detection Based on Deep Learning: Multi-Level Feature Cross-Fusion with 3D-Convolutional Neural Networks

Deep Multiscale Siamese Network With Parallel Convolutional Structure and Self-Attention for Change Detection

A Siamese Network with a Multiscale Window-Based Transformer via an Adaptive Fusion Strategy for High-Resolution Remote Sensing Image Change Detection

Multi-Scale Feature Interaction Network for Remote Sensing Change Detection

A transformer-based Siamese network and an open optical dataset for semantic change detection of remote sensing images

SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images

An Enhanced and Unsupervised Siamese Network With Superpixel-Guided Learning for Change Detection in Heterogeneous Remote Sensing Images

A Siamese Network Based U-Net for Change Detection in High Resolution Remote Sensing Images

Adjacent-Level Feature Cross-Fusion With 3-D CNN for Remote Sensing Image Change Detection

Spatiotemporal Enhancement and Interlevel Fusion Network for Remote Sensing Images Change Detection

SCDNET: A novel convolutional network for semantic change detection in high resolution optical remote sensing imagery

ICIF-Net: Intra-scale Cross-interaction and Inter-scale Feature Fusion Network For Bi-temporal Remote Sensing Images Change Detection

BGSINet-CD: Bitemporal Graph Semantic Interaction Network for Remote-Sensing Image Change Detection

Multiscale Fusion CNN-Transformer Network for High-Resolution Remote Sensing Image Change Detection