Abstract:Change detection (CD) in remote sensing (RS) images is a critical task that has achieved significant success by deep learning. Current networks often employ pixel-based differencing, proportion, classification-based, or feature concatenation methods to represent changes of interest. However, these methods fail to effectively detect the desired changes, as they are highly sensitive to factors such as atmospheric conditions, lighting variations, and phenological variations, resulting in detection errors. Inspired by the transformer structure, we adopt a cross-attention mechanism to more robustly extract feature differences between bitemporal images. The motivation of the method is based on the assumption that if there is no change between image pairs, the semantic features from one temporal image can well be represented by the semantic features from another temporal image. Conversely if there is a change, there are significant reconstruction errors. Therefore, a Cross Swin transformer-based Siamese U-shaped network namely CSTSUNet is proposed for RS CD. CSTSUnet consists of encoder, difference feature extraction, and decoder. The encoder is based on a hierarchical residual network (ResNet) with the Siamese U-net structure, allowing parallel processing of bitemporal images and extraction of multiscale features. The difference feature extraction consists of four difference feature extraction modules that compute difference feature at multiple scales. In this module, Cross Swin transformer is employed in each difference feature extraction module to communicate the information of bitemporal images. The decoder takes in the multiscale difference features as input, injects details and boundaries iteratively level by level, and makes the change map more and more accurate. We conduct experiments on three public datasets, and the experimental results demonstrate that the proposed CSTSUNet outperforms other state-of-the-art methods in terms of both qualitative and quantitative analyses. Our code is available at https://github.com/l7170/CSTSUNet.git.

CSANet: Cross-Temporal Interaction Symmetric Attention Network for Hyperspectral Image Change Detection

A Spatial-Spectral-Temporal Attention Method for Hyperspectral Image Change Detection.

Attention in Attention for Hyperspectral with High Spatial Resolution (H) Image Classification

Multiple Spatial–Spectral Features Aggregated Neural Network for Hyperspectral Change Detection

A dual-branch siamese spatial-spectral transformer attention network for Hyperspectral Image Change Detection

Cross-domain attention network for hyperspectral image classification

SSCNN-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection

Multilevel Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection

Temporal difference-guided network for hyperspectral image change detection

Collaborative Self-Perception Network Architecture for Hyperspectral Image Change Detection

One-Stream Neural Network Based on Multi-Level Features Fusion for Hyperspectral Image Change Detection

Hyperspectral Image Change Detection Based on Gated Spectral–Spatial–Temporal Attention Network With Spectral Similarity Filtering

HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images

Semantic-Aware Alignment Network for Cross-Resolution Change Detection

Spectral–Spatial–Temporal Transformers for Hyperspectral Image Change Detection

Multitemporal Symmetric Fusion Network for Hyperspectral Change Detection

CD-SDN: Unsupervised Sensitivity Disparity Networks for Hyper-Spectral Image Change Detection

CSTSUNet: A Cross Swin Transformer-Based Siamese U-Shape Network for Change Detection in Remote Sensing Images

Multiple Attention Siamese Network for High-Resolution Image Change Detection

CTACL:Hyperspectral Image Change Detection Based on Adaptive Contrastive Learning

SAAN: Similarity-Aware Attention Flow Network for Change Detection With VHR Remote Sensing Images