Abstract:In the change detection (CD) task, the UNet architecture has achieved superior results. However, due to the inherent limitation of convolution operations, UNet is inadequate in learning global context and long-range spatial relations. Transformers can capture long-range feature dependencies, but the lack of low-level details may result in limited localization capabilities. Therefore, this article proposes an end-to-end encoding-decoding hybrid transformer model for CD, TransUNetCD, which has the advantages of both transformers and UNet. The model encodes the tokenized image patches from the convolutional neural network (CNN) feature map to extract rich global context information. The decoder upsamples the encoded features, connects them with higher-resolution multiscale features through skip connections to learn local-global semantic features, and restores the full spatial resolution of the feature map to achieve precise localization. The model proposed in this article not only solves the problem that redundant information is generated when extracting low-level features under the UNet framework, but also solves the problem that the relationship between each feature layer cannot be fully modeled and the optimal feature difference representation cannot be obtained. On this basis, we introduce a difference enhancement module to generate a difference feature map containing rich change information. By weighting each pixel and selectively aggregating features, the effectiveness of the network and the accuracy of extracting changing features are improved. The results on multiple datasets demonstrate that, compared to state-of-the-art methods, the TransUNetCD can further reduce false alarms and missed alarms, and the edge of the changing area is more accurate. The model has the highest score in each metric than other baseline models and has a robust generalization ability.

L-UNet: An LSTM Network for Remote Sensing Image Change Detection

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

Change Detection for High-resolution Remote Sensing Images Based on a Siamese Structured UNet3+ Network

A Deep Multitask Learning Framework Coupling Semantic Segmentation and Fully Convolutional LSTM Networks for Urban Change Detection

Novel Enhanced UNet for Change Detection Using Multimodal Remote Sensing Image

Change Detection for High-resolution Remote Sensing Images Based on a UNet-like Siamese-structured Transformer Network

SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images

LRDE-Net: Large Receptive Field and Image Difference Enhancement Network for Remote Sensing Images Change Detection

T-UNet: triplet UNet for change detection in high-resolution remote sensing images

Simple Multiscale UNet for Change Detection With Heterogeneous Remote Sensing Images

STransUNet: A Siamese TransUNet-Based Remote Sensing Image Change Detection Network

An UNet3+ Network Based on Global Pyramid Aggregation for Change Detection in Optical Remote-Sensing Images

CS-HSNet: A Cross-Siamese Change Detection Network Based on Hierarchical-Split Attention

Hierarchical Feature Association and Global Correction Network for Change Detection

A hybrid U‐shaped and transformer network for change detection in high‐resolution remote sensing images

SUDANet: A Siamese UNet with Dense Attention Mechanism for Remote Sensing Image Change Detection

End-To-End Change Detection For High Resolution Satellite Images Using Improved Unet Plus

Global-Local Collaborative Learning Network for Optical Remote Sensing Image Change Detection

Spectral-Spatial Attentions and Deep Supervision for Change Detection in Remote Sensing Images

TransUNet++SAR: Change Detection with Deep Learning about Architectural Ensemble in SAR Images