Abstract:In the change detection (CD) task, the UNet architecture has achieved superior results. However, due to the inherent limitation of convolution operations, UNet is inadequate in learning global context and long-range spatial relations. Transformers can capture long-range feature dependencies, but the lack of low-level details may result in limited localization capabilities. Therefore, this article proposes an end-to-end encoding-decoding hybrid transformer model for CD, TransUNetCD, which has the advantages of both transformers and UNet. The model encodes the tokenized image patches from the convolutional neural network (CNN) feature map to extract rich global context information. The decoder upsamples the encoded features, connects them with higher-resolution multiscale features through skip connections to learn local-global semantic features, and restores the full spatial resolution of the feature map to achieve precise localization. The model proposed in this article not only solves the problem that redundant information is generated when extracting low-level features under the UNet framework, but also solves the problem that the relationship between each feature layer cannot be fully modeled and the optimal feature difference representation cannot be obtained. On this basis, we introduce a difference enhancement module to generate a difference feature map containing rich change information. By weighting each pixel and selectively aggregating features, the effectiveness of the network and the accuracy of extracting changing features are improved. The results on multiple datasets demonstrate that, compared to state-of-the-art methods, the TransUNetCD can further reduce false alarms and missed alarms, and the edge of the changing area is more accurate. The model has the highest score in each metric than other baseline models and has a robust generalization ability.

Trans-Cycle: Unpaired Image-to-Image Translation Network by Transformer

Multi-Curve Translator for Real-Time High-Resolution Image-to-Image Translation

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

ITTR: Unpaired Image-to-Image Translation with Transformers

Multimodal Image-to-Image Translation via Mutual Information Estimation and Maximization

Image Cross-Domain Translation Algorithm Based on Self-Similarity and Contrastive Learning

Transformer Union Convolution Network for Visual Object Tracking

A one-to-many conditional generative adversarial network framework for multiple image-to-image translations

Unpaired Image-to-Image Translation with Diffusion Adversarial Network

CTFCD: Channel Transformer Based on Full Convolutional Decoder for Single Image Deraining

Unpaired image-to-image translation with improved two-dimensional feature

Unsupervised image-to-image translation via long-short cycle-consistent adversarial networks

Image-Assisted Transformer in Zero-Resource Multi-Modal Translation.

Unpaired Image-to-Image Translation from Shared Deep Space.

Multi-Curve Translator for High-Resolution Photorealistic Image Translation

Unpaired Image-to-Image Translation Using Adversarial Consistency Loss

Vector Quantized Image-to-Image Translation

UVCGAN: UNet Vision Transformer cycle-consistent GAN for unpaired image-to-image translation

CMT: Convolutional Neural Networks Meet Vision Transformers

Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks

GEN: Generative Equivariant Networks for Diverse Image-to-Image Translation.