Abstract:In the change detection (CD) task, the UNet architecture has achieved superior results. However, due to the inherent limitation of convolution operations, UNet is inadequate in learning global context and long-range spatial relations. Transformers can capture long-range feature dependencies, but the lack of low-level details may result in limited localization capabilities. Therefore, this article proposes an end-to-end encoding-decoding hybrid transformer model for CD, TransUNetCD, which has the advantages of both transformers and UNet. The model encodes the tokenized image patches from the convolutional neural network (CNN) feature map to extract rich global context information. The decoder upsamples the encoded features, connects them with higher-resolution multiscale features through skip connections to learn local-global semantic features, and restores the full spatial resolution of the feature map to achieve precise localization. The model proposed in this article not only solves the problem that redundant information is generated when extracting low-level features under the UNet framework, but also solves the problem that the relationship between each feature layer cannot be fully modeled and the optimal feature difference representation cannot be obtained. On this basis, we introduce a difference enhancement module to generate a difference feature map containing rich change information. By weighting each pixel and selectively aggregating features, the effectiveness of the network and the accuracy of extracting changing features are improved. The results on multiple datasets demonstrate that, compared to state-of-the-art methods, the TransUNetCD can further reduce false alarms and missed alarms, and the edge of the changing area is more accurate. The model has the highest score in each metric than other baseline models and has a robust generalization ability.

Research on Improving TransUnet Network for Feature Classification

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

An Improved Res-UNet Model for Tree Species Classification Using Airborne High-Resolution Images

STransUNet: A Siamese TransUNet-Based Remote Sensing Image Change Detection Network

DenseUNet: Improved Image Classification Method Using Standard Convolution and Dense Transposed Convolution

Transferring Digit Classifier's Features to a Traffic Sign Detector

Improved U-Net Remote Sensing Classification Algorithm Based on Multi-Feature Fusion Perception

STransU2Net: Transformer based hybrid model for building segmentation in detailed satellite imagery

P-TransUNet: an improved parallel network for medical image segmentation

Intelligent Identification Method of Crop Species Using Improved U-Net Network in UAV Remote Sensing Image

E-Transunet: Enhanced Transunet for Medical Image Segmentation

A vegetation classification method based on improved dual-way branch feature fusion U-net

CDTNet: Improved Image Classification Method Using Standard, Dilated and Transposed Convolutions

HSI-TransUNet: A transformer based semantic segmentation model for crop mapping from UAV hyperspectral imagery

TransCUNet: UNet cross fused transformer for medical image segmentation

Trans-UNeter: A new Decoder of TransUNet for Medical Image Segmentation.

Medical Image Segmentation Based on TransUnet and A2B

Remote Sensing Image Scene Classification Based on Deep Multi-branch Feature Fusion Network

ATTransUNet: an Enhanced Hybrid Transformer Architecture for Ultrasound and Histopathology Image Segmentation

CNN-TransNet: A Hybrid CNN-Transformer Network with Differential Feature Enhancement for Cloud Detection.

AA-TransUNet: Attention Augmented TransUNet For Nowcasting Tasks