Abstract:Convolutional neural network (CNN) can extract effective semantic features, so it was widely used for remote sensing image change detection (CD) in the latest years. CNN has acquired great achievements in the field of CD, but due to the intrinsic locality of convolution operation, it could not capture global information in space-time. The transformer was proposed in recent years and it can effectively extract global information, so it was used to solve computer vision (CV) tasks and achieved amazing success. In this article, we design a pure transformer network with Siamese U-shaped structure to solve CD problems and name it SwinSUNet. SwinSUNet contains encoder, fusion, and decoder, and all of them use Swin transformer blocks as basic units. Encoder has a Siamese structure based on hierarchical Swin transformer, so encoder can process bitemporal images in parallel and extract their multiscale features. Fusion is mainly responsible for the merge operation of the bitemporal features generated by the encoder. Like encoder, the decoder is also based on hierarchical Swin transformer. Different from the encoder, the decoder uses upsampling and merging (UM) block and Swin transformer blocks to recover the details of the change information. The encoder uses patch merging and Swin transformer blocks to generate effective semantic features. After the sequential process of these three modules, SwinSUNet will output the change maps. We did expensive experiments on four CD datasets, and in these experiments, SwinSUNet achieved better results than other related methods.

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

Swin Transformer-Based Edge Guidance Network for RGB-D Salient Object Detection

SwinSOD: Salient object detection using swin-transformer

Swin Transformer with Local Aggregation

Swin Transformer: Hierarchical Vision Transformer using Shifted Windows

SwinHCST: a deep learning network architecture for scene classification of remote sensing images based on improved CNN and Transformer

SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection

EDSD: Efficient Driving Scenes Detection Based on Swin Transformer

SwinFuse: A Residual Swin Transformer Fusion Network for Infrared and Visible Images

Swin-ASNet: An Adaptive RGB-selection Network with Swin Transformer for Retinal Vessel Segmentation

SDRSwin: A Residual Swin Transformer Network with Saliency Detection for Infrared and Visible Image Fusion

SwinTFNet: Dual-Stream Transformer With Cross Attention Fusion for Land Cover Classification

Swin Resnetswin Transformers for Change Detection in Remote Sensing Images

Swin Transformer Embedding UNet for Remote Sensing Image Semantic Segmentation.

Swin Transformer coupling CNNs Makes Strong Contextual Encoders for VHR Image Road Extraction

Adaptive enhanced swin transformer with U-net for remote sensing image segmentation*

Improved deep learning image classification algorithm based on Swin Transformer V2

Target detection based on improved swin transformer and cascade RCNN

Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery