Abstract:Existing optical remote sensing image change detection (CD) methods aim to learn an appropriate discriminate decision by analyzing the feature information of bitemporal images obtained at the same place. However, the complex scenes in high-resolution (HR) remote images cause unsatisfied results, especially for some irregular and occluded objects. Although recent self-attention-driven change detection models with CNN achieve promising effects, the computational and consumed parameters costs emerge as an impassable gap for HR images. In this paper, we utilize a transformer structure replacing self-attention to learn stronger feature representations per image. In addition, concurrent vision transformer models only consider tokenizing single-dimensional image tokens, thus failing to build multi-scale long-range interactions among features. Here, we propose a hybrid multi-scale transformer module for HR remote images change detection, which fully models representation attentions at hybrid scales of each image via a fine-grained self-attention mechanism. The key idea of the hybrid transformer structure is to establish heterogeneous semantic tokens containing multiple receptive fields, thus simultaneously preserving large object and fine-grained features. For building relationships between features without embedding with token sequences from the Siamese tokenizer, we also introduced a hybrid difference transformer decoder (HDTD) layer to further strengthen multi-scale global dependencies of high-level features. Compared to capturing single-stream tokens, our HDTD layer directly focuses representing differential features without increasing exponential computational cost. Finally, we propose a cascade feature decoder (CFD) for aggregating different-dimensional upsampling features by establishing difference skip-connections. To evaluate the effectiveness of the proposed method, experiments on two HR remote sensing CD datasets are conducted. Compared to state-of-the-art methods, our Hybrid-TransCD achieved superior performance on both datasets (i.e., LEVIR-CD, SYSU-CD) with improvements of 0.75% and 1.98%, respectively.

Hybrid transformer-CNN networks using superpixel segmentation for remote sensing building change detection

TransUNetCD: A Hybrid Transformer Network for Change Detection in Optical Remote-Sensing Images

A CNN-Transformer Network Combining CBAM for Change Detection in High-Resolution Remote Sensing Images

Multiscale Fusion CNN-Transformer Network for High-Resolution Remote Sensing Image Change Detection

TCNet: Multiscale Fusion of Transformer and CNN for Semantic Segmentation of Remote Sensing Images

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

A hybrid U‐shaped and transformer network for change detection in high‐resolution remote sensing images

TChange: A Hybrid Transformer-CNN Change Detection Network

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

Transformer and CNN Hybrid Deep Neural Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery

Mixed-former: multi-fusion remote sensing change detection

A Network Combining a Transformer and a Convolutional Neural Network for Remote Sensing Image Change Detection

Relating CNN-Transformer Fusion Network for Remote Sensing Change Detection

Remote sensing building damage assessment with a multihead neighbourhood attention transformer

CNN and Transformer Fusion for Remote Sensing Image Semantic Segmentation

Hybrid-TransCD: A Hybrid Transformer Remote Sensing Image Change Detection Network via Token Aggregation

MCTNet: A Multi-Scale CNN-Transformer Network for Change Detection in Optical Remote Sensing Images

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

A CBAM Based Multiscale Transformer Fusion Approach for Remote Sensing Image Change Detection

SMBCNet: A Transformer-Based Approach for Change Detection in Remote Sensing Images through Semantic Segmentation