Abstract:In recent years, with the extensive application of deep learning in images, the task of remote sensing image change detection has witnessed a significant improvement. Several excellent methods based on Convolutional Neural Networks and emerging transformer-based methods have achieved impressive accuracy. However, Convolutional Neural Network-based approaches have difficulties in capturing long-range dependencies because of their natural limitations in effective receptive field acquisition unless deeper networks are employed, introducing other drawbacks such as an increased number of parameters and loss of shallow information. The transformer-based methods can effectively learn the relationship between different regions, but the computation is inefficient. Thus, in this paper, a multi-scale feature aggregation via transformer (MFATNet) is proposed for remote sensing image change detection. To obtain a more accurate change map after learning the intra-relationships of feature maps at different scales through the transformer, MFATNet aggregates the multi-scale features. Moreover, the Spatial Semantic Tokenizer (SST) is introduced to obtain refined semantic tokens before feeding into the transformer structure to make it focused on learning more crucial pixel relationships. To fuse low-level features (more fine-grained localization information) and high-level features (more accurate semantic information), and to alleviate the localization and semantic gap between high and low features, the Intra- and Inter-class Channel Attention Module (IICAM) are integrated to further determine more convincing change maps. Extensive experiments are conducted on LEVIR-CD, WHU-CD, and DSIFN-CD datasets. Intersection over union (IoU) of 82.42 and F1 score of 90.36, intersection over union (IoU) of 79.08 and F1 score of 88.31, intersection over union (IoU) of 77.98 and F1 score of 87.62, respectively, are achieved. The experimental results achieved promising performance compared to certain previous state-of-the-art change detection methods.

Remote sensing building damage assessment with a multihead neighbourhood attention transformer

Dual-Tasks Siamese Transformer Framework for Building Damage Assessment

Scene-level Buildings Damage Recognition Based on Cross Conv-Transformer

Asymmetric Network Combining CNN and Transformer for Building Extraction from Remote Sensing Images

HRTBDA: a network for post-disaster building damage assessment based on remote sensing images

Hybrid transformer-CNN networks using superpixel segmentation for remote sensing building change detection

Cross-level and multiscale CNN-Transformer network for automatic building extraction from remote sensing imagery

Cross-Scale-Guided Fusion Transformer for Disaster Assessment Using Satellite Imagery.

TCNet: Multiscale Fusion of Transformer and CNN for Semantic Segmentation of Remote Sensing Images

Enhancing Multiscale Representations with Transformer for Remote Sensing Image Semantic Segmentation

Asymmetric Cross-Attention Hierarchical Network Based on CNN and Transformer for Bitemporal Remote Sensing Images Change Detection

A Dual-Branch Fusion Network Based on Reconstructed Transformer for Building Extraction in Remote Sensing Imagery

BDANet: Multiscale Convolutional Neural Network with Cross-directional Attention for Building Damage Assessment from Satellite Images

MFATNet: Multi-Scale Feature Aggregation via Transformer for Remote Sensing Image Change Detection

Structure-Aware Multiscale Hybrid Network for Change Detection of Remote Sensing Images

Transformer based on channel-spatial attention for accurate classification of scenes in remote sensing image

DBCT-Net:A Dual Branch Hybrid CNN-transformer Network for Remote Sensing Image Fusion.

Multihead Global Attention and Spatial Spectral Information Fusion for Remote Sensing Image Compression

CAW: A Remote-Sensing Scene Classification Network Aided by Local Window Attention

Multi-head Global Attention and Spatial Spectral Information Fusion for Remote Sensing Image Compression

A CNN-Transformer Network Combining CBAM for Change Detection in High-Resolution Remote Sensing Images