Nested transformer decoder using dense skip-connections for change detection in high-resolution remote sensing image

Xiangjun Meng,Yonghong Song,Guofu Li
DOI: https://doi.org/10.1080/01431161.2024.2398225
IF: 3.531
2024-10-03
International Journal of Remote Sensing
Abstract:Change detection is a critical task in remote sensing image analysis, with applications in land management and urban development. Convolutional neural networks (CNNs) have shown success in this area, but existing CNN-based methods often struggle with irrelevant changes caused by interfering factors, leading to unsatisfactory results. To address this, some studies have replaced CNN layers with transformers to enhance the receptive field and utilize global information better. However, this can make models overly reliant on global information, potentially overlooking shallow, fine-grained features, especially at the edges of changed targets. To overcome these limitations, we propose a Nested Transformer Decoder (NTD) that combines the strengths of transformers and CNNs by introducing dense skip connections. While having a large receptive field, it can also better retain shallow and fine-grained features by adding skip-connection. These innovations enable our model to more accurately identify changes and preserve the edges of the changed areas, including small changes that are difficult to detect using existing methods. Additionally, we introduce a Residual Fusion Module (RFM) to reduce false detections caused by irrelevant factors like light and shadow. The RFM employs residual information and spatiotemporal attention to suppress differences in multi-scale features, leading to better detection outcomes. The experimental results demonstrate that our proposed model outperforms the current state-of-the-art change detection methods in various metrics, and represents a novel and effective solution to the challenge of change detection in remote sensing images. Experimental results show that our model surpasses state-of-the-art change detection methods across various metrics. Tested on three public change detection datasets, our method improves the Intersection over Union (IoU) for the change class by 2.83% to 16.39% and enhances the F1-score by 1.60% to 9.63%. These results demonstrate that the proposed approach provides an effective solution to the challenges of change detection in remote sensing images.
imaging science & photographic technology,remote sensing
What problem does this paper attempt to address?