Building Instance Change Detection from High Spatial Resolution Remote Sensing Images Using Improved Instance Segmentation Architecture

Yan Li,Yang Jianbing,Zhang Yi
DOI: https://doi.org/10.1007/s12524-022-01601-z
2022-01-01
Abstract:The detection of ground surface changes provides essential and valuable information for many fields. Many deep learning models have been proposed for change detection from remote sensing images. However, most studies have not been able to simultaneously accomplish both building change detection and instance segmentation of changed buildings from high spatial resolution images. The model based on convolutional neural networks can not extract long-range features and detect spatial–temporal relationships between pixels, making it difficult to improve the performance of change detection. To address these issues, we propose a novel backbone network by establishing the Swin Transformer Siamese and the spatial–temporal attention module network. It is inserted into the Cascade Mask R-CNN as a backbone to establish a new architecture for building instance change detection, called STS-STAM-CMR. Two building change detection datasets are transferred to validate our method, achieving state-of-the-art performance in F1 of 90.9 and 95.2 points on the LEVIER-CD and WHU-CD datasets, respectively. Our experiment demonstrated that the performance of our architecture can be effectively improved by substituting the siamese backbone for the non-siamese backbone. Moreover, the spatial–temporal attention module integrates the global spatial–temporal relationships between pixels to compute the attention weights, improving the feature extraction capabilities of the siamese backbone. Our architecture detects the edges of the building well and obtains finer details by introducing the module. In addition, the copy-pasting data augmentation method further improves the detection accuracy of the object-based AP and small buildings. Furthermore, our architecture can effectively be applied to building damage assessment for disaster situation surveys.
What problem does this paper attempt to address?