Abstract:Multimodal change detection (MCD) is an increasingly interesting but very challenging topic in remote sensing, which is due to the unavailability of detecting changes by directly comparing multimodal images from different domains. In this article, we first analyze the structural asymmetry between multitemporal images and show their negative impact on the previous MCD methods using image structures. Specifically, when there is a structural asymmetry, previous structure-based methods can only complete a structure comparison or image regression in one direction and fail in the other direction; that is, they cannot transform or convert from complex structural images (with more categories) to simple structural images (with fewer categories). To reduce the influence of structural asymmetry, we propose a structural regression fusion (SRF)-based method that simultaneously transforms the pre-event and post-event images into the image domain of each other, calculating the forward and backward changed images, respectively. Noteworthy, different from previous late fusion methods that fuse the forward and backward changed images in the postprocessing stage, SRF incorporates fusion into the regression process, which can fully explore the connection between changed images and, thus, improve image transformation performance and obtain better changed images. Specifically, SRF yields three types of constraints to perform the fused image transformation: structure consistency-based regression term, change smoothness and alignment-based fusion term, and prior sparsity-based penalty term. Finally, the changes can be extracted by comparing the transformed and original images. The proposed SRF is verified on six real datasets by comparing with some state-of-the-art (SOTA) methods. Source code of the proposed method will be made available at https://github.com/yulisun/SRF.

Iterative Structure Transformation and Conditional Random Field based Method for Unsupervised Multimodal Change Detection

Structural Regression Fusion for Unsupervised Multimodal Change Detection

A Spectral-Spatial Multiscale Approach For Unsupervised Multiple Change Detection

Unsupervised multimodal change detection based on adaptive optimization of structured graph

Global structure graph mapping for multimodal change detection

Unsupervised Change Detection in High Spatial Resolution Remote Sensing Images Based on a Conditional Random Field Model

Unsupervised Change Detection in Multispectral Remote Sensing Images Via Spectral-Spatial Band Expansion

Change Detection Based on Structural Conditional Random Field Framework for High Spatial Resolution Remote Sensing Imagery

Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection

Iterative Robust Graph for Unsupervised Change Detection of Heterogeneous Remote Sensing Images

Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Unsupervised Multiple Change Detection for Multispectral Images Based on AMMF and SpatioSpectral Channel Augmentation

Unsupervised Change Detection Based on Hybrid Conditional Random Field Model for High Spatial Resolution Remote Sensing Imagery

Image Regression With Structure Cycle Consistency for Heterogeneous Change Detection

Cross-Domain Separable Translation Network for Multimodal Image Change Detection

Change Detection Using High Resolution Remote Sensing Images Based On Active Learning And Markov Random Fields

UCDFormer: Unsupervised Change Detection Using a Transformer-Driven Image Translation

Structure Consistency-Based Graph for Unsupervised Change Detection with Homogeneous and Heterogeneous Remote Sensing Images.

A Change Detection Method Based on Multi-Scale Adaptive Convolution Kernel Network and Multimodal Conditional Random Field for Multi-Temporal Multispectral Images

Change Alignment-Based Image Transformation for Unsupervised Heterogeneous Change Detection