Abstract:Multimodal change detection (MCD) is an increasingly interesting but very challenging topic in remote sensing, which is due to the unavailability of detecting changes by directly comparing multimodal images from different domains. In this article, we first analyze the structural asymmetry between multitemporal images and show their negative impact on the previous MCD methods using image structures. Specifically, when there is a structural asymmetry, previous structure-based methods can only complete a structure comparison or image regression in one direction and fail in the other direction; that is, they cannot transform or convert from complex structural images (with more categories) to simple structural images (with fewer categories). To reduce the influence of structural asymmetry, we propose a structural regression fusion (SRF)-based method that simultaneously transforms the pre-event and post-event images into the image domain of each other, calculating the forward and backward changed images, respectively. Noteworthy, different from previous late fusion methods that fuse the forward and backward changed images in the postprocessing stage, SRF incorporates fusion into the regression process, which can fully explore the connection between changed images and, thus, improve image transformation performance and obtain better changed images. Specifically, SRF yields three types of constraints to perform the fused image transformation: structure consistency-based regression term, change smoothness and alignment-based fusion term, and prior sparsity-based penalty term. Finally, the changes can be extracted by comparing the transformed and original images. The proposed SRF is verified on six real datasets by comparing with some state-of-the-art (SOTA) methods. Source code of the proposed method will be made available at https://github.com/yulisun/SRF.

Global structure graph mapping for multimodal change detection

Unsupervised multimodal change detection based on adaptive optimization of structured graph

Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

SDC-GAE: Structural Difference Compensation Graph Autoencoder for Unsupervised Multimodal Change Detection

Iterative Structure Transformation and Conditional Random Field based Method for Unsupervised Multimodal Change Detection

Structural Regression Fusion for Unsupervised Multimodal Change Detection

A Spectral-Spatial Multiscale Approach For Unsupervised Multiple Change Detection

Locality Preservation for Unsupervised Multimodal Change Detection in Remote Sensing Imagery

Enhanced Graph Structure Representation for Unsupervised Heterogeneous Change Detection

Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection

Iterative Optimization-Enhanced Contrastive Learning for Multimodal Change Detection

Self-Paced Multi-Scale Joint Feature Mapper for Multi-Objective Change Detection in Heterogeneous Images

Unsupervised Multiple Change Detection for Multispectral Images Based on AMMF and SpatioSpectral Channel Augmentation

Change Alignment-Based Graph Structure Learning for Unsupervised Heterogeneous Change Detection

Structure Consistency-Based Graph for Unsupervised Change Detection with Homogeneous and Heterogeneous Remote Sensing Images.

An Unsupervised Remote Sensing Change Detection Method Based on Multiscale Graph Convolutional Network and Metric Learning

Similarity and dissimilarity relationships based graphs for multimodal change detection

Transformer-based Multimodal Change Detection with Multitask Consistency Constraints

Unsupervised Multimodal Change Detection by Distilling Common and Discrepant Representations

A multiscale graph convolutional network for change detection in homogeneous and heterogeneous remote sensing images