Abstract:Multimodal change detection (MCD) is an increasingly interesting but very challenging topic in remote sensing, which is due to the unavailability of detecting changes by directly comparing multimodal images from different domains. In this article, we first analyze the structural asymmetry between multitemporal images and show their negative impact on the previous MCD methods using image structures. Specifically, when there is a structural asymmetry, previous structure-based methods can only complete a structure comparison or image regression in one direction and fail in the other direction; that is, they cannot transform or convert from complex structural images (with more categories) to simple structural images (with fewer categories). To reduce the influence of structural asymmetry, we propose a structural regression fusion (SRF)-based method that simultaneously transforms the pre-event and post-event images into the image domain of each other, calculating the forward and backward changed images, respectively. Noteworthy, different from previous late fusion methods that fuse the forward and backward changed images in the postprocessing stage, SRF incorporates fusion into the regression process, which can fully explore the connection between changed images and, thus, improve image transformation performance and obtain better changed images. Specifically, SRF yields three types of constraints to perform the fused image transformation: structure consistency-based regression term, change smoothness and alignment-based fusion term, and prior sparsity-based penalty term. Finally, the changes can be extracted by comparing the transformed and original images. The proposed SRF is verified on six real datasets by comparing with some state-of-the-art (SOTA) methods. Source code of the proposed method will be made available at https://github.com/yulisun/SRF.

Locality Preservation for Unsupervised Multimodal Change Detection in Remote Sensing Imagery

A Spectral-Spatial Multiscale Approach For Unsupervised Multiple Change Detection

Unsupervised multimodal change detection based on adaptive optimization of structured graph

Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection

Global structure graph mapping for multimodal change detection

Iterative Optimization-Enhanced Contrastive Learning for Multimodal Change Detection

Unsupervised Change Detection in Multispectral Remote Sensing Images Via Spectral-Spatial Band Expansion

Iterative Structure Transformation and Conditional Random Field based Method for Unsupervised Multimodal Change Detection

Enhanced Multitask Semantic Change Detection via Semi-Supervised Learning in LULC Segmentation Subtask

Superpixel-based multiple change detection in very-high-resolution remote sensing images

Unsupervised Multiple Change Detection for Multispectral Images Based on AMMF and SpatioSpectral Channel Augmentation

Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Cross-modal change detection using historical land use maps and current remote sensing images

Structural Regression Fusion for Unsupervised Multimodal Change Detection

Multiscale Geometric Analysis Fusion-Based Unsupervised Change Detection in Remote Sensing Images Via FLICM Model

Change Detection In Multispectral Remote Sensing Images Based On Optimized Fusion Of Subspaces

A Review of Multi-Class Change Detection for Satellite Remote Sensing Imagery

Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)

Patch Similarity Graph Matrix-Based Unsupervised Remote Sensing Change Detection with Homogeneous and Heterogeneous Sensors

Similarity and dissimilarity relationships based graphs for multimodal change detection

Unsupervised Noise-Resistant Remote-Sensing Image Change Detection: A Self-Supervised Denoising Network-, FCM_SICM-, and EMD Metric-Based Approach