Abstract:Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly compared due to their modal heterogeneity, we take advantage of two types of modality-independent structural relationships in multimodal images. In particular, we present a structural relationship graph representation learning framework for measuring the similarity of the two structural relationships. Firstly, structural graphs are generated from preprocessed multimodal image pairs by means of an object-based image analysis approach. Then, a structural relationship graph convolutional autoencoder (SR-GCAE) is proposed to learn robust and representative features from graphs. Two loss functions aiming at reconstructing vertex information and edge information are presented to make the learned representations applicable for structural relationship similarity measurement. Subsequently, the similarity levels of two structural relationships are calculated from learned graph representations and two difference images are generated based on the similarity levels. After obtaining the difference images, an adaptive fusion strategy is presented to fuse the two difference images. Finally, a morphological filtering-based postprocessing approach is employed to refine the detection results. Experimental results on five datasets with different modal combinations demonstrate the effectiveness of the proposed method.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to perform unsupervised change detection in multi - modal remote sensing images. Due to the modal heterogeneity between multi - modal images (such as optical images and SAR images), it is very difficult to directly compare these images to detect changes. The paper proposes a framework based on structural relationship graph representation learning, aiming to overcome this challenge. Specifically, this method utilizes two modality - independent structural relationships, represents the pre - processed multi - modal image pairs by generating structural graphs, and proposes a Structural Relationship Graph Convolutional Auto - Encoder (SR - GCAE) to learn robust and representative features from these graphs. These features are used to measure the similarity of the two structural relationships, thereby generating a difference image, and finally refining the change detection results through a fusion strategy and morphological filtering post - processing. The main contributions of the paper include: 1. Simultaneously exploring local and non - local structural relationships for unsupervised multi - modal change detection. 2. Designing a graph representation learning framework for the first time for unsupervised multi - modal change detection. The proposed network can learn robust high - level graph representations for measuring the similarity levels of local and non - local structural relationships through two reconstruction optimization objectives as loss functions. 3. Proposing an adaptive fusion strategy based on the discrimination of change intensity in the difference image, which better highlights the changed pixels and suppresses the unchanged pixels. 4. On change detection datasets with five different modality combinations, the proposed method outperforms existing methods, showing its superiority. Through these innovations, the paper provides a new method to solve the change detection problem in multi - modal remote sensing images, and has important practical significance especially in time - sensitive emergency applications.

Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Unsupervised multimodal change detection based on adaptive optimization of structured graph

SDC-GAE: Structural Difference Compensation Graph Autoencoder for Unsupervised Multimodal Change Detection

Structural Regression Fusion for Unsupervised Multimodal Change Detection

Unsupervised Multimodal Change Detection by Distilling Common and Discrepant Representations

Global structure graph mapping for multimodal change detection

Iterative Structure Transformation and Conditional Random Field based Method for Unsupervised Multimodal Change Detection

Similarity and dissimilarity relationships based graphs for multimodal change detection

Unsupervised Change Detection for Multimodal Remote Sensing Images via Coupled Dictionary Learning and Sparse Coding

Enhanced Graph Structure Representation for Unsupervised Heterogeneous Change Detection

Iterative Optimization-Enhanced Contrastive Learning for Multimodal Change Detection

Transformer-based Multimodal Change Detection with Multitask Consistency Constraints

Structure Consistency-Based Graph for Unsupervised Change Detection with Homogeneous and Heterogeneous Remote Sensing Images.

SAR Image Change Detection Via Heterogeneous Graph with Multi-order and Multi-level Connections

Multimodal Co-Learning for Building Change Detection: A Domain Adaptation Framework Using VHR Images and Digital Surface Models

Global-Local Collaborative Learning Network for Optical Remote Sensing Image Change Detection

Change Detection between Multimodal Remote Sensing Data Using Siamese CNN

Self-Supervised Multisensor Change Detection

Coupled dictionary learning for unsupervised change detection between multi-sensor remote sensing images

Convolutional Autoencoder-Based Image Reconstruction for Unsupervised Multimodal Change Detection