Abstract:Change detection in high-resolution Earth observation is a fundamental Earth vision task to understand the subtle temporal dynamics of Earth’s surface, significantly promoted by generic vision technologies in recent years. Vision Transformer is a powerful component to learning spatiotemporal representation but with enormous computation complexity, especially for high-resolution images. Besides, there is still lacking principles in designing macro architectures integrating these advanced vision components for various change detection tasks. In this paper, we present a deep probabilistic change model (DPCM) to provide a unified, interpretable, modular probabilistic change process modeling to address multiple change detection tasks, including binary change detection, one-to-many semantic change detection, and many-to-many semantic change detection. DPCM describes any complex change process as a probabilistic graphical model to provide theoretical evidence for macro architecture design and generic change detection task modeling. We refer to this probabilistic graphical model as the probabilistic change model (PCM), where DPCM is the PCM parameterized by deep neural networks. For parameterization, the PCM is factorized into many easy-to-solve distributions based on task-specific assumptions, and then we can use deep neural modules to parameterize these distributions to solve the change detection problem uniformly. In this way, DPCM has both theoretical macro architecture from PCM and strong representation capability of deep networks. We also present the sparse change Transformer for better parameterization. Inspired by domain knowledge, i.e., the sparsity of change and the local correlation of change, the sparse change Transformer computes self-attention within change regions to model spatiotemporal correlations, which has a quadratic computational complexity of the change region size but independent of image size, significantly reducing computation overhead for high-resolution image change detection. We refer to this instance of DPCM with sparse change Transformer as ChangeSparse to demonstrate their effectiveness. The experiments confirm ChangeSparse’s superiority in speed and accuracy for multiple real-world application scenarios, such as disaster response and urban development monitoring. The code is available at https://github.com/Z-Zheng/pytorch-change-models. More resources can be found in http://rsidea.whu.edu.cn/resource_sharing.htm.

Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model

Scalable Multi-Temporal Remote Sensing Change Data Generation via Simulating Stochastic Change Process

Unifying Remote Sensing Change Detection Via Deep Probabilistic Change Models: from Principles, Models to Applications

ChangeDiff: A Multi-Temporal Change Detection Data Generator with Flexible Text Prompts via Diffusion Model

ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model

Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change Detection

Multi-scale Change-Aware Transformer for Remote Sensing Image Change Detection

Multi-Temporal Images Generation for Building Change Detection Performance Promotion

ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuning

TChange: A Hybrid Transformer-CNN Change Detection Network

ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensing

A Semisupervised GAN-Based Multiple Change Detection Framework in Multi-Spectral Images

Diffusion Models and Pseudo-Change: A Transfer Learning-Based Change Detection in Remote Sensing Images

Progressive Domain Adaptation for Change Detection Using Season-Varying Remote Sensing Images

Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysis

Unsupervised Multiple Change Detection in Remote Sensing Images via Generative Representation Learning Network

Generative Adversarial Networks for Change Detection in Multispectral Imagery

A Dual Attentive Generative Adversarial Network for Remote Sensing Image Change Detection

Multi-Temporal SamplePair Generation for Building Change Detection Promotion in Optical Remote Sensing Domain Based on Generative Adversarial Network

A New Learning Paradigm for Foundation Model-based Remote Sensing Change Detection

Change-Aware Cascaded Dual-Decoder Network for Remote Sensing Image Change Detection