Abstract:Contrastive self-supervised learning (CSSL) is a promising method for extracting effective features from unlabeled data. It performs well in image-level tasks, such as image classification and retrieval. However, the existing CSSL methods are not suitable for pixel-level tasks, for example, change detection (CD), since they ignore the correlation between local patches or pixels. In this article, we first propose a multicue CSSL (MC-CSSL) method to derive dense features for CD. Besides data augmentation, the MC-CSSL takes advantage of more cues based on the semantic meaning and temporal correlation of local patches. Specifically, the positive pair is built from local patches with similar semantic meanings or temporal ones with the same geographic location. The assumption is that local patches belonging to the same kind of land-covering tend to share similar features. Second, the affinity matrix is truncated and introduced to extract change information between two temporal patches obtained from different types of sensors. As a result, some initial unchanged pixels are selected to serve as the supervision for mapping the dense features into a consistent space. Based on the distance between all bitemporal pixels in the consistent space, a difference image (DI) is generated and more unchanged pixels can be available. The dense feature mapping and unchanged pixel updating proceed alternately. The proposed CD method is evaluated in both homogeneous and heterogeneous cases, and the experimental results demonstrate its effectiveness and priority after comparison with some existing state-of-the-art methods. The source code will be available at https://github.com/Yang202308/ChangeDetection_CSSL .

Multi-task contrastive learning for change detection in remote sensing images

Self-supervised Change Detection in Multi-view Remote Sensing Images

Multi-task Learning Based Single Temporal Remote Sensing Image Change Detection.

Task-Related Self-Supervised Learning for Remote Sensing Image Change Detection

Superpixel-based multiple change detection in very-high-resolution remote sensing images

Laddering vision foundation model for remote sensing image change detection

Feature-Guided Multitask Change Detection Network

Change Detection Using High Resolution Remote Sensing Images Based On Active Learning And Markov Random Fields

Superpixel-Based Difference Representation Learning for Change Detection in Multispectral Remote Sensing Images

Iterative Optimization-Enhanced Contrastive Learning for Multimodal Change Detection

Single-temporal Supervised Remote Change Detection for Domain Generalization

ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensing

A Multi-Task Framework for Hyperspectral Change Detection and Band Reweighting with Unbalanced Contrastive Learning

Global-Local Collaborative Learning Network for Optical Remote Sensing Image Change Detection

A Multi-Task Network and Two Large Scale Datasets for Change Detection and Captioning in Remote Sensing Images

Unsupervised CD in satellite image time series by contrastive learning and feature tracking

Toward Efficient Remote Sensing Image Change Detection Via Cross-Temporal Context Learning

Multicue Contrastive Self-Supervised Learning for Change Detection in Remote Sensing

High-Resolution Remote Sensing Bitemporal Image Change Detection Based on Feature Interaction and Multitask Learning.

Unsupervised Difference Representation Learning for Detecting Multiple Types of Changes in Multitemporal Remote Sensing Images.

Spatial-Temporal Based Multihead Self-Attention for Remote Sensing Image Change Detection