Contrastive Scene Change Representation Learning for High-Resolution Remote Sensing Scene Change Detection

Jue Wang,Yanfei Zhong,Liangpei Zhang
DOI: https://doi.org/10.1109/tgrs.2024.3370556
IF: 8.2
2024-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Scene change detection (SCD) involves recognizing the high-level semantic change types for a bitemporal remote sensing image scene pair. Previous methods have implicitly considered joint bitemporal features as a change representation to perform SCD. However, they have not effectively enhanced the discriminative power of the change representation. Consequently, these methods struggle to recognize scene changes with both intraclass variation and interclass similarity. In this article, scene change contrastive (SCC) learning based on contrastive learning is proposed to ensure that bitemporal features are discriminative change representations for SCD recognition. Contrastive learning can learn specific discriminative features by gathering predefined specific positives and separating negatives in the projection space. In the SCC learning, the change representations, which are represented by the joint bitemporal features, are mapped to real and pseudo multiview change (MVC) projections by the proposed MVC projector and the pseudo change augmentation (PeCA) strategy. The change projections are then guided to be discriminative, exploiting both local spatial and global information. By doing so, the joint bitemporal scene features become more discriminative change representations, which enable accurate recognition of scene changes. The extensive experimental results obtained on two public datasets consistently demonstrate the effectiveness of the proposed method. The code is available at https://github.com/wdczs/SCC.
What problem does this paper attempt to address?