Joint Self-Training and Rebalanced Consistency Learning for Semi-Supervised Change Detection

Xueting Zhang,Xin Huang,Jiayi Li

DOI: https://doi.org/10.1109/TGRS.2023.3314452

2023-01-01

Abstract:Change detection (CD) is an important Earth observation task that can monitor change areas at two times from the view of space. However, fully supervised CD has a heavy dependence on numerous manually labeled data, limiting their applications in practice. Beyond the fully supervised setting, semi-supervised CD (SSCD), which uses a few labeled data to guide the unsupervised learning of dominant unlabeled data, has attracted increasing attention for its significant advantage in alleviating the demand for annotations. To this end, in this article we propose a joint self-training and rebalanced consistency learning (ST-RCL) framework for SSCD, which consists of a basic supervised branch for the labeled data and a novel unsupervised branch for the unlabeled data. To make full use of the unlabeled data, the unsupervised branch generates pseudolabels from weakly augmented unlabeled remote sensing image (RSI) pairs to supervise the CD of two strongly augmented counterparts, including an unrotated version and a rotated version. On one hand, the unrotated unlabeled RSI pairs are pseudosupervised with the pseudolabels by confidence-based self-training (ST). On the other hand, to further enhance model robustness to rotation nonequivariance and imbalanced distribution, the predictions of rotated unlabeled RSI pairs are aligned to the pseudolabels by a well-designed rebalanced consistency learning (RCL) strategy based on uncertainty-based class weighting. Extensive experiments are performed on four widely used CD datasets, and the proposed ST-RCL yields new state-of-the-art results on all these datasets in comparison to some other SSCD methods, demonstrating its effectiveness and generalization. Our code will be available at https://github.com/zxt9/STRCL-SSCD.