CrossMatch: Cross-View Matching for Semi-supervised Remote Sensing Image Segmentation

Ruizhong Liu,Tingzhang Luo,Shaoguang Huang,Yuwei Wu,Zhen Jiang,Hongyan Zhang

DOI: https://doi.org/10.1109/tgrs.2024.3507050

IF: 8.2

2024-01-01

IEEE Transactions on Geoscience and Remote Sensing

Abstract:Recently, weak-to-strong consistency based methods have yielded a remarkable performance for remote sensing image segmentation. However, they are designed within a single view, which encounters the problems of unreliable pseudo-label supervision and insufficient ability to capture informative features for the segmentation of complex remote sensing data. In this paper, we propose a cross-view weak-to-strong consistency based method, which aggregates rich information from two irrelevant views. We employ two subnets for the two views to generate view-specific features while encouraging them to yield the same prediction. Within each view, we enhance the perturbation space of data at the image level and feature level for a more robust representation. To leverage the information from unlabeled data, we propose a cross-view weak-to-strong consistency scheme, which employs the pseudo-label of the weakly augmented data in one view to supervise the model training in another view, facilitating an effective information exchange across views. To avoid identical information extraction from the two views, we propose a cross-view contrastive loss to maximize the dissimilarity of the feature representations across views, which ensures that the learned complementary information from one view provides additional helpful information for the model training in another view. Finally, we propose a cross-view discrepancy based supervised constraint by imposing a larger weight on the areas that exist discrepant predictions across views in the cross-entropy loss, allowing the model to focus more on the hard-to-classify regions of the images. Extensive experimental results on several benchmark datasets demonstrate that our method outperforms the state-of-the-art.