Abstract:Semantic segmentation of remote sensing images is vital in remote sensing technology. High-quality models for this task require a vast amount of images, and manual annotation is a process that is time-consuming and labor-intensive. Consequently, this has catalyzed the emergence of semi-supervised semantic segmentation methods. However, the complexity of foreground categories in remote sensing images poses a challenge to maintaining prediction consistency. Moreover, inherent characteristics such as intraclass variations and interclass similarities result in a certain degree of confusion among features of different classes in the feature space. This impacts the final classification results. To improve the model's consistency and optimize the classification of categories based on features, this article proposes a new semi-supervised semantic segmentation framework that combines consistency regularization and contrastive learning (CL). In terms of consistency regularization, the proposed method incorporates dual-teacher networks, introduces ClassMix for image augmentation, and uses confidence levels to integrate the predictions from these networks. By introducing perturbations at both the network and image levels, while simultaneously maintaining consistency, the predictive prowess and generalization ability of the model are enhanced. For CL, positive-unlabeled learning (PU-Learning) is used to improve the problem of mis-sampling when selecting features. At the same time, higher biased weights are allocated to more challenging negative samples, thereby elevating the complexity of feature learning and enhancing the discriminative capability of the final feature representation space. Our extensive experiments on the ISPRS Vaihingen dataset and the challenging iSAID dataset have served to underscore the superior performance of our approach.

Multi-scale constraints and perturbation consistency for semi-supervised sonar image segmentation

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

Deep Dual-Stream Network with Scale Context Selection Attention Module for Semantic Segmentation

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Enhancing Semi-Supervised Semantic Segmentation of Remote Sensing Images via Feature Perturbation-Based Consistency Regularization Methods

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Weakly Supervised Semantic Segmentation with a Multiscale Model

CFCG: Semi-Supervised Semantic Segmentation Via Cross-Fusion and Contour Guidance Supervision

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Conservative-Progressive Collaborative Learning for Semi-supervised Semantic Segmentation

Weakly Supervised 3D Segmentation Via Receptive-Driven Pseudo Label Consistency and Structural Consistency.

Multi-Scale Prototype Constraints with Relation Aggregation for Semi-supervised Medical Image Segmentation.

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Multi-Scale Superpoint Network for 3D Point Cloud Semantic Segmentation.

Semi-Supervised Object Detection with Multi-Scale Regularization and Bounding Box Re-Prediction

Curriculum Consistency Learning and Multi-Scale Contrastive Constraint in Semi-Supervised Medical Image Segmentation

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Learning Multi-level Region Consistency with Dense Multi-label Networks for Semantic Segmentation.

Advancing Data-Efficient Exploitation for Semi-Supervised Remote Sensing Images Semantic Segmentation

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images