Abstract:This paper focuses on the unsupervised domain adaptation of transferring the knowledge from the source domain to the target domain in the context of semantic segmentation. Existing approaches usually regard the pseudo label as the ground truth to fully exploit the unlabeled target-domain data. Yet the pseudo labels of the target-domain data are usually predicted by the model trained on the source domain. Thus, the generated labels inevitably contain the incorrect prediction due to the discrepancy between the training domain and the test domain, which could be transferred to the final adapted model and largely compromises the training process. To overcome the problem, this paper proposes to explicitly estimate the prediction uncertainty during training to rectify the pseudo label learning for unsupervised semantic segmentation adaptation. Given the input image, the model outputs the semantic segmentation prediction as well as the uncertainty of the prediction. Specifically, we model the uncertainty via the prediction variance and involve the uncertainty into the optimization objective. To verify the effectiveness of the proposed method, we evaluate the proposed method on two prevalent synthetic-to-real semantic segmentation benchmarks, i.e., GTA5 \(\rightarrow \) Cityscapes and SYNTHIA \(\rightarrow \) Cityscapes, as well as one cross-city benchmark, i.e., Cityscapes \(\rightarrow \) Oxford RobotCar. We demonstrate through extensive experiments that the proposed approach (1) dynamically sets different confidence thresholds according to the prediction variance, (2) rectifies the learning from noisy pseudo labels, and (3) achieves significant improvements over the conventional pseudo label learning and yields competitive performance on all three benchmarks.

Semi-supervised Defect Segmentation with Uncertainty-aware Pseudo-labels from Multi-branch Network.

Uncertainty-aware and Dynamically-Mixed Pseudo-Labels for Semi-Supervised Defect Segmentation

Semisupervised Defect Segmentation with Pairwise Similarity Map Consistency and Ensemble-Based Cross Pseudolabels.

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation

Pseudo-label Selection for Deep Semi-supervised Learning

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Mutual learning with reliable pseudo label for semi-supervised medical image segmentation

Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentation

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Confidence-weighted Mutual Supervision on Dual Networks for Unsupervised Cross-Modality Image Segmentation

Semisupervised Semantic Segmentation with Mutual Correction Learning

Using Unreliable Pseudo-Labels for Label-Efficient Semantic Segmentation

Synergy-Guided Regional Supervision of Pseudo Labels for Semi-Supervised Medical Image Segmentation

Semi-supervised Semantic Segmentation via Strong-Weak Dual-Branch Network

Dual uncertainty-guided multi-model pseudo-label learning for semi-supervised medical image segmentation

Self-Loop Uncertainty: A Novel Pseudo-Label for Semi-Supervised Medical Image Segmentation

Dual-Decoder Consistency via Pseudo-Labels Guided Data Augmentation for Semi-Supervised Medical Image Segmentation

Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism.