Abstract:A common challenge posed to robust semantic segmentation is the expensive data annotation cost. Existing semi-supervised solutions show great potential for solving this problem. Their key idea is constructing consistency regularization with unsupervised data augmentation from unlabeled data for model training. The perturbations for unlabeled data enable the consistency training loss, which benefits semi-supervised semantic segmentation. However, these perturbations destroy image context and introduce unnatural boundaries, which is harmful for semantic segmentation. Besides, the widely adopted semi-supervised learning framework, i.e. mean-teacher, suffers performance limitation since the student model finally converges to the teacher model. In this paper, first of all, we propose a context friendly differentiable geometric warping to conduct unsupervised data augmentation; secondly, a novel adversarial dual-student framework is proposed to improve the Mean-Teacher from the following two aspects: (1) dual student models are learned independently except for a stabilization constraint to encourage exploiting model diversities; (2) adversarial training scheme is applied to both students and the discriminators are resorted to distinguish reliable pseudo-label of unlabeled data for self-training. Effectiveness is validated via extensive experiments on PASCAL VOC2012 and Cityscapes. Our solution significantly improves the performance and state-of-the-art results are achieved on both datasets. Remarkably, compared with fully supervision, our solution achieves comparable mIoU of 73.4% using only 12.5% annotated data on PASCAL VOC2012. Our codes and models are available at https://github.com/cao-cong/ADS-SemiSeg.

Class Probability Space Regularization for Semi-Supervised Semantic Segmentation

A Semantic Labeling Strategy to Reject Unknown Objects in Large Scale 3d Point Clouds

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Class-Wise Adaptive Strategy for Semi Supervised Semantic Segmentation

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Semi-Supervised Semantic Segmentation With Region Relevance

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Fully Data-Driven Pseudo Label Estimation for Pointly-Supervised Panoptic Segmentation

Out-of-Candidate Rectification for Weakly Supervised Semantic Segmentation

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

CAFS: Class Adaptive Framework for Semi-Supervised Semantic Segmentation

Spatial Structure Constraints for Weakly Supervised Semantic Segmentation

Adversarial Dual-Student With Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation

Fuzzy Positive Learning for Semi-Supervised Semantic Segmentation

Scribble Hides Class: Promoting Scribble-Based Weakly-Supervised Semantic Segmentation with Its Class Label

NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic Segmentation

Saliency Guided Inter- and Intra-Class Relation Constraints for Weakly Supervised Semantic Segmentation

Erase then Grow: Generating Correct Class Activation Maps for Weakly-Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation Via Adaptive Equalization Learning