Abstract:A common challenge posed to robust semantic segmentation is the expensive data annotation cost. Existing semi-supervised solutions show great potential for solving this problem. Their key idea is constructing consistency regularization with unsupervised data augmentation from unlabeled data for model training. The perturbations for unlabeled data enable the consistency training loss, which benefits semi-supervised semantic segmentation. However, these perturbations destroy image context and introduce unnatural boundaries, which is harmful for semantic segmentation. Besides, the widely adopted semi-supervised learning framework, i.e. mean-teacher, suffers performance limitation since the student model finally converges to the teacher model. In this paper, first of all, we propose a context friendly differentiable geometric warping to conduct unsupervised data augmentation; secondly, a novel adversarial dual-student framework is proposed to improve the Mean-Teacher from the following two aspects: (1) dual student models are learned independently except for a stabilization constraint to encourage exploiting model diversities; (2) adversarial training scheme is applied to both students and the discriminators are resorted to distinguish reliable pseudo-label of unlabeled data for self-training. Effectiveness is validated via extensive experiments on PASCAL VOC2012 and Cityscapes. Our solution significantly improves the performance and state-of-the-art results are achieved on both datasets. Remarkably, compared with fully supervision, our solution achieves comparable mIoU of 73.4% using only 12.5% annotated data on PASCAL VOC2012. Our codes and models are available at https://github.com/cao-cong/ADS-SemiSeg.

Semi-supervised Semantic Segmentation Based on Confrontation Network

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Semi-supervised semantic image segmentation using dual discriminator adversarial networks

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation

Semantic Segmentation using Adversarial Networks

Semi-supervised Semantic Segmentation via Strong-Weak Dual-Branch Network

Semi-Supervised Mesh Segmentation and Labeling

Adversarial Dual-Student With Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation

Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Collaborative Semantic Segmentation with Image Labels.

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation With Region Relevance

Classification Constrained Discriminator for Domain Adaptive Semantic Segmentation

Attention Based Object Localization for Weakly Supervised Semantic Segmentation

Har Enhanced Weakly-Supervised Semantic Segmentation Coupled With Adversarial Learning

Pairwise-Pixel Self-Supervised and Superpixel-Guided Prototype Contrastive Loss for Weakly Supervised Semantic Segmentation

Dynamic Divide-and-Conquer Adversarial Training for Robust Semantic Segmentation

Weakly Supervised Semantic Segmentation with Boundary Exploration

Improving Semi-Supervised Semantic Segmentation with Dual-Level Siamese Structure Network