Abstract:A common challenge posed to robust semantic segmentation is the expensive data annotation cost. Existing semi-supervised solutions show great potential for solving this problem. Their key idea is constructing consistency regularization with unsupervised data augmentation from unlabeled data for model training. The perturbations for unlabeled data enable the consistency training loss, which benefits semi-supervised semantic segmentation. However, these perturbations destroy image context and introduce unnatural boundaries, which is harmful for semantic segmentation. Besides, the widely adopted semi-supervised learning framework, i.e. mean-teacher, suffers performance limitation since the student model finally converges to the teacher model. In this paper, first of all, we propose a context friendly differentiable geometric warping to conduct unsupervised data augmentation; secondly, a novel adversarial dual-student framework is proposed to improve the Mean-Teacher from the following two aspects: (1) dual student models are learned independently except for a stabilization constraint to encourage exploiting model diversities; (2) adversarial training scheme is applied to both students and the discriminators are resorted to distinguish reliable pseudo-label of unlabeled data for self-training. Effectiveness is validated via extensive experiments on PASCAL VOC2012 and Cityscapes. Our solution significantly improves the performance and state-of-the-art results are achieved on both datasets. Remarkably, compared with fully supervision, our solution achieves comparable mIoU of 73.4% using only 12.5% annotated data on PASCAL VOC2012. Our codes and models are available at https://github.com/cao-cong/ADS-SemiSeg.

Semi-Supervised Semantic Segmentation via Marginal Contextual Information

Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism.

Semisupervised Semantic Segmentation with Mutual Correction Learning

Beyond Pixels: Semi-Supervised Semantic Segmentation with a Multi-scale Patch-based Multi-Label Classifier

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

Semi-Supervised Mesh Segmentation and Labeling

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss

Semisupervised Semantic Segmentation by Improving Prediction Confidence

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

CFCG: Semi-Supervised Semantic Segmentation Via Cross-Fusion and Contour Guidance Supervision

Weakly-Supervised Semantic Segmentation with Regional Location Cutting and Dynamic Credible Regions Correction

Enhancing Unsupervised Semantic Segmentation Through Context-Aware Clustering

Conservative-Progressive Collaborative Learning for Semi-supervised Semantic Segmentation

Twin Pseudo-training for Semi-Supervised Semantic Segmentation

Fully Self-Supervised Learning for Semantic Segmentation

Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentation

Advancing Data-Efficient Exploitation for Semi-Supervised Remote Sensing Images Semantic Segmentation

DMSA: Dynamic Multi-scale Unsupervised Semantic Segmentation Based on Adaptive Affinity

Adversarial Dual-Student With Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation With Region Relevance