Abstract:Semantic segmentation is the important task of assigning a semantic label to each pixel. However, semantic segmentation based on the deep neural network usually requires massive annotations consumption to acquire better performance. To avoid the problem, some algorithms based on weakly-supervised and semi-supervised conditions have been proposed and achieved gradually improving performance in recent years. In this paper, we propose a novel semi supervised adversarial network to alleviate the shortage of labeled data, which only requires a few labeled images to get competitive performance. The model is composed of two parts: the segmentation network and the discriminator network. The first part aims to semantically generate a segmented result that has the same size as the input color image. The discriminator network is designed in a fully convolutional manner to distinguish the predicted probability maps depending on the ground truth distribution. In particular, the probability maps are regarded as focal attention maps, which are fed back to the segmentation network to make the model converge faster, and the process can induce the model to focus on pixels that are hard to segment. To enhance the representation ability of image features, sparse representation and dual attention are adopted in the segmentation network. The sparse representation module aims to emphasize the object edges and locations by learning the convolutional sparse representation of the input color images, and the dual attention module can exploit the semantic interdependencies in two different dimensions. Moreover, the semi-supervised mechanism is introduced to the network, in which the adaptive parameter T that controls the sensitivity of the self-taught phase is proposed, and the training dataset is split into two parts for fully-supervised learning and semi-supervised learning. Specifically, the first part is unlabeled data, which is applied to provide supervised signals for semi-supervised training. The labeled data drawn from the other part is utilized for fully-supervised learning. Our semi-supervised adversarial framework can improve the learning ability and achieve higher performance, also, provide a novel approach to tackle the semantic segmentation task. Finally, comprehensive experiments on the PASCAL VOC 2012 and Cityscapes datasets are conducted to verify the effectiveness of the proposed model, which achieves the expected performance.

Conservative-Progressive Collaborative Learning for Semi-supervised Semantic Segmentation

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Collaborative Semantic Segmentation with Image Labels.

Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

Semisupervised Semantic Segmentation with Mutual Correction Learning

Twin Pseudo-training for Semi-Supervised Semantic Segmentation

Credible Dual-Expert Learning for Weakly Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation Using Unreliable Pseudo-Labels

Uncertainty-Participation Context Consistency Learning for Semi-supervised Semantic Segmentation

Progressive Learning With Cross-Window Consistency for Semi-Supervised Semantic Segmentation

Semi-Supervised Semantic Segmentation Via Dynamic Self-Training and Class-Balanced Curriculum.

CFCG: Semi-Supervised Semantic Segmentation Via Cross-Fusion and Contour Guidance Supervision

Semi-supervised Semantic Segmentation with Complementary Reconfirmation Mechanism.

Fuzzy Positive Learning for Semi-Supervised Semantic Segmentation

C3T: Contrastive Consistency Cross-Network Learning for Semi-Supervised Semantic Segmentation

Learning from Pixel-Level Label Noise: A New Perspective for Semi-Supervised Semantic Segmentation.

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

Synergy-Guided Regional Supervision of Pseudo Labels for Semi-Supervised Medical Image Segmentation

All-Around Real Label Supervision: Cyclic Prototype Consistency Learning for Semi-supervised Medical Image Segmentation

Adversarial Network Integrating Dual Attention and Sparse Representation for Semi-Supervised Semantic Segmentation

Exploiting Minority Pseudo-Labels for Semi-Supervised Semantic Segmentation in Autonomous Driving