Abstract:Semantic segmentation is the important task of assigning a semantic label to each pixel. However, semantic segmentation based on the deep neural network usually requires massive annotations consumption to acquire better performance. To avoid the problem, some algorithms based on weakly-supervised and semi-supervised conditions have been proposed and achieved gradually improving performance in recent years. In this paper, we propose a novel semi supervised adversarial network to alleviate the shortage of labeled data, which only requires a few labeled images to get competitive performance. The model is composed of two parts: the segmentation network and the discriminator network. The first part aims to semantically generate a segmented result that has the same size as the input color image. The discriminator network is designed in a fully convolutional manner to distinguish the predicted probability maps depending on the ground truth distribution. In particular, the probability maps are regarded as focal attention maps, which are fed back to the segmentation network to make the model converge faster, and the process can induce the model to focus on pixels that are hard to segment. To enhance the representation ability of image features, sparse representation and dual attention are adopted in the segmentation network. The sparse representation module aims to emphasize the object edges and locations by learning the convolutional sparse representation of the input color images, and the dual attention module can exploit the semantic interdependencies in two different dimensions. Moreover, the semi-supervised mechanism is introduced to the network, in which the adaptive parameter T that controls the sensitivity of the self-taught phase is proposed, and the training dataset is split into two parts for fully-supervised learning and semi-supervised learning. Specifically, the first part is unlabeled data, which is applied to provide supervised signals for semi-supervised training. The labeled data drawn from the other part is utilized for fully-supervised learning. Our semi-supervised adversarial framework can improve the learning ability and achieve higher performance, also, provide a novel approach to tackle the semantic segmentation task. Finally, comprehensive experiments on the PASCAL VOC 2012 and Cityscapes datasets are conducted to verify the effectiveness of the proposed model, which achieves the expected performance.

Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation

Adversarial Network Integrating Dual Attention and Sparse Representation for Semi-Supervised Semantic Segmentation

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning

Region-aware contrastive learning for semantic segmentation

Positive-Negative Equal Contrastive Loss for Semantic Segmentation

Adversarial Dual-Student With Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation

Prototypical Contrastive Learning for Domain Adaptive Semantic Segmentation.

Directed Mix Contrast for Lidar Point Cloud Segmentation

Pairwise-Pixel Self-Supervised and Superpixel-Guided Prototype Contrastive Loss for Weakly Supervised Semantic Segmentation

Semi-supervised Semantic Segmentation Based on Confrontation Network

Dense Semantic Contrast for Self-Supervised Visual Representation Learning

Confidence-Weighted Dual-Teacher Networks With Biased Contrastive Learning for Semi-Supervised Semantic Segmentation in Remote Sensing Images

A Domain Adaptive Semantic Segmentation Method Using Contrastive Learning and Data Augmentation

Region-Aware Contrastive Learning for Semi-Supervised Semantic Segmentation of Remote Sensing Images

Contrast, Stylize and Adapt: Unsupervised Contrastive Learning Framework for Domain Adaptive Semantic Segmentation

Semantic Distribution-aware Contrastive Adaptation for Semantic Segmentation

Har Enhanced Weakly-Supervised Semantic Segmentation Coupled With Adversarial Learning

Weakly Supervised Region-Level Contrastive Learning for Efficient Object Detection.

Semi-Supervised Semantic Segmentation Via Adaptive Equalization Learning