Abstract:Semantic segmentation plays an important role in many fields because of its powerful ability to classify each pixel efficiently and accurately, but it relies on a large amount of manual annotations. In many cases, the annotations are very scarce and expensive, such as in medical image segmentation. To address this problem, researchers have been increasingly concerned about building efficient deep learning algorithms using rough label information in the past few years, with weakly supervised semantic segmentation method being one of them. Currently, most weakly supervised semantic segmentation methods rely on prototype learning to obtain the correlation between pixels; when the images of different categories are similar or indistinguishable, the extracted prototype has no representativeness to guide the training of model. Inspired by metric learning, we construct the pixel-level pairwise samples and propose a new self-supervised contrastive loss based on them, which makes full use of the class activation maps to reduce the intra-class difference and increase the inter-class difference; we also propose a novel prototype loss by a superpixel-guided clustering method to mine the valuable information in the image, which gathers the similar feature vectors to obtain the prototypes more accurately. The comparative experiments are carried out on PASCAL VOC 2012 and MS COCO 2014, the segmentation mIoU on the test set of PASCAL VOC 2012 has reached 69.5%, and the mIoU on the test set of MS COCO 2014 has reached 40.6%. The experimental results demonstrate our method achieves new state-of-the-art performance, which verifies the effectiveness and feasibility of the proposed method.

Pairwise-Pixel Self-Supervised and Superpixel-Guided Prototype Contrastive Loss for Weakly Supervised Semantic Segmentation

Semi-supervised Semantic Segmentation via Prototypical Contrastive Learning

Pixel Contrastive-Consistent Semi-Supervised Semantic Segmentation

Cross-Image Pixel Contrasting for Semantic Segmentation

Weakly-supervised Semantic Segmentation with Superpixel Guided Local and Global Consistency

Exploring Cross-Image Pixel Contrast for Semantic Segmentation

Dual Prototypical Contrastive Learning for Few-shot Semantic Segmentation

Progressive Feature Self-reinforcement for Weakly Supervised Semantic Segmentation

Adversarial Dense Contrastive Learning for Semi-Supervised Semantic Segmentation

Weakly supervised semantic segmentation based on superpixel affinity

Weakly-supervised Semantic Segmentation via Dual-stream Contrastive Learning of Cross-image Contextual Information

Weakly Supervised Semantic Segmentation via Progressive Patch Learning

Region-aware Contrastive Learning for Semantic Segmentation

Weakly Supervised Semantic Segmentation Based on Co-segmentation.

Prototype-oriented Contrastive Learning for Semi-Supervised Medical Image Segmentation

Weak-shot Semantic Segmentation via Dual Similarity Transfer

Positive-Negative Equal Contrastive Loss for Semantic Segmentation

Weaklier Supervised Semantic Segmentation with Only One Image Level Annotation Per Category.

Weakly Supervised Semantic Segmentation Based on Web Image Co-segmentation

Sparse Reconstruction for Weakly Supervised Semantic Segmentation.

Bottom-Up Top-Down Cues for Weakly-Supervised Semantic Segmentation