Abstract:Semantic segmentation with limited annotations, such as weakly supervised semantic segmentation (WSSS) and semi-supervised semantic segmentation (SSSS), is a challenging task that has attracted much attention recently. Most leading WSSS methods employ a sophisticated multi-stage training strategy to estimate pseudo-labels as precise as possible, but they suffer from high model complexity. In contrast, there exists another research line that trains a single network with image-level labels in one training cycle. However, such a single-stage strategy often performs poorly because of the compounding effect caused by inaccurate pseudo-label estimation. To address this issue, this paper presents a Self-supervised Low-Rank Network (SLRNet) for single-stage WSSS and SSSS. The SLRNet uses cross-view self-supervision, that is, it simultaneously predicts several complementary attentive LR representations from different views of an image to learn precise pseudo-labels. Specifically, we reformulate the LR representation learning as a collective matrix factorization problem and optimize it jointly with the network learning in an end-to-end manner. The resulting LR representation deprecates noisy information while capturing stable semantics across different views, making it robust to the input variations, thereby reducing overfitting to self-supervision errors. The SLRNet can provide a unified single-stage framework for various label-efficient semantic segmentation settings: (1) WSSS with image-level labeled data, (2) SSSS with a few pixel-level labeled data, and (3) SSSS with a few pixel-level labeled data and many image-level labeled data. Extensive experiments on the Pascal VOC 2012, COCO, and L2ID datasets demonstrate that our SLRNet outperforms both state-of-the-art WSSS and SSSS methods with a variety of different settings, proving its good generalizability and efficacy.

SEPL-Net: A Semantics-Enhanced Pseudo Labeling Network for Semi-Supervised Image Analysis

PEPL: Precision-Enhanced Pseudo-Labeling for Fine-Grained Image Classification in Semi-Supervised Learning

Pseudo Labeling Methods for Semi-Supervised Semantic Segmentation: A Review and Future Perspectives

Label-PEnet: Sequential Label Propagation and Enhancement Networks for Weakly Supervised Instance Segmentation

Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation

Exploring Structured Semantic Prior for Multi Label Recognition with Incomplete Labels

HPL-ESS: Hybrid Pseudo-Labeling for Unsupervised Event-based Semantic Segmentation

In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learning

Synergy-Guided Regional Supervision of Pseudo Labels for Semi-Supervised Medical Image Segmentation

Leveraging Local Variance for Pseudo-Label Selection in Semi-supervised Learning

Fuzzy Positive Learning for Semi-Supervised Semantic Segmentation

Learning Self-supervised Low-Rank Network for Single-Stage Weakly and Semi-supervised Semantic Segmentation

On Pseudo-Labeling for Class-Mismatch Semi-Supervised Learning

A Semi-Supervised Stacked Autoencoder Using the Pseudo Label for Classification Tasks

A Channel-ensemble Approach: Unbiased and Low-variance Pseudo-labels is Critical for Semi-supervised Classification

Semi-supervised Label Enhancement Via Structured Semantic Extraction

Multi-Level Label Correction by Distilling Proximate Patterns for Semi-supervised Semantic Segmentation

Index Your Position: A Novel Self-Supervised Learning Method for Remote Sensing Images Semantic Segmentation

PseCo: Pseudo Labeling and Consistency Training for Semi-Supervised Object Detection

SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Network

Semi-supervised image semantic segmentation method with semantic regions patching and uncertainty-guided loss