Abstract:In semi-supervised learning (SSL), a common practice is to learn consistent information from unlabeled data and discriminative information from labeled data to ensure both the immutability and the separability of the classification model. Existing SSL methods suffer from failures in barely-supervised learning (BSL), where only one or two labels per class are available, as the insufficient labels cause the discriminative information being difficult or even infeasible to learn. To bridge this gap, we investigate a simple yet effective way to leverage unlabeled samples for discriminative learning, and propose a novel discriminative information learning module to benefit model training. Specifically, we formulate the learning objective of discriminative information at the super-class level and dynamically assign different classes into different super-classes based on model performance improvement. On top of this on-the-fly process, we further propose a distribution-based loss to learn discriminative information by utilizing the similarity relationship between samples and super-classes. It encourages the unlabeled samples to stay closer to the distribution of their corresponding super-class than those of others. Such a constraint is softer than the direct assignment of pseudo labels, while the latter could be very noisy in BSL. We compare our method with state-of-the-art SSL and BSL methods through extensive experiments on standard SSL benchmarks. Our method can achieve superior results, \eg, an average accuracy of 76.76\% on CIFAR-10 with merely 1 label per class.

Learning sample-aware threshold for semi-supervised learning

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.

Learning Label Refinement and Threshold Adjustment for Imbalanced Semi-Supervised Learning

InstanT: Semi-supervised Learning with Instance-dependent Thresholds

Self Adaptive Threshold Pseudo-labeling and Unreliable Sample Contrastive Loss for Semi-supervised Image Classification

Rethinking Pseudo-labeled Sample Mining for Semi-Supervised Object Detection

Meta-Semi: A Meta-learning Approach for Semi-supervised Learning.

Dual-Decoupling Learning and Metric-Adaptive Thresholding for Semi-Supervised Multi-Label Learning

Towards Self-Adaptive Pseudo-Label Filtering for Semi-Supervised Learning

AllMatch: Exploiting All Unlabeled Data for Semi-Supervised Learning

SoftMatch: Addressing the Quantity-Quality Trade-off in Semi-supervised Learning

Class-Specific Thresholding for Imbalanced Semi-Supervised Learning

Semi-supervised learning by selective training with pseudo labels via confidence estimation

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

Uncertainty-aware Sampling for Long-tailed Semi-supervised Learning

Dash: Semi-Supervised Learning with Dynamic Thresholding

Boosting Semi-Supervised Learning with Dual-Threshold Screening and Similarity Learning

A Channel-ensemble Approach: Unbiased and Low-variance Pseudo-labels is Critical for Semi-supervised Classification

FreeMatch: Self-adaptive Thresholding for Semi-supervised Learning

Pseudo-Labeling Based Practical Semi-Supervised Meta-Training for Few-Shot Learning