Abstract:In semi-supervised learning (SSL), a common practice is to learn consistent information from unlabeled data and discriminative information from labeled data to ensure both the immutability and the separability of the classification model. Existing SSL methods suffer from failures in barely-supervised learning (BSL), where only one or two labels per class are available, as the insufficient labels cause the discriminative information being difficult or even infeasible to learn. To bridge this gap, we investigate a simple yet effective way to leverage unlabeled samples for discriminative learning, and propose a novel discriminative information learning module to benefit model training. Specifically, we formulate the learning objective of discriminative information at the super-class level and dynamically assign different classes into different super-classes based on model performance improvement. On top of this on-the-fly process, we further propose a distribution-based loss to learn discriminative information by utilizing the similarity relationship between samples and super-classes. It encourages the unlabeled samples to stay closer to the distribution of their corresponding super-class than those of others. Such a constraint is softer than the direct assignment of pseudo labels, while the latter could be very noisy in BSL. We compare our method with state-of-the-art SSL and BSL methods through extensive experiments on standard SSL benchmarks. Our method can achieve superior results, \eg, an average accuracy of 76.76\% on CIFAR-10 with merely 1 label per class.

DP-SSL: Towards Robust Semi-supervised Learning with A Few Labeled Samples

DeLaLA: Semisupervised Learning via Determinately Labeling and Kernelized Large Margin Projection

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled Data.

Semi-supervised Learning with Deterministic Labeling and Large Margin Projection

Robust Deep Semi-Supervised Learning with Label Propagation and Differential Privacy

Robust Pseudo-Label Selection for Holistic Semi-Supervised Learning

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

ADT-SSL: Adaptive Dual-Threshold for Semi-Supervised Learning

Get a head start: targeted labeling at source with limited annotation overhead for semi-supervised learning

Robust Deep Semi-Supervised Learning: A Brief Introduction

DCRP: Class-Aware Feature Diffusion Constraint and Reliable Pseudo-Labeling for Imbalanced Semi-Supervised Learning

Evidential Pseudo-Label Ensemble for Semi-Supervised Classification

Rethinking Pseudo-labeled Sample Mining for Semi-Supervised Object Detection

In Defense of Pseudo-Labeling: An Uncertainty-Aware Pseudo-label Selection Framework for Semi-Supervised Learning

Improve Semi-supervised Learning with Metric Learning Clusters and Auxiliary Fake Samples

On Pseudo-Labeling for Class-Mismatch Semi-Supervised Learning

Semi-Supervised Learning via Weight-aware Distillation under Class Distribution Mismatch

Robust Semi-Supervised Learning when Not All Classes have Labels

Boosting Semi-Supervised Learning with Dual-Threshold Screening and Similarity Learning

Privileged Semi-Supervised Learning