Abstract:In semi-supervised learning (SSL), a common practice is to learn consistent information from unlabeled data and discriminative information from labeled data to ensure both the immutability and the separability of the classification model. Existing SSL methods suffer from failures in barely-supervised learning (BSL), where only one or two labels per class are available, as the insufficient labels cause the discriminative information being difficult or even infeasible to learn. To bridge this gap, we investigate a simple yet effective way to leverage unlabeled samples for discriminative learning, and propose a novel discriminative information learning module to benefit model training. Specifically, we formulate the learning objective of discriminative information at the super-class level and dynamically assign different classes into different super-classes based on model performance improvement. On top of this on-the-fly process, we further propose a distribution-based loss to learn discriminative information by utilizing the similarity relationship between samples and super-classes. It encourages the unlabeled samples to stay closer to the distribution of their corresponding super-class than those of others. Such a constraint is softer than the direct assignment of pseudo labels, while the latter could be very noisy in BSL. We compare our method with state-of-the-art SSL and BSL methods through extensive experiments on standard SSL benchmarks. Our method can achieve superior results, \eg, an average accuracy of 76.76\% on CIFAR-10 with merely 1 label per class.

Robust Semi-Supervised Learning when Not All Classes have Labels

Robust Deep Semi-Supervised Learning: A Brief Introduction

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.

Robust Semi-Supervised Learning for Self-learning Open-World Classes

Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled Data.

Robust Pseudo-Label Selection for Holistic Semi-Supervised Learning

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

Label Distribution-based Open-world Semi-supervised Learning

Robust Deep Semi-Supervised Learning with Label Propagation and Differential Privacy

Open World Semi-supervised Learning Based on Multi-scale Enhanced Feature

Robust Self-Tuning Semi-Supervised Learning.

Privileged Semi-Supervised Learning

A Survey of Class-Imbalanced Semi-Supervised Learning

Safe semi-supervised learning for pattern classification.

Robust Graph-Based Semisupervised Learning for Noisy Labeled Data Via Maximum Correntropy Criterion

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Exploration and Exploitation of Unlabeled Data for Open-Set Semi-Supervised Learning

Robust Mutual Learning for Semi-supervised Semantic Segmentation

Robust Semi-supervised Learning by Wisely Leveraging Open-set Data

Reinforcement Learning-Guided Semi-Supervised Learning

DC-SSL: Addressing Mismatched Class Distribution in Semi-supervised Learning