Abstract:In semi-supervised learning (SSL), a common practice is to learn consistent information from unlabeled data and discriminative information from labeled data to ensure both the immutability and the separability of the classification model. Existing SSL methods suffer from failures in barely-supervised learning (BSL), where only one or two labels per class are available, as the insufficient labels cause the discriminative information being difficult or even infeasible to learn. To bridge this gap, we investigate a simple yet effective way to leverage unlabeled samples for discriminative learning, and propose a novel discriminative information learning module to benefit model training. Specifically, we formulate the learning objective of discriminative information at the super-class level and dynamically assign different classes into different super-classes based on model performance improvement. On top of this on-the-fly process, we further propose a distribution-based loss to learn discriminative information by utilizing the similarity relationship between samples and super-classes. It encourages the unlabeled samples to stay closer to the distribution of their corresponding super-class than those of others. Such a constraint is softer than the direct assignment of pseudo labels, while the latter could be very noisy in BSL. We compare our method with state-of-the-art SSL and BSL methods through extensive experiments on standard SSL benchmarks. Our method can achieve superior results, \eg, an average accuracy of 76.76\% on CIFAR-10 with merely 1 label per class.

SCD:Sampling-based Class Distribution for Imbalanced Semi-Supervised Learning

A Survey of Class-Imbalanced Semi-Supervised Learning

An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning

CDMAD: Class-Distribution-Mismatch-Aware Debiasing for Class-Imbalanced Semi-Supervised Learning

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

DC-SSL: Addressing Mismatched Class Distribution in Semi-supervised Learning

Label Distribution-based Open-world Semi-supervised Learning

DeCAB: Debiased Semi-supervised Learning for Imbalanced Open-Set Data.

A Normal Distribution-Based Over-Sampling Approach to Imbalanced Data Classification

A New Sampling Approach for Classification of Imbalanced Data Sets with High Density.

Entropy-based Sampling Approaches for Multi-Class Imbalanced Problems

Learning Label Refinement and Threshold Adjustment for Imbalanced Semi-Supervised Learning

Gradient-based Sampling for Class Imbalanced Semi-supervised Object Detection

A Cluster-Based Hybrid Sampling Approach for Imbalanced Data Classification.

OCI-SSL: Open Class-Imbalanced Semi-Supervised Learning with Contrastive Learning

An Improved SVM Based Under-Sampling Method for Classifying Imbalanced Data

DCRP: Class-Aware Feature Diffusion Constraint and Reliable Pseudo-Labeling for Imbalanced Semi-Supervised Learning

Semi-Supervised Learning via Weight-aware Distillation under Class Distribution Mismatch

How Far Have We Progressed in the Sampling Methods for Imbalanced Data Classification? an Empirical Study