Abstract:Traditional Semi-supervised Learning (SSL) methods usually assume that the labeled data is independent and identically distributed (i.i.d.) from the underlying distribution. However, several relevant researches have revealed that i.i.d. assumption may not always hold. Influenced by the human preference or automatic labeling, in some cases, the labels (or trusted labels) would be concentrated in the easy samples which have distinctive characteristics. Such a biased labeled set will lead to grave misestimating for the decision boundaries in learning process. In this paper, we proposed a novel evolutionary SSL framework, Solar Eclipse (SE), to address the problem. This framework is based on the concept of progressively enlarging the labeled set with the closest unlabeled samples. Specifically, a novel relative distance measurement Regional Label Propagation (R-LP) is designed. In R-LP, the sample space is divided into several regions according to the class similarities, and the distance is calculated independently in each region with label propagation. Such segregation strategy efficiently reduces the complicity of distance measurement in the feature space. Moreover, R-LP also facilitates the ensemble of different feature views. In our practice, an unbiased self-supervised feature view is introduced to assist the measurement. Experiments show that such dual-view scheme can help us find more reliable extending samples. The evaluation on the popular SSL benchmarks shows that the proposed SE framework achieves the most advanced performance with the easy labeled data. Except that, it also shows advantages when only a few i.i.d. labeled samples is provided, given that they may also have sampling bias.

Semi-supervised Learning with Easy Labeled Data via Impartial Labeled Set Extension

Semi-supervised Learning with Deterministic Labeling and Large Margin Projection

DeLaLA: Semisupervised Learning via Determinately Labeling and Kernelized Large Margin Projection

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Label Distribution-based Open-world Semi-supervised Learning

Exploration and Exploitation of Unlabeled Data for Open-Set Semi-Supervised Learning

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled Data.

DP-SSL: Towards Robust Semi-supervised Learning with A Few Labeled Samples

Privileged Semi-Supervised Learning

Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation

DC-SSL: Addressing Mismatched Class Distribution in Semi-supervised Learning

Semi-Supervised Learning with Label Proportion

Robust Semi-Supervised Learning when Not All Classes have Labels

Semi-supervised learning with extremely sparse labeled data on multiple semi-supervised assumptions

An Empirical Study and Analysis on Open-Set Semi-Supervised Learning

InterLUDE: Interactions between Labeled and Unlabeled Data to Enhance Semi-Supervised Learning

Enhanced Soft Label for Semi-Supervised Semantic Segmentation

Dlsa: Semi-supervised Partial Label Learning Via Dependence-Maximized Label Set Assignment

An Embarrassingly Simple Baseline for Imbalanced Semi-Supervised Learning

Semi-Supervised Learning Through Label Propagation on Geodesics