Abstract:Semi-supervised learning (SSL) concerns the problem of how to improve classifiers’ performance through making use of prior knowledge from unlabeled data. Many SSL methods have been developed to integrate unlabeled data into the classifiers based on either the manifold or cluster assumption in recent years. In particular, the graph-based approaches, following the manifold assumption, have achieved a promising performance in many real-world applications. However, most of them work well on small-scale data sets only and lack probabilistic outputs. In this paper, a scalable graph-based SSL framework through sparse Bayesian model is proposed by defining a graph-based sparse prior. Based on the traditional Bayesian inference technique, a sparse Bayesian SSL algorithm (SBS $^2$ L) is obtained, which can remove the irrelevant unlabeled samples and make probabilistic prediction for out-of-sample data. Moreover, in order to scale SBS $^2$ L to large-scale data sets, an incremental SBS $^2$ L (ISBS$^2$ L) is derived. The key idea of ISBS $^2$ L is employing an incremental strategy and sequentially selecting parts of unlabeled samples that contribute to the learning instead of using all available unlabeled samples directly. ISBS$^2$ L has lower time and space complexities than previous SSL algorithms with the use of all unlabeled samples. Extensive experiments on various data sets verify that our algorithms can achieve comparable classification effectiveness and efficiency with much better scalability. Finally, the generalization error bound is derived based on robustness analysis.

Label Diagnosis Through Self Tuning for Web Image Search

Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive

Locating High-Density Clusters with Noisy Queries.

Image colourisation using graph-based semi-supervised learning

Robust Self-Tuning Semi-Supervised Learning.

LaSSL: Label-Guided Self-Training for Semi-supervised Learning

Learning Label Refinement and Threshold Adjustment for Imbalanced Semi-Supervised Learning

Semi-supervised Active Learning for Semi-supervised Models: Exploit Adversarial Examples with Graph-based Virtual Labels

Learning Where to Learn in Cross-View Self-Supervised Learning

Learning What and Where to Learn: A New Perspective on Self-supervised Learning

Meta-Semi: A Meta-learning Approach for Semi-supervised Learning.

On Improving the Algorithm-, Model-, and Data- Efficiency of Self-Supervised Learning

Robust Pseudo-Label Selection for Holistic Semi-Supervised Learning

Towards Self-Adaptive Pseudo-Label Filtering for Semi-Supervised Learning

Generalized Semi-Supervised Learning via Self-Supervised Feature Adaptation

Robust Semi-Supervised Learning when Not All Classes have Labels

Improving Barely Supervised Learning by Discriminating Unlabeled Samples with Super-Class

FlexSSL : A Generic and Efficient Framework for Semi-Supervised Learning

Scalable Graph-Based Semi-Supervised Learning Through Sparse Bayesian Model.

On the Discriminability of Self-Supervised Representation Learning

Class-Imbalanced Semi-Supervised Learning with Adaptive Thresholding.