Abstract:Semi-supervised learning (SSL) concerns the problem of how to improve classifiers’ performance through making use of prior knowledge from unlabeled data. Many SSL methods have been developed to integrate unlabeled data into the classifiers based on either the manifold or cluster assumption in recent years. In particular, the graph-based approaches, following the manifold assumption, have achieved a promising performance in many real-world applications. However, most of them work well on small-scale data sets only and lack probabilistic outputs. In this paper, a scalable graph-based SSL framework through sparse Bayesian model is proposed by defining a graph-based sparse prior. Based on the traditional Bayesian inference technique, a sparse Bayesian SSL algorithm (SBS $^2$ L) is obtained, which can remove the irrelevant unlabeled samples and make probabilistic prediction for out-of-sample data. Moreover, in order to scale SBS $^2$ L to large-scale data sets, an incremental SBS $^2$ L (ISBS$^2$ L) is derived. The key idea of ISBS $^2$ L is employing an incremental strategy and sequentially selecting parts of unlabeled samples that contribute to the learning instead of using all available unlabeled samples directly. ISBS$^2$ L has lower time and space complexities than previous SSL algorithms with the use of all unlabeled samples. Extensive experiments on various data sets verify that our algorithms can achieve comparable classification effectiveness and efficiency with much better scalability. Finally, the generalization error bound is derived based on robustness analysis.

Posterior consistency of semi-supervised regression on graphs

Learning directed acyclic graphs based on sparsest permutations

Noise-resistant Graph Neural Networks with Manifold Consistency and Label Consistency

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Semi-supervised Classification Via Low Rank Graph

Posterior Consistency of the Silverman G-Prior in Bayesian Model Choice.

Probabilistic Semi-Supervised Learning via Sparse Graph Structure Learning

Semi-Supervised Graph Imbalanced Regression

Semi-Supervised Laplace Learning on Stiefel Manifolds

Scalable Graph-Based Semi-Supervised Learning Through Sparse Bayesian Model.

Posterior consistency of Gaussian process prior for nonparametric binary regression

Consistency of Fractional Graph-Laplacian Regularization in Semi-Supervised Learning with Finite Labels

Semi-supervised regression with label-guided adaptive graph optimization

Semi-supervised Classification with Pairwise Constraints

Semisupervised regression in latent structure networks on unknown manifolds

Bayesian graph selection consistency under model misspecification

Posterior Concentration for Sparse Deep Learning

Semi-supervised Learning Through Adaptive Laplacian Graph Trimming

Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy

Latent Graph Inference with Limited Supervision

Distributionally Robust Semi-Supervised Learning Over Graphs