Abstract:Graph-based semisupervised learning can explore the graph topology information behind the samples, becoming one of the most attractive research areas in machine learning in recent years. Nevertheless, existing graph-based methods also suffer from two shortcomings. On the one hand, the existing methods generate graphs in the original high-dimensional space, which are easily disturbed by noisy and redundancy features, resulting in low-quality constructed graphs that cannot accurately portray the relationships between data. On the other hand, most of the existing models are based on the Gaussian assumption, which cannot capture the local submanifold structure information of the data, thus reducing the discriminativeness of the learned low-dimensional representations. This article proposes a semisupervised subspace learning with adaptive pairwise graph embedding (APGE), which first builds a k<sub>1</sub> -nearest neighbor graph on the labeled data to learn local discriminant embeddings for exploring the intrinsic structure of the non-Gaussian labeled data, i.e., the submanifold structure. Then, a k<sub>2</sub> -nearest neighbor graph is constructed on all samples and mapped to GE learning to adaptively explore the global structure of all samples. Clustering unlabeled data and its corresponding labeled neighbors into the same submanifold, sharing the same label information, improves embedded data's discriminative ability. And the adaptive neighborhood learning method is used to learn the graph structure in the continuously optimized subspace to ensure that the optimal graph matrix and projection matrix are finally learned, which has strong robustness. Meanwhile, the rank constraint is added to the Laplacian matrix of the similarity matrix of all samples so that the connected components in the obtained similarity matrix are precisely equal to the number of classes in the sample, which makes the structure of the graph clearer and the relationship between the near-neighbor sample points more explicit. Finally, multiple experiments on several synthetic and real-world datasets show that the method performs well in exploring local structure and classification tasks.

Generalized Matrix Means for Semi-Supervised Learning with Multilayer Graphs

Generalized entropy based semi-supervised learning

Learnable Graph-Regularization for Matrix Decomposition

Learning the Right Layers: a Data-Driven Layer-Aggregation Strategy for Semi-Supervised Learning on Multilayer Graphs

Laplacian-based Semi-Supervised Learning in Multilayer Hypergraphs by Coordinate Descent

Penalized Maximum Likelihood Estimation of Multi-layered Gaussian Graphical Models

Generalization errors of Laplacian regularized least squares regression

Simultaneous Learning Of Affinity Matrix And Laplacian Regularized Least Squares For Semi-Supervised Classification

A Regularized Approach for Geodesic-Based Semisupervised Multimanifold Learning

Multilayer Clustered Graph Learning

A multilevel approach for learning from labeled and unlabeled data on graphs

A Large Dimensional Analysis of Multi-task Semi-Supervised Learning

A unified deep semi-supervised graph learning scheme based on nodes re-weighting and manifold regularization

Graph Based Multi-class Semi-supervised Learning Using Gaussian Process

Semisupervised Subspace Learning With Adaptive Pairwise Graph Embedding

Adaptive graph Laplacian MTL L1, L2 and LS-SVMs

Distributed Estimation on Semi-Supervised Generalized Linear Model.

Label Information Guided Graph Construction for Semi-Supervised Learning

Mean-field Analysis of Generalization Errors

Non-negative low rank and sparse graph for semi-supervised learning

Generalization Error of Graph Neural Networks in the Mean-field Regime