Abstract:Graph self-supervised learning is an effective technique for learning common knowledge from unlabeled graph data through pretext tasks. To capture the interrelationships between nodes and their essential roles globally, existing methods use clustering labels as self-supervised signals. However, in some cases, these methods may introduce noise, leading to over-fitting of the model and a reduction in performance. To address these issues, a novel framework for Graph Self-Supervised Curriculum Learning based on clustering label smoothing called GSSCL has been proposed. GSSCL clusters knowledge in an easy-to-difficult manner, reducing the heavy dependence on the reliability of clustering and improving the generalizability of the model. Moreover, the Silhouette Coefficient is employed to evaluate the clustering confident scores for all nodes. Some nodes are selected based on high confident scores to perform self-supervised learning. To account for the possibility of complex heterophilous information in graphs (e.g., noisy links), clustering pseudo-label smoothing is performed on K-nearest neighbor graphs built upon the similarities between node features instead of the original graph structures. The obtained multi-scale knowledge is then applied to curriculum learning. Finally, comprehensive experiments conducted across diverse public graph benchmarks demonstrate the superior performance of the proposed framework. It exhibits comparable results to state-of-the-art methods across semi-supervised node classification and clustering tasks.

Constrained Least Squares Regression for Semi-Supervised Learning.

Self-supervised Learning on Graphs: Contrastive, Generative,or Predictive

Graph Based Semi-Supervised Learning Via Label Fitting

Efficient And Robust Semi-Supervised Learning Over A Sparse-Regularized Graph

Semi-supervised Image Classification Via Nonnegative Least-Squares Regression

Safety-aware Graph-based Semi-Supervised Learning

Semi-supervised Classification Via Low Rank Graph

Learning a Nonnegative Sparse Graph for Linear Regression

Graph-based Semi-supervised Learning: A Comprehensive Review

Label Information Guided Graph Construction for Semi-Supervised Learning

Semi-supervised Classification with Pairwise Constraints

Robust Self-Tuning Semi-Supervised Learning.

A Semi-Supervised Learning Algorithm Via Adaptive Laplacian Graph

GSSCL: A framework for Graph Self-Supervised Curriculum Learning based on clustering label smoothing

Semi-supervised Learning Through Adaptive Laplacian Graph Trimming

Semi-supervised regression with label-guided adaptive graph optimization

Discriminative and robust least squares regression for semi-supervised image classification

Simultaneous Learning Of Affinity Matrix And Laplacian Regularized Least Squares For Semi-Supervised Classification

Semi-Supervised Learning with Close-Form Label Propagation Using a Bipartite Graph

Semi-supervised learning via sparse model

Symmetric Low-Rank Representation with Adaptive Distance Penalty for Semi-Supervised Learning