Abstract:Graph neural networks (GNNs) have demonstrated great success in many graph data-based applications. The impressive behavior of GNNs typically relies on the availability of a sufficient amount of labeled data for model training. However, in practice, obtaining a large number of annotations is prohibitively labor-intensive and even impossible. Co-training is a popular semi-supervised learning (SSL) paradigm, which trains multiple models based on a common training set while augmenting the limited amount of labeled data used for training each model via the pseudolabeled data generated from the prediction results of other models. Most of the existing co-training works do not control the quality of pseudolabeled data when using them. Therefore, the inaccurate pseudolabels generated by immature models in the early stage of the training process are likely to cause noticeable errors when they are used for augmenting the training data for other models. To address this issue, we propose a self-paced co-training for the GNN (SPC-GNN) framework for semi-supervised node classification. This framework trains multiple GNNs with the same or different structures on different representations of the same training data. Each GNN carries out SSL by using both the originally available labeled data and the augmented pseudolabeled data generated from other GNNs. To control the quality of pseudolabels, a self-paced label augmentation strategy is designed to make the pseudolabels generated at a higher confidence level to be utilized earlier during training such that the negative impact of inaccurate pseudolabels on training data augmentation, and accordingly, the subsequent training process can be mitigated. Finally, each of the trained GNN is evaluated on a validation set, and the best-performing one is chosen as the output. To improve the training effectiveness of the framework, we devise a pretraining followed by a two-step optimization scheme to train GNNs. Experimental results on the node classification task demonstrate that the proposed framework achieves significant improvement over the state-of-the-art SSL methods.

A Fully Test-Time Training Framework for Semi-Supervised Node Classification on Out-of-Distribution Graphs

GraphTTA: Test Time Adaptation on Graph Neural Networks

TGNN: A Joint Semi-supervised Framework for Graph-level Classification

Test-Time Training for Graph Neural Networks

A Post-Training Framework for Improving Heterogeneous Graph Neural Networks

Semisupervised Graph Neural Networks for Graph Classification

Alternately Optimized Graph Neural Networks

Test-Time Training on Graphs with Large Language Models (LLMs)

Enhancing Graph Neural Networks Via Auxiliary Training for Semi-Supervised Node Classification.

Graph Neural Networks With Adaptive Confidence Discrimination

Self-Paced Co-Training of Graph Neural Networks for Semi-Supervised Node Classification

Towards Semi-supervised Universal Graph Classification

GHNN: Graph Harmonic Neural Networks for semi-supervised graph-level classification

Beyond Homophily in Graph Neural Networks: Current Limitations and Effective Designs

Breaking the Entanglement of Homophily and Heterophily in Semi-supervised Node Classification

Learn from Heterophily: Heterophilous Information-enhanced Graph Neural Network

Heterogeneous Graph Tree Networks

Improving Node Classification by Co-training Node Pair Classification: A Novel Training Framework for General Graph Neural Networks

Leveraging Invariant Principle for Heterophilic Graph Structure Distribution Shifts

Rethinking Graph Transformer Architecture Design for Node Classification

Revisiting Graph Neural Networks for Node Classification in Heterogeneous Graphs.