Abstract:Graph neural networks (GNNs) have demonstrated great success in many graph data-based applications. The impressive behavior of GNNs typically relies on the availability of a sufficient amount of labeled data for model training. However, in practice, obtaining a large number of annotations is prohibitively labor-intensive and even impossible. Co-training is a popular semi-supervised learning (SSL) paradigm, which trains multiple models based on a common training set while augmenting the limited amount of labeled data used for training each model via the pseudolabeled data generated from the prediction results of other models. Most of the existing co-training works do not control the quality of pseudolabeled data when using them. Therefore, the inaccurate pseudolabels generated by immature models in the early stage of the training process are likely to cause noticeable errors when they are used for augmenting the training data for other models. To address this issue, we propose a self-paced co-training for the GNN (SPC-GNN) framework for semi-supervised node classification. This framework trains multiple GNNs with the same or different structures on different representations of the same training data. Each GNN carries out SSL by using both the originally available labeled data and the augmented pseudolabeled data generated from other GNNs. To control the quality of pseudolabels, a self-paced label augmentation strategy is designed to make the pseudolabels generated at a higher confidence level to be utilized earlier during training such that the negative impact of inaccurate pseudolabels on training data augmentation, and accordingly, the subsequent training process can be mitigated. Finally, each of the trained GNN is evaluated on a validation set, and the best-performing one is chosen as the output. To improve the training effectiveness of the framework, we devise a pretraining followed by a two-step optimization scheme to train GNNs. Experimental results on the node classification task demonstrate that the proposed framework achieves significant improvement over the state-of-the-art SSL methods.

Enhancing Graph Neural Networks Via Auxiliary Training for Semi-Supervised Node Classification.

Improving Node Classification by Co-training Node Pair Classification: A Novel Training Framework for General Graph Neural Networks

Improving Node Classification by Co-training Node Pair Classification: A Novel Training Framework for General Graph Neural Networks

Self-consistent Graph Neural Networks for Semi-supervised Node Classification

Semisupervised Graph Neural Networks for Graph Classification

Dual GNNs: Graph Neural Network Learning with Limited Supervision

Self-supervised Graph Representations with Generative Adversarial Learning

Self-Paced Co-Training of Graph Neural Networks for Semi-Supervised Node Classification

Self-Enhanced GNN: Improving Graph Neural Networks Using Model Outputs

Graph Neural Networks With Adaptive Confidence Discrimination

E2GNN: Efficient Graph Neural Network Ensembles for Semi-Supervised Classification

GHNN: Graph Harmonic Neural Networks for semi-supervised graph-level classification

GANN: Graph Alignment Neural Network for semi-supervised learning

INS-GNN: Improving Graph Imbalance Learning with Self-Supervision

Supervised contrastive learning for graph representation enhancement

Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks

Generalized Equivariance and Preferential Labeling for GNN Node Classification

Alternately Optimized Graph Neural Networks

KGNN: Harnessing Kernel-based Networks for Semi-supervised Graph Classification

Improving Your Graph Neural Networks: A High-Frequency Booster

NodeAug: Semi-Supervised Node Classification with Data Augmentation