Abstract:Graph Neural Networks (GNNs), the powerful graph representation technique based on deep learning, have attracted great research interest in recent years. Although many GNNs have achieved the state-of-the-art accuracy on a set of standard benchmark datasets, they are still limited to traditional semi-supervised framework and lack of sufficient supervision information, especially for the large amount of unlabeled data. To overcome this issue, we propose a novel self-consistent graph neural networks (SCGNN) framework to enrich the supervision information from two aspects: the self-consistency of unlabeled data and the label information of labeled data. First, in order to extract the self-supervision information from the numerous unlabeled nodes, we perform graph data augmentation and leverage a self-consistent constraint to maximize the mutual information of the unlabeled nodes across different augmented graph views. The self-consistency can sufficiently utilize the intrinsic structural attributes of the graph to extract the self-supervision information from unlabeled data and improve the subsequent classification result. Second, to further extract supervision information from scarce labeled nodes, we introduce a fusion mechanism to obtain comprehensive node embeddings by fusing node representations of two positive graph views, and optimize the classification loss over labeled nodes to maximize the utilization of label information. We conduct comprehensive empirical studies on six public benchmark datasets in node classification task. In terms of accuracy, SCGNN improves by an average of 2.08% over the best baseline, and specifically by 5.8% on the Disease dataset.

A Generative Bayesian Graph Attention Network for Semi-Supervised Classification on Scarce Data

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Bayesian Graph Convolutional Neural Networks for Semi-Supervised Classification

Attention-based Graph Neural Network for Semi-supervised Learning

Hierarchical Graph Attention Networks for Semi-Supervised Node Classification

Self-supervised Graph Representations with Generative Adversarial Learning

On Classification Thresholds for Graph Attention with Edge Features

Deep Graph Attention Model

Deep Graph-Convolutional Generative Adversarial Network for Semi-Supervised Learning on Graphs

Semi-Supervised Node Classification on Graphs: Markov Random Fields vs. Graph Neural Networks

Semisupervised Graph Neural Networks for Graph Classification

Semi-AttentionAE: An Integrated Model for Graph Representation Learning

Graph Stochastic Neural Networks for Semi-supervised Learning.

Graph Decoupling Attention Markov Networks for Semisupervised Graph Node Classification

Towards Semi-supervised Universal Graph Classification

Graph Random Neural Networks for Semi-Supervised Learning on Graphs.

Bayesian graph convolutional network with partial observations

Self-consistent Graph Neural Networks for Semi-supervised Node Classification

Node Classification via Semantic-Structural Attention-Enhanced Graph Convolutional Networks

Revisiting Attention-Based Graph Neural Networks for Graph Classification

A Semi-Supervised Graph Neural Network with Confidence Discrimination