Abstract:Graph Neural Networks (GNNs), the powerful graph representation technique based on deep learning, have attracted great research interest in recent years. Although many GNNs have achieved the state-of-the-art accuracy on a set of standard benchmark datasets, they are still limited to traditional semi-supervised framework and lack of sufficient supervision information, especially for the large amount of unlabeled data. To overcome this issue, we propose a novel self-consistent graph neural networks (SCGNN) framework to enrich the supervision information from two aspects: the self-consistency of unlabeled data and the label information of labeled data. First, in order to extract the self-supervision information from the numerous unlabeled nodes, we perform graph data augmentation and leverage a self-consistent constraint to maximize the mutual information of the unlabeled nodes across different augmented graph views. The self-consistency can sufficiently utilize the intrinsic structural attributes of the graph to extract the self-supervision information from unlabeled data and improve the subsequent classification result. Second, to further extract supervision information from scarce labeled nodes, we introduce a fusion mechanism to obtain comprehensive node embeddings by fusing node representations of two positive graph views, and optimize the classification loss over labeled nodes to maximize the utilization of label information. We conduct comprehensive empirical studies on six public benchmark datasets in node classification task. In terms of accuracy, SCGNN improves by an average of 2.08% over the best baseline, and specifically by 5.8% on the Disease dataset.

An In-depth Analysis of Graph Neural Networks for Semi-supervised Learning

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Deeper Insights Into Graph Convolutional Networks for Semi-Supervised Learning

Self-supervised Graph Representations with Generative Adversarial Learning

Gated Relational Graph Neural Network For Semi-Supervised Learning On Knowledge Graphs

Graph Convolutional Network For Semi-supervised Node Classification With Subgraph Sketching

Deep Graph-Convolutional Generative Adversarial Network for Semi-Supervised Learning on Graphs

Hierarchical Graph Convolutional Networks for Semi-supervised Node Classification

Graph Stochastic Neural Networks for Semi-supervised Learning.

Semisupervised Graph Neural Networks for Graph Classification

Semi-supervised Training for Knowledge Base Graph Self-attention Networks on Link Prediction

Graph Partner Neural Networks for Semi-Supervised Learning on Graphs

Semi-Supervised and Self-Supervised Classification with Multi-View Graph Neural Networks

Simple and Deep Graph Convolutional Networks

Robust graph learning with graph convolutional network

Self-consistent Graph Neural Networks for Semi-supervised Node Classification

A Comprehensive Survey of Graph Neural Networks for Knowledge Graphs

Self-supervised Training of Graph Convolutional Networks

Attention-based Graph Neural Network for Semi-supervised Learning

Exploring Structure-Adaptive Graph Learning for Robust Semi-Supervised Classification