Abstract:Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity, the family of MPNNs suffers from several drawbacks such as transparency and expressivity. Recently, the idea of designing neural models on graphs using the theory of graph kernels has emerged as a more transparent as well as sometimes more expressive alternative to MPNNs known as kernel graph neural networks (KGNNs). Developments on KGNNs are currently a nascent field of research, leaving several challenges from algorithmic design and adaptation to other learning paradigms such as self-supervised learning. In this paper, we improve the design and learning of KGNNs. Firstly, we extend the algorithmic formulation of KGNNs by allowing a more flexible graph-level similarity definition that encompasses former proposals like random walk graph kernel, as well as providing a smoother optimization objective that alleviates the need of introducing combinatorial learning procedures. Secondly, we enhance KGNNs through the lens of self-supervision via developing a novel structure-preserving graph data augmentation method called latent graph augmentation (LGA). Finally, we perform extensive empirical evaluations to demonstrate the efficacy of our proposed mechanisms. Experimental results over benchmark datasets suggest that our proposed model achieves competitive performance that is comparable to or sometimes outperforming state-of-the-art graph representation learning frameworks with or without self-supervision on graph classification tasks. Comparisons against other previously established graph data augmentation methods verify that the proposed LGA augmentation scheme captures better semantics of graph-level invariance.

Variants for Advanced Training Methods

Minimal Variance Sampling with Provable Guarantees for Fast Training of Graph Neural Networks

Sampling methods for efficient training of graph convolutional networks: A survey

Bandit Samplers for Training Graph Neural Networks

Stochastic Training of Graph Convolutional Networks with Variance Reduction

Variants for Different Graph Types

Improving Subgraph Representation Learning via Multi-View Augmentation

Graph Neural Networks Inspired by Classical Iterative Algorithms

Graph Contrastive Learning with Augmentations

Towards data augmentation in graph neural network: An overview and evaluation

Two-Stage Training of Graph Neural Networks for Graph Classification

Graph Relearn Network: Reducing Performance Variance and Improving Prediction Accuracy of Graph Neural Networks

Edge Convolutional Networks: Decomposing Graph Convolutional Networks for Stochastic Training with Independent Edges

Self-supervision meets kernel graph neural models: From architecture to augmentations

Fine-Tuning Graph Neural Networks Via Graph Topology Induced Optimal Transport

Feature-Oriented Sampling for Fast and Scalable GNN Training.

NodeAug: Semi-Supervised Node Classification with Data Augmentation

Data Augmentation on Graphs: A Technical Survey

A learnable sampling method for scalable graph neural networks

Research and Implementation of Data Enhancement Techniques for Graph Neural Networks

Fine-tuning Graph Neural Networks by Preserving Graph Generative Patterns