Abstract:Graph representation learning has now become the de facto standard when handling graph-structured data, with the framework of message-passing graph neural networks (MPNN) being the most prevailing algorithmic tool. Despite its popularity, the family of MPNNs suffers from several drawbacks such as transparency and expressivity. Recently, the idea of designing neural models on graphs using the theory of graph kernels has emerged as a more transparent as well as sometimes more expressive alternative to MPNNs known as kernel graph neural networks (KGNNs). Developments on KGNNs are currently a nascent field of research, leaving several challenges from algorithmic design and adaptation to other learning paradigms such as self-supervised learning. In this paper, we improve the design and learning of KGNNs. Firstly, we extend the algorithmic formulation of KGNNs by allowing a more flexible graph-level similarity definition that encompasses former proposals like random walk graph kernel, as well as providing a smoother optimization objective that alleviates the need of introducing combinatorial learning procedures. Secondly, we enhance KGNNs through the lens of self-supervision via developing a novel structure-preserving graph data augmentation method called latent graph augmentation (LGA). Finally, we perform extensive empirical evaluations to demonstrate the efficacy of our proposed mechanisms. Experimental results over benchmark datasets suggest that our proposed model achieves competitive performance that is comparable to or sometimes outperforming state-of-the-art graph representation learning frameworks with or without self-supervision on graph classification tasks. Comparisons against other previously established graph data augmentation methods verify that the proposed LGA augmentation scheme captures better semantics of graph-level invariance.

Graph kernels on machine learning:recent works and future developments

Graph Kernels: State-of-the-Art and Future Challenges

Graph Kernel Neural Networks

A Survey on Graph Kernels

Artistic Photo Filtering Recognition Using CNNs

Graph Kernels Exploiting Weisfeiler-Lehman Graph Isomorphism Test Extensions

Message Passing Graph Kernels

Weisfeiler-Lehman Graph Kernels

Graph Neural Tangent Kernel: Fusing Graph Neural Networks with Graph Kernels

Cheetah: Fast Graph Kernel Tracking on Dynamic Graphs

Graph kernel by spectral transform in kernel fisher discriminant analysis

A Simple Hypergraph Kernel Convolution based on Discounted Markov Diffusion Process

Foundations and Frontiers of Graph Learning Theory

Graph Neural Networks with Composite Kernels

What Would a Graph Look Like in this Layout? A Machine Learning Approach to Large Graph Visualization

Seeding the Kernels in Graphs: Toward Multi-Resolution Community Analysis

The AABBA Graph Kernel: Atom–Atom, Bond–Bond, and Bond–Atom Autocorrelations for Machine Learning

Tree++: Truncated Tree Based Graph Kernels

Graph coarsening: from scientific computing to machine learning

Deep graph kernel point processes

Self-supervision meets kernel graph neural models: From architecture to augmentations