Abstract:Graph neural networks (GNNs) have become powerful tools for processing graph-based information in various domains. A desirable property of GNNs is transferability, where a trained network can swap in information from a different graph without retraining and retain its accuracy. A recent method of capturing transferability of GNNs is through the use of graphons, which are symmetric, measurable functions representing the limit of large dense graphs. In this work, we contribute to the application of graphons to GNNs by presenting an explicit two-layer graphon neural network (WNN) architecture. We prove its ability to approximate bandlimited graphon signals within a specified error tolerance using a minimal number of network weights. We then leverage this result, to establish the transferability of an explicit two-layer GNN over all sufficiently large graphs in a convergent sequence. Our work addresses transferability between both deterministic weighted graphs and simple random graphs and overcomes issues related to the curse of dimensionality that arise in other GNN results. The proposed WNN and GNN architectures offer practical solutions for handling graph data of varying sizes while maintaining performance guarantees without extensive retraining.

What problem does this paper attempt to address?

This paper mainly discusses the transferability of Graph Neural Networks (GNNs), particularly through the use of graphon and sampling theory. GNNs are very effective in handling graph-structured data, and one important feature is their ability to transfer between different graphs without retraining while maintaining accuracy. The paper proposes a two-layered Graphon Neural Network (WNN) architecture, which can accurately approximate band-limited graphon signals with a small number of network weights, and proves that this two-layered GNN has transferability in all sufficiently large convergent sequence graphs, covering both deterministic and random graphs. The authors first introduce the basic concepts of GNNs, graphon, and WNNs, and then discuss band-limited functions, which are functions that can be linearly combined by a finite number of Fourier patterns. They propose a two-layered WNN architecture that can approximate band-limited graphon signals with a limited number of network weights within a specified error range. Then, they demonstrate how to transform WNN into GNN, so that performance guarantees can be maintained when exchanging information on graphs of different sizes without extensive retraining. The main contributions of the paper include: 1. Proving a sampling theorem that provides a foundation for the WNN and GNN architectures. 2. Designing a two-layered WNN architecture for reconstructing band-limited graphon signals with an error within the range of ε > 0. 3. Transforming WNN into GNN through discretization intervals to ensure the transferability of these GNNs in sufficiently large, simple, deterministic, and random graphs. The research also addresses the problem related to the curse of dimensionality, which refers to maintaining performance without the impact of reducing ε on the number of network layers. These results are of significant importance for practical solutions in handling graph data of different sizes while maintaining performance guarantees.

Transferability of Graph Neural Networks using Graphon and Sampling Theories

Transferability Properties of Graph Neural Networks

Discovering the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions

Graph neural networks and non-commuting operators

Graph Neural Networks: Architectures, Stability, and Transferability

Graph Sampling for Scalable and Expressive Graph Neural Networks on Homophilic Graphs

Transferability of Spectral Graph Convolutional Neural Networks

Graphon Pooling in Graph Neural Networks

An Experimental Study of the Transferability of Spectral Graph Networks

Discovering the Representation Bottleneck of Graph Neural Networks

Training Graph Neural Networks on Growing Stochastic Graphs

Exploiting the Structure of Two Graphs with Graph Neural Networks

A Manifold Perspective on the Statistical Generalization of Graph Neural Networks

Scalable Graph Neural Networks Via Bidirectional Propagation.

Blocking-based Neighbor Sampling for Large-scale Graph Neural Networks.

Graph Policy Network for Transferable Active Learning on Graphs

Scale Invariance of Graph Neural Networks

Graph Neural Networks for Wireless Communications: From Theory to Practice

Learning to Approximate Adaptive Kernel Convolution on Graphs

Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networks

Analyzing the Expressive Power of Graph Neural Networks in a Spectral Perspective