Abstract:Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a star-shaped pattern. MPNNs are appealing for being efficient and scalable, how-ever their expressiveness is upper-bounded by the 1st-order Weisfeiler-Lehman isomorphism test (1-WL). In response, prior works propose highly expressive models at the cost of scalability and sometimes generalization performance. Our work stands between these two regimes: we introduce a general framework to uplift any MPNN to be more expressive, with limited scalability overhead and greatly improved practical performance. We achieve this by extending local aggregation in MPNNs from star patterns to general subgraph patterns (e.g.,k-egonets):in our framework, each node representation is computed as the encoding of a surrounding induced subgraph rather than encoding of immediate neighbors only (i.e. a star). We choose the subgraph encoder to be a GNN (mainly MPNNs, considering scalability) to design a general framework that serves as a wrapper to up-lift any GNN. We call our proposed method GNN-AK(GNN As Kernel), as the framework resembles a convolutional neural network by replacing the kernel with GNNs. Theoretically, we show that our framework is strictly more powerful than 1&2-WL, and is not less powerful than 3-WL. We also design subgraph sampling strategies which greatly reduce memory footprint and improve speed while maintaining performance. Our method sets new state-of-the-art performance by large margins for several well-known graph ML tasks; specifically, 0.08 MAE on ZINC,74.79% and 86.887% accuracy on CIFAR10 and PATTERN respectively.

Irregular Message Passing Networks

Message Passing Assisted Scalable Distributed Link Management for Ubiquitous Network

Understanding the Message Passing in Graph Neural Networks via Power Iteration Clustering

Message gain aggregation architecture: a scalable graph neural network for combining large-scale neighborhoods

Towards Dynamic Message Passing on Graphs

Improving Message-Passing GNNs by Asynchronous Aggregation

FairAGG: Toward Fair Graph Neural Networks Via Fair Aggregation

Graph Neural Network with Virtual Edge Message Passing for Heterophilous Graphs

Framelet Message Passing

A Simple and General Graph Neural Network with Stochastic Message Passing

Diverse Message Passing for Attribute with Heterophily

ACMP: Allen-Cahn Message Passing with Attractive and Repulsive Forces for Graph Neural Networks

Contrastive Message Passing for Robust Graph Neural Networks with Sparse Labels

Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphs

Propagation Enhanced Neural Message Passing for Graph Representation Learning

A Simple and General Graph Neural Network with Stochastic Message Passing

Identity-aware Graph Neural Networks

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

Generalization Bounds for Message Passing Networks on Mixture of Graphons

Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing

Graph Unitary Message Passing