Abstract:Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a star-shaped pattern. MPNNs are appealing for being efficient and scalable, how-ever their expressiveness is upper-bounded by the 1st-order Weisfeiler-Lehman isomorphism test (1-WL). In response, prior works propose highly expressive models at the cost of scalability and sometimes generalization performance. Our work stands between these two regimes: we introduce a general framework to uplift any MPNN to be more expressive, with limited scalability overhead and greatly improved practical performance. We achieve this by extending local aggregation in MPNNs from star patterns to general subgraph patterns (e.g.,k-egonets):in our framework, each node representation is computed as the encoding of a surrounding induced subgraph rather than encoding of immediate neighbors only (i.e. a star). We choose the subgraph encoder to be a GNN (mainly MPNNs, considering scalability) to design a general framework that serves as a wrapper to up-lift any GNN. We call our proposed method GNN-AK(GNN As Kernel), as the framework resembles a convolutional neural network by replacing the kernel with GNNs. Theoretically, we show that our framework is strictly more powerful than 1&2-WL, and is not less powerful than 3-WL. We also design subgraph sampling strategies which greatly reduce memory footprint and improve speed while maintaining performance. Our method sets new state-of-the-art performance by large margins for several well-known graph ML tasks; specifically, 0.08 MAE on ZINC,74.79% and 86.887% accuracy on CIFAR10 and PATTERN respectively.

Learning Cellular Coverage from Real Network Configurations using GNNs

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

Implementing Graph Neural Networks over Wireless Networks Via Over-the-Air Computing: A Joint Communication and Computation Framework

Isometric Graph Neural Networks

Fine-grained graph representation learning for heterogeneous mobile networks with attentive fusion and contrastive learning

Local Clustering Graph Neural Networks

Geodesic Graph Neural Network for Efficient Graph Representation Learning

Mobile Network Configuration Recommendation using Deep Generative Graph Neural Network

Learning the Network of Graphs for Graph Neural Networks

FLEXIBLE: Forecasting Cellular Traffic by Leveraging Explicit Inductive Graph-Based Learning

GNN-Geo: A Graph Neural Network-based Fine-grained IP geolocation Framework

From Stars to Subgraphs: Uplifting Any GNN with Local Structure Awareness

Xgcn: an Extreme Graph Convolutional Network for Large-scale Social Link Prediction

Scalable and Efficient Full-Graph GNN Training for Large Graphs

Deep Graph Convolutional Networks for Accurate Automatic Road Network Selection

A data-centric framework of improving graph neural networks for knowledge graph embedding

Graph Neural Networks over the Air for Decentralized Tasks in Wireless Networks

Learning Large-scale Location Embedding From Human Mobility Trajectories with Graphs

Graph Representation Learning for Wireless Communications

Spatiotemporal Learning on Cell-embedded Graphs

Fully Distributed Online Training of Graph Neural Networks in Networked Systems