Abstract:Scalable graph neural networks (GNNs) have emerged as a promising technique, which exhibits superior predictive performance and high running efficiency across numerous large-scale graph-based web applications. However, (i) Most scalable GNNs tend to treat all nodes in graphs with the same propagation rules, neglecting their topological uniqueness; (ii) Existing node-wise propagation optimization strategies are insufficient on web-scale graphs with intricate topology, where a full portrayal of nodes' local properties is required. Intuitively, different nodes in web-scale graphs possess distinct topological roles, and therefore propagating them indiscriminately or neglect local contexts may compromise the quality of node representations. This intricate topology in web-scale graphs cannot be matched by small-scale scenarios. To address the above issues, we propose \textbf{A}daptive \textbf{T}opology-aware \textbf{P}ropagation (ATP), which reduces potential high-bias propagation and extracts structural patterns of each node in a scalable manner to improve running efficiency and predictive performance. Remarkably, ATP is crafted to be a plug-and-play node-wise propagation optimization strategy, allowing for offline execution independent of the graph learning process in a new perspective. Therefore, this approach can be seamlessly integrated into most scalable GNNs while remain orthogonal to existing node-wise propagation optimization strategies. Extensive experiments on 12 datasets, including the most representative large-scale ogbn-papers100M, have demonstrated the effectiveness of ATP. Specifically, ATP has proven to be efficient in improving the performance of prevalent scalable GNNs for semi-supervised node classification while addressing redundant computational costs.

Cayley Graph Propagation

Discovering the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions

Discovering the Representation Bottleneck of Graph Neural Networks

Oversquashing in GNNs through the lens of information contraction and graph expansion

Optimal Propagation for Graph Neural Networks

Graph Neural Networks Inspired by Classical Iterative Algorithms

Expanding Label Sets for Graph Convolutional Networks

Graph Neural Networks Do Not Always Oversmooth

Accelerating Scalable Graph Neural Network Inference with Node-Adaptive Propagation

Geodesic Graph Neural Network for Efficient Graph Representation Learning

Global Minima, Recoverability Thresholds, and Higher-Order Structure in GNNS

Graph Neural Networks Exponentially Lose Expressive Power for Node Classification

Tracing the Propagation Path: A Flow Perspective of Representation Learning on Graphs

Enhanced Expressivity in Graph Neural Networks with Lanczos-Based Linear Constraints

Higher-Order GNNs Meet Efficiency: Sparse Sobolev Graph Neural Networks

Graph neural networks and non-commuting operators

Approximate Graph Propagation

Prioritized Propagation in Graph Neural Networks

Revealing Decurve Flows for Generalized Graph Propagation

Convolutional Signal Propagation: A Simple Scalable Algorithm for Hypergraphs

Rethinking Node-wise Propagation for Large-scale Graph Learning