Abstract:Graph Neural Networks (GNNs) have become a prominent approach to machine learning with graphs and have been increasingly applied in a multitude of domains. Nevertheless, since most existing GNN models are based on flat message-passing mechanisms, two limitations need to be tackled: (i) they are costly in encoding long-range information spanning the graph structure; (ii) they are failing to encode features in the high-order neighbourhood in the graphs as they only perform information aggregation across the observed edges in the original graph. To deal with these two issues, we propose a novel Hierarchical Message-passing Graph Neural Networks framework. The key idea is generating a hierarchical structure that re-organises all nodes in a flat graph into multi-level super graphs, along with innovative intra- and inter-level propagation manners. The derived hierarchy creates shortcuts connecting far-away nodes so that informative long-range interactions can be efficiently accessed via message passing and incorporates meso- and macro-level semantics into the learned node representations. We present the first model to implement this framework, termed Hierarchical Community-aware Graph Neural Network (HC-GNN), with the assistance of a hierarchical community detection algorithm. The theoretical analysis illustrates HC-GNN's remarkable capacity in capturing long-range information without introducing heavy additional computation complexity. Empirical experiments conducted on 9 datasets under transductive, inductive, and few-shot settings exhibit that HC-GNN can outperform state-of-the-art GNN models in network analysis tasks, including node classification, link prediction, and community detection. Moreover, the model analysis further demonstrates HC-GNN's robustness facing graph sparsity and the flexibility in incorporating different GNN encoders.

Towards Dynamic Message Passing on Graphs

Discovering the Representation Bottleneck of Graph Neural Networks from Multi-order Interactions

Persistent Message Passing

Message passing all the way up

A Simple and General Graph Neural Network with Stochastic Message Passing

Message Passing Assisted Scalable Distributed Link Management for Ubiquitous Network

A Simple and General Graph Neural Network with Stochastic Message Passing

GMLP: Building Scalable and Flexible Graph Neural Networks with Feature-Message Passing

Framelet Message Passing

Next Level Message-Passing with Hierarchical Support Graphs

Dynamic Spiking Framework for Graph Neural Networks

Parallel Message Passing in Dual-space on Graphs

Hierarchical Message-Passing Graph Neural Networks

Flow2GNN: Flexible Two-Way Flow Message Passing for Enhancing GNNs Beyond Homophily

Irregular Message Passing Networks

TransGNN: A Transductive Graph Neural Network with Graph Dynamic Embedding

Discovering the Representation Bottleneck of Graph Neural Networks

Propagation Enhanced Neural Message Passing for Graph Representation Learning

Diverse Message Passing for Attribute with Heterophily

Improving Message-Passing GNNs by Asynchronous Aggregation

Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing