Abstract:Message passing (MP) is crucial for effective graph neural networks (GNNs). Most local message-passing schemes have been shown to underperform on heterophily graphs due to the perturbation of updated representations caused by local redundant heterophily information. However, our experiment findings indicate that the distribution of heterophily information during MP can be disrupted by disentangling local neighborhoods. This finding can be applied to other GNNs, improving their performance on heterophily graphs in a more flexible manner compared to most heterophily GNNs with complex designs. This article proposes a new type of simple message-passing neural network called Flow2GNN. It uses a two-way flow message-passing scheme to enhance the ability of GNNs by disentangling and redistributing heterophily information in the topology space and the attribute space. Our proposed message-passing scheme consists of two steps in topology space and attribute space. First, we introduce a new disentangled operator with binary elements that disentangle topology information in-flow and out-flow between connected nodes. Second, we use an adaptive aggregation model that adjusts the flow amount between homophily and heterophily attribute information. Furthermore, we rigorously prove that disentangling in message-passing can reduce the generalization gap, offering a deeper understanding of how our model enhances other GNNs. The extensive experiment results show that the proposed model, Flow2GNN, not only outperforms state-of-the-art GNNs, but also helps improve the performance of other commonly used GNNs on heterophily graphs, including GCN, GAT, GCNII, and H $_{2}$ GCN, specifically for GCN, with up to a 25.88% improvement on the Wisconsin dataset.

Diverse Message Passing for Attribute with Heterophily

Beyond Homophily and Homogeneity Assumption: Relation-Based Frequency Adaptive Graph Neural Networks

Flow2GNN: Flexible Two-Way Flow Message Passing for Enhancing GNNs Beyond Homophily

Memory-based Message Passing: Decoupling the Message for Propogation from Discrimination

Memory-based message passing: decoupling the message for propagation from discrimination

Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing

Revisiting the Message Passing in Heterophilous Graph Neural Networks

Generalizing Message Passing Neural Networks to Heterophily Using Position Information

Message Passing Assisted Scalable Distributed Link Management for Ubiquitous Network

DCGNN: Adaptive deep graph convolution for heterophily graphs

Heterophilous Distribution Propagation for Graph Neural Networks

Revisiting Heterophily For Graph Neural Networks

Fairness-aware Message Passing for Graph Neural Networks

PathMLP: Smooth Path Towards High-order Homophily

Higher-Order Attribute-Enhancing Heterogeneous Graph Neural Networks

Heterogeneous Graph Propagation Network

Taming Over-Smoothing Representation on Heterophilic Graphs

Universal Inceptive GNNs by Eliminating the Smoothness-generalization Dilemma

Graph Neural Network with Virtual Edge Message Passing for Heterophilous Graphs

Partitioning Message Passing for Graph Fraud Detection