Abstract:Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation for each node. However, they fail to generalize to heterophilic graphs, where most neighboring nodes have different labels or features, and the relevant nodes are distant. Few recent studies attempt to address this problem by combining multiple hops of hidden representations of central nodes (i.e., multi-hop-based approaches) or sorting the neighboring nodes based on attention scores (i.e., ranking-based approaches). As a result, these approaches have some apparent limitations. On the one hand, multi-hop-based approaches do not explicitly distinguish relevant nodes from a large number of multi-hop neighborhoods, leading to a severe over-smoothing problem. On the other hand, ranking-based models do not joint-optimize node ranking with end tasks and result in sub-optimal solutions. In this work, we present Graph Pointer Neural Networks (GPNN) to tackle the challenges mentioned above. We leverage a pointer network to select the most relevant nodes from a large amount of multi-hop neighborhoods, which constructs an ordered sequence according to the relationship with the central node. 1D convolution is then applied to extract high-level features from the node sequence. The pointer-network-based ranker in GPNN is joint-optimized with other parts in an end-to-end manner. Extensive experiments are conducted on six public node classification datasets with heterophilic graphs. The results show that GPNN significantly improves the classification performance of state-of-the-art methods. In addition, analyses also reveal the privilege of the proposed GPNN in filtering out irrelevant neighbors and reducing over-smoothing.

Graph Neural Networks with Soft Association Between Topology and Attribute

DGNN: Decoupled Graph Neural Networks with Structural Consistency between Attribute and Graph Embedding Representations

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Graph Neural Networks Beyond Compromise Between Attribute and Topology

Heterophily-Aware Graph Attention Network

Heterophilic Graph Neural Network Based on Spatial and Frequency Domain Adaptive Embedding Mechanism

Graph Neural Networks with Feature and Structure Aware Random Walk

Signed Attention Based Graph Neural Network for Graphs with Heterophily.

Graph Neural Networks with Heterophily

Graph Neural Network with Heterogeneous Attributes for Node Classification

ATPGNN: Reconstruction of Neighborhood in Graph Neural Networks with Attention-Based Topological Patterns

Scalable Graph Neural Networks for Heterogeneous Graphs

Exploiting Neighbor Effect: Conv-Agnostic GNN Framework for Graphs with Heterophily

Graph Pointer Neural Networks

Modeling Heterogeneity with Flexible and Semantic Aligned Graph Neural Networks

Advancing Graph Neural Networks with HL-HGAT: A Hodge-Laplacian and Attention Mechanism Approach for Heterogeneous Graph-Structured Data

Adaptive Universal Generalized PageRank Graph Neural Network

Joint Adaptive Feature Smoothing and Topology Extraction via Generalized PageRank GNNs

DCGNN: Adaptive deep graph convolution for heterophily graphs

Representation Learning on Heterophilic Graph with Directional Neighborhood Attention