Abstract:Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are restricted by two problems, i.e., (i) lack of interpretability to identify node features significant to the prediction of GNNs, and (ii) feature over-mixing that leads to the over-smoothing issue in capturing long-range dependencies and inability to handle graphs under heterophily or low homophily. In this paper, we propose a Node-level Capsule Graph Neural Network (NCGNN) to address these problems with an improved message passing scheme. Specifically, NCGNN represents nodes as groups of node-level capsules, in which each capsule extracts distinctive features of its corresponding node. For each node-level capsule, a novel dynamic routing procedure is developed to adaptively select appropriate capsules for aggregation from a subgraph identified by the designed graph filter. NCGNN aggregates only the advantageous capsules and restrains irrelevant messages to avoid over-mixing features of interacting nodes. Therefore, it can relieve the over-smoothing issue and learn effective node representations over graphs with homophily or heterophily. Furthermore, our proposed message passing scheme is inherently interpretable and exempt from complex post-hoc explanations, as the graph filter and the dynamic routing procedure identify a subset of node features that are most significant to the model prediction from the extracted subgraph. Extensive experiments on synthetic as well as real-world graphs demonstrate that NCGNN can well address the over-smoothing issue and produce better node representations for semisupervised node classification. It outperforms the state of the arts under both homophily and heterophily.

Exploring Graph Capsual Network and Graphormer for Graph Classification

Exploring graph capsual network for graph classification

LightCapsGNN: Light Capsule Graph Neural Network for Graph Classification

NCGNN: Node-Level Capsule Graph Neural Network for Semisupervised Classification

Adaptive Attention Graph Capsule Network

The Analysis Between Traditional Convolution Neural Network and CapsuleNet

Capsule Graph Neural Networks with EM Routing

Graph Transformer Networks Based Text Representation.

GCN2CAPS: Graph Convolutional Network to Capsule Network for Wide-Field Robust Graph Learning

Graph Clustering with Graph Capsule Network.

NodeFormer: A Scalable Graph Structure Learning Transformer for Node Classification

On Size-Oriented Long-Tailed Graph Classification of Graph Neural Networks

Can Higher-Order Structural Features Improve the Performance of Graph Neural Networks for Graph Classification?

Federated Capsule Graph Neural Network with Personalization.

Graph Transformer: Learning Better Representations for Graph Neural Networks.

Rethinking Graph Transformer Architecture Design for Node Classification

Text Level Graph Neural Network for Text Classification

Hierarchical Graph Capsule Networks for Molecular Function Classification with Disentangled Representations.

Graph structure reforming framework enhanced by commute time distance for graph classification

Graph as a feature: improving node classification with non-neural graph-aware logistic regression

A Novel Two-Channel Classification Approach Using Graph Attention Network with K-Nearest Neighbor