Abstract:Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism, which has been demonstrated effective, is the most fundamental part of GNNs. Although most of the GNNs basically follow a message passing manner, little effort has been made to discover and analyze their essential relations. In this paper, we establish a surprising connection between different propagation mechanisms with an optimization problem. We show that despite the proliferation of various GNNs, in fact, their proposed propagation mechanisms are the optimal solutions of a generalized optimization framework with a flexible feature fitting function and a generalized graph regularization term. Actually, the optimization framework can not only help understand the propagation mechanisms of GNNs, but also open up opportunities for flexibly designing new GNNs. Through analyzing the general solutions of the optimization framework, we provide a more convenient way for deriving corresponding propagation results of GNNs. We further discover that existing works usually utilize naïve graph convolutional kernels for feature fitting function, or just utilize one-hop structural information (original topology graph) for graph regularization term. Correspondingly, we develop two novel objective functions considering adjustable graph kernels showing low-pass or high-pass filtering capabilities and one novel objective function considering high-order structural information during propagation respectively. Extensive experiments on benchmark datasets clearly show that the newly proposed GNNs not only outperform the state-of-the-art methods but also have good ability to alleviate over-smoothing, and further verify the feasibility for designing GNNs with the generalized unified optimization framework.

Why Do Attributes Propagate in Graph Convolutional Neural Networks?

Graph Convolutional Network with Learnable Message Propagation Mechanism

Powerful Graph Convolutional Networks with Adaptive Propagation Mechanism for Homophily and Heterophily

Propagation is All You Need: A New Framework for Representation Learning and Classifier Training on Graphs

Powerful Graph Convolutioal Networks with Adaptive Propagation Mechanism for Homophily and Heterophily

Understanding the Effect of GCN Convolutions in Regression Tasks

Learning Data-Driven Propagation Mechanism for Graph Neural Network

Data Representation Via Attribute Selection- Propagation Neural Network

Universal Graph Convolutional Networks

Contrastive Adaptive Propagation Graph Neural Networks for Efficient Graph Learning

Graph Neural Networks Do Not Always Oversmooth

Efficient Nodes Representation Learning with Residual Feature Propagation

Tracing the Propagation Path: A Flow Perspective of Representation Learning on Graphs

Interpreting and Understanding Graph Convolutional Neural Network using Gradient-based Attribution Method

Proximity Preserving Graph Convolutional Networks.

Graph Neural Networks Without Propagation.

Unifying Graph Neural Networks with a Generalized Optimization Framework

On the Equivalence of Decoupled Graph Convolution Network and Label Propagation

Graph Neural Networks Provably Benefit from Structural Information: A Feature Learning Perspective

Interpreting and Unifying Graph Neural Networks with an Optimization Framework

Explaining GNN over Evolving Graphs using Information Flow