Abstract:Graph Neural Networks (GNNs) have received considerable attention on graph-structured data learning for a wide variety of tasks. The well-designed propagation mechanism which has been demonstrated effective is the most fundamental part of GNNs. Although most of GNNs basically follow a message passing manner, litter effort has been made to discover and analyze their essential relations. In this paper, we establish a surprising connection between different propagation mechanisms with a unified optimization problem, showing that despite the proliferation of various GNNs, in fact, their proposed propagation mechanisms are the optimal solution optimizing a feature fitting function over a wide class of graph kernels with a graph regularization term. Our proposed unified optimization framework, summarizing the commonalities between several of the most representative GNNs, not only provides a macroscopic view on surveying the relations between different GNNs, but also further opens up new opportunities for flexibly designing new GNNs. With the proposed framework, we discover that existing works usually utilize naïve graph convolutional kernels for feature fitting function, and we further develop two novel objective functions considering adjustable graph kernels showing low-pass or high-pass filtering capabilities respectively. Moreover, we provide the convergence proofs and expressive power comparisons for the proposed models. Extensive experiments on benchmark datasets clearly show that the proposed GNNs not only outperform the state-of-the-art methods but also have good ability to alleviate over-smoothing, and further verify the feasibility for designing GNNs with our unified optimization framework.

Beyond Graph Convolutional Network: an Interpretable Regularizer-centered Optimization Framework

Graph Learning in Low Dimensional Space for Graph Convolutional Networks

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

A Unified Framework for Convolution-Based Graph Neural Networks

Graph Convolutional Network with elastic topology

Understanding the Effect of GCN Convolutions in Regression Tasks

Stability and Generalization of lp-Regularized Stochastic Learning for GCN

Simplifying Graph Convolutional Networks

Interpretable and Efficient Heterogeneous Graph Convolutional Network

Interpretable Graph Convolutional Network for Multi-View Semi-Supervised Learning

Explainable, Stable, and Scalable Graph Convolutional Networks for Learning Graph Representation

Interpreting and Unifying Graph Neural Networks with an Optimization Framework

Revisiting Graph Convolutional Network on Semi-Supervised Node Classification from an Optimization Perspective

Generalizing Graph Convolutional Networks Via Heat Kernel

Topology Optimization Based Graph Convolutional Network.

LRGCN: Linear Residual Graph Convolution Network Recommendation System

Universal Graph Convolutional Networks

On Regularization for Explaining Graph Neural Networks: An Information Theory Perspective

DAGCN: Dual Attention Graph Convolutional Networks

2 Related Work Following the success of deep neural networks for image classification