Abstract:Designing effective graph neural networks (GNNs) with message passing has two fundamental challenges, i.e., determining optimal message-passing pathways and designing local aggregators. Previous methods of designing optimal pathways are limited with information loss on the input features. On the other hand, existing local aggregators generally fail to extract multi-scale features and approximate diverse operators under limited parameter scales. In contrast to these methods, Euclidean convolution has been proven as an expressive aggregator, making it a perfect candidate for GNN construction. However, the challenges of generalizing Euclidean convolution to graphs arise from the irregular structure of graphs. To bridge the gap between Euclidean space and graph topology, we propose a differentiable method that applies permutations to calibrate input graphs for Euclidean convolution. The permutations constrain all nodes in a row regardless of their input order and therefore enable the flexible generalization of Euclidean convolution to graphs. Based on the graph calibration, we propose the Compressed Convolution Network (CoCN) for hierarchical graph representation learning. CoCN follows local feature-learning and global parameter-sharing mechanisms of convolution neural networks. The whole model can be trained end-to-end, with compressed convolution applied to learn individual node features and their corresponding structure features. CoCN can further borrow successful practices from Euclidean convolution, including residual connection and inception mechanism. We validate CoCN on both node-level and graph-level benchmarks. CoCN achieves superior performance over competitive GNN baselines. Codes are available at <a class="link-external link-https" href="https://github.com/sunjss/CoCN" rel="external noopener nofollow">this https URL</a>.

Barron Space for Graph Convolution Neural Networks

Representation Formulas and Pointwise Properties for Barron Functions

Asymptotic generalization error of a single-layer graph convolutional network

The Barron Space and the Flow-Induced Function Spaces for Neural Network Models

Bayesian Graph Convolutional Neural Networks for Semi-Supervised Classification

Graph Learning in Low Dimensional Space for Graph Convolutional Networks

Understanding the Effect of GCN Convolutions in Regression Tasks

Topology and Prediction Focused Research on Graph Convolutional Neural Networks

Bilinear Graph Neural Network with Neighbor Interactions

Bi-GCN: Binary Graph Convolutional Network

Binarized Graph Neural Network

PAC-Bayesian Adversarially Robust Generalization Bounds for Graph Neural Network

Equivariant Neural Operator Learning with Graphon Convolution

Pooling in Graph Convolutional Neural Networks

Scalable Graph Compressed Convolutions

Binary Graph Convolutional Network With Capacity Exploration

Some observations on high-dimensional partial differential equations with Barron data

Clenshaw Graph Neural Networks

Graph convolutional networks of reconstructed graph structure with constrained Laplacian rank

Explainable, Stable, and Scalable Graph Convolutional Networks for Learning Graph Representation

Embeddings between Barron spaces with higher order activation functions