Abstract:Designing effective graph neural networks (GNNs) with message passing has two fundamental challenges, i.e., determining optimal message-passing pathways and designing local aggregators. Previous methods of designing optimal pathways are limited with information loss on the input features. On the other hand, existing local aggregators generally fail to extract multi-scale features and approximate diverse operators under limited parameter scales. In contrast to these methods, Euclidean convolution has been proven as an expressive aggregator, making it a perfect candidate for GNN construction. However, the challenges of generalizing Euclidean convolution to graphs arise from the irregular structure of graphs. To bridge the gap between Euclidean space and graph topology, we propose a differentiable method that applies permutations to calibrate input graphs for Euclidean convolution. The permutations constrain all nodes in a row regardless of their input order and therefore enable the flexible generalization of Euclidean convolution to graphs. Based on the graph calibration, we propose the Compressed Convolution Network (CoCN) for hierarchical graph representation learning. CoCN follows local feature-learning and global parameter-sharing mechanisms of convolution neural networks. The whole model can be trained end-to-end, with compressed convolution applied to learn individual node features and their corresponding structure features. CoCN can further borrow successful practices from Euclidean convolution, including residual connection and inception mechanism. We validate CoCN on both node-level and graph-level benchmarks. CoCN achieves superior performance over competitive GNN baselines. Codes are available at <a class="link-external link-https" href="https://github.com/sunjss/CoCN" rel="external noopener nofollow">this https URL</a>.

Bi-GCN: Binary Graph Convolutional Network

Binary Graph Convolutional Network With Capacity Exploration

Binarized Graph Neural Network

BitGNN: Unleashing the Performance Potential of Binary Graph Neural Networks on GPUs

BiGCN: A Bi-directional Low-Pass Filtering Graph Neural Network

Bilinear Graph Neural Network with Neighbor Interactions

PB-GCN: Progressive binary graph convolutional networks for skeleton-based action recognition

Simplifying Graph Convolutional Networks

Binarized Simplicial Convolutional Neural Networks

Graph Construction using Principal Axis Trees for Simple Graph Convolution

Scalable Graph Compressed Convolutions

Understanding GNN Computational Graph: A Coordinated Computation, IO, and Memory Perspective

Accelerating Graph Neural Networks with a Novel Matrix Compression Format

DeGNN: Characterizing and Improving Graph Neural Networks with Graph Decomposition.

BiFeat: Supercharge GNN Training via Graph Feature Quantization

L2-GCN: Layer-Wise and Learned Efficient Training of Graph Convolutional Networks

DeGNN: Improving Graph Neural Networks with Graph Decomposition

PCGCN: Partition-Centric Processing for Accelerating Graph Convolutional Network

Unified GCNs: Towards Connecting GCNs with CNNs

Accel-GCN: High-Performance GPU Accelerator Design for Graph Convolution Networks