Abstract:Aggregation functions are regarded as the multiplication between an aggregation matrix and node embeddings, based on which a full rank matrix can enhance representation capacity of Graph Neural Networks (GNNs). In this work, we fill this research gap based on the full rank aggregation matrix and its functional form, i.e., the injective aggregation function, and state that injectivity is necessary to guarantee the rich representation capacity to GNNs. To this end, we conduct theoretical injectivity analysis for the typical feature aggregation methods and provide inspiring solutions on turning the non-injective aggregation functions into injective versions. Based on our injective aggregation functions, we create various GNN structures by combining the aggregation functions with the other ingredient of GNNs, node feature encoding, in different ways. Following these structures, we highlight that by using our injective aggregation function entirely as a pre-processing step before applying independent node feature learning, we can simultaneously achieve satisfactory performance and computational efficiency on the large-scale graph-based traffic data for traffic state prediction tasks. Through comprehensive experiments on standard node classification benchmarks and practical traffic state data (for Chengdu and Xi’an cities), we show that the representation capacity of GNNs can be improved by using our injective aggregation functions just by changing the model in simple operations.

Denoising Aggregation of Graph Neural Networks by Using Principal Component Analysis.

DGA-GNN: Dynamic Grouping Aggregation GNN for Fraud Detection

NGAT: Attention in Breadth and Depth Exploration for Semi-Supervised Graph Representation Learning

A Unified View on Graph Neural Networks as Graph Signal Denoising

You Can't Ignore Either: Unifying Structure and Feature Denoising for Robust Graph Learning

How Powerful is Implicit Denoising in Graph Neural Networks

AGP-Net: Adaptive Graph Prior Network for Image Denoising

Meta-Aggregator: Learning to Aggregate for 1-bit Graph Neural Networks

Deep Graph Neural Networks via Flexible Subgraph Aggregation

Feature Correlation Aggregation: on the Path to Better Graph Neural Networks

Improving performance and efficiency of Graph Neural Networks by injective aggregation

Alleviating Over-Smoothing via Aggregation over Compact Manifolds

Enhance Information Propagation for Graph Neural Network by Heterogeneous Aggregations

Complete the Missing Half: Augmenting Aggregation Filtering with Diversification for Graph Convolutional Neural Networks

DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

Breaking the Expressive Bottlenecks of Graph Neural Networks

Generalizing Aggregation Functions in GNNs:High-Capacity GNNs via Nonlinear Neighborhood Aggregators

Unsupervised Graph Denoising via Feature-Driven Matrix Factorization

Understanding Graph Neural Networks from Graph Signal Denoising Perspectives

Complete the Missing Half: Augmenting Aggregation Filtering with Diversification for Graph Convolutional Networks

Breaking the Expression Bottleneck of Graph Neural Networks