Abstract:Graph Neural Networks (GNNs) have been the standard toolkit for processing non-euclidean spatial data since their powerful capability in graph representation learning. Unfortunately, their training strategy for network parameters is inefficient since it is directly inherited from classic Neural Networks (NNs), ignoring the characteristic of GNNs. To alleviate this issue, experimental analyses are performed to investigate the knowledge captured in classifier parameters during network training. We conclude that the parameter features, i.e., the column vectors of the classifier parameter matrix, are cluster representations with high discriminability. And after a theoretical analysis, we conclude that the discriminability of these features is obtained from the feature propagation from nodes to parameters. Furthermore, an experiment verifies that compared with cluster centroids, the parameter features are more potential for augmenting the feature propagation between nodes. Accordingly, a novel GNN-specific training framework is proposed by simultaneously updating node representations and classifier parameters via a unified feature propagation scheme. Moreover, two augmentation schemes are implemented for the framework, named Full Propagation Augmentation (FPA) and Simplified Full Propagation Augmentation (SFPA). Specifically, FPA augmentates the feature propagation of each node with the updated classifier parameters. SFPA only augments nodes with the classifier parameters corresponding to their clusters. Theoretically, FPA is equivalent to optimizing a novel graph learning objective, which demonstrates the universality of the proposed framework to existing GNNs. Extensive experiments demonstrate the superior performance and the universality of the proposed framework.

Feature Expansion for Graph Neural Networks

Graph Neural Networks Provably Benefit from Structural Information: A Feature Learning Perspective

Subgraph Networks with Application to Structural Feature Space Expansion.

Exploiting Node-Feature Bipartite Graph in Graph Convolutional Networks.

How Graph Neural Networks Learn: Lessons from Training Dynamics in Function Space

Bridging the Gap Between Spatial and Spectral Domains: A Unified Framework for Graph Neural Networks

Feature Correlation Aggregation: on the Path to Better Graph Neural Networks

Bridging the Gap between Spatial and Spectral Domains: A Survey on Graph Neural Networks.

Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

Improving Spectral Graph Convolution for Learning Graph-level Representation

Graph neural network with feature enhancement of isolated marginal groups

Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective

From Local to Global: Spectral-Inspired Graph Neural Networks

Decoupling the Depth and Scope of Graph Neural Networks

Survey of Graph Neural Networks and Applications

Scalable Graph Neural Networks for Heterogeneous Graphs

Explainable, Stable, and Scalable Graph Convolutional Networks for Learning Graph Representation

Wide Graph Neural Network

Propagation is All You Need: A New Framework for Representation Learning and Classifier Training on Graphs

Exploiting Edge Features for Graph Neural Networks

Graph neural networks via contrast between separation and aggregation for self and neighborhood