Abstract:Recent studies have shown that graph neural networks (GNNs) exhibit strong biases towards the node degree: they usually perform satisfactorily on high-degree nodes with rich neighbor information but struggle with low-degree nodes. Existing works tackle this problem by deriving either designated GNN architectures or training strategies specifically for low-degree nodes. Though effective, these approaches unintentionally create an artificial out-of-distribution scenario, where models mainly or even only observe low-degree nodes during the training, leading to a downgraded performance for high-degree nodes that GNNs originally perform well at. In light of this, we propose a test-time augmentation framework, namely GraphPatcher, to enhance test-time generalization of any GNNs on low-degree nodes. Specifically, GraphPatcher iteratively generates virtual nodes to patch artificially created low-degree nodes via corruptions, aiming at progressively reconstructing target GNN's predictions over a sequence of increasingly corrupted nodes. Through this scheme, GraphPatcher not only learns how to enhance low-degree nodes (when the neighborhoods are heavily corrupted) but also preserves the original superior performance of GNNs on high-degree nodes (when lightly corrupted). Additionally, GraphPatcher is model-agnostic and can also mitigate the degree bias for either self-supervised or supervised GNNs. Comprehensive experiments are conducted over seven benchmark datasets and GraphPatcher consistently enhances common GNNs' overall performance by up to 3.6% and low-degree performance by up to 6.5%, significantly outperforming state-of-the-art baselines. The source code is publicly available at <a class="link-external link-https" href="https://github.com/jumxglhf/GraphPatcher" rel="external noopener nofollow">this https URL</a>.

Scapin: Scalable Graph Structure Perturbation by Augmented Influence Maximization.

Revisiting Edge Perturbation for Graph Neural Network in Graph Data Augmentation and Attack

Scalable Expressiveness through Preprocessed Graph Perturbations

Robust Optimization as Data Augmentation for Large-scale Graphs

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Manipulating Structural Graph Clustering

SCARA: Scalable Graph Neural Networks with Feature-Oriented Optimization

Graph Structure Reshaping Against Adversarial Attacks on Graph Neural Networks

GAIM: Attacking Graph Neural Networks via Adversarial Influence Maximization

Enhancing the Resilience of Graph Neural Networks to Topological Perturbations in Sparse Graphs

ENGAGE: Explanation Guided Data Augmentation for Graph Representation Learning

Exploiting Edge Features in Graph Neural Networks

Exploiting Edge Features for Graph Neural Networks

GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

Adversarial Attack on Large Scale Graph

Turning Strengths into Weaknesses: A Certified Robustness Inspired Attack Framework against Graph Neural Networks

Graph Agent Network: Empowering Nodes with Inference Capabilities for Adversarial Resilience

GraphPatcher: Mitigating Degree Bias for Graph Neural Networks via Test-time Augmentation

Interpretable Sparsification of Brain Graphs: Better Practices and Effective Designs for Graph Neural Networks