Abstract:While existing Graph Neural Networks (GNNs) have demonstrated exceptional performance in semi-supervised learning, they are criticized for not fully utilizing unlabeled data and graph structure, leading to over-fitting. Recently, data augmentation as a technique gaining significant attention recently for enhancing the generalization capabilities of Graph Neural Networks (GNNs), is regarded as a promising solution to mitigate the issue of over-fitting. Nonetheless, existing studies focus on designing a simple augmentation strategy tailored to a specific dataset, without ensuring a diverse and consistent distribution of augmented graphs during the training process. Moreover, formulating different graph augmentation strategies for diverse datasets relies heavily on domain knowledge due to the distinct distributions inherent in various graphs. Designing a universal augmentation strategy which can adapt to different datasets remains a challenging endeavor. To resolve the thorny issue, we introduce an adaptive augmentation framework called MSA-AUG, which can adaptively integrate multiple heuristic strategies for GNNs. Specifically, in order to enhance the representation quality of GNNs, we first take advantage of various augmentation strategies from global, local and label perspectives. Then we integrate them into a set of candidate strategies, which is model-agnostic for any GNNs. Then, we construct a search space of candidate strategies and take each candidate-strategy with different selection weights and operation magnitudes. The learned parameters are leveraged to explore different selection weights and operation magnitudes for ensuring that the contribution of various graph augmentation strategies is well-adjusted. Finally, we employ a search algorithm based on density matching to dynamically explore the candidate strategies and take the best augmentation strategy on various datasets with different distributions for improving the generalization ability of GNNs. Extensive experiments on diverse benchmark datasets demonstrate that MSA-AUG can improve the performance of GNNs with varying structures of backbones.

Robust Optimization as Data Augmentation for Large-scale Graphs

Knowledge Distillation Improves Graph Structure Augmentation for Graph Neural Networks

Learning to Augment Graph Structure for Both Homophily and Heterophily Graphs

Local Augmentation for Graph Neural Networks

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Graph Data Augmentation for Node Classification

Feature Augmentation for Adversarial Robustness

Class-homophilic-based Data Augmentation for Improving Graph Neural Networks

Graph Augmentation Against Structural Poisoning Attacks Via Structure and Attribute Reconciliation

A Two-Stage Co-Adversarial Perturbation to Mitigate Out-of-distribution Generalization of Large-Scale Graph

Graph Adversarial Training: Dynamically Regularizing Based on Graph Structure.

CAP: Co-Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networks

GABO: Graph Augmentations with Bi-level Optimization

Towards data augmentation in graph neural network: An overview and evaluation

Data Augmentation in Graph Neural Networks: The Role of Generated Synthetic Graphs

GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

NodeAug: Semi-Supervised Node Classification with Data Augmentation

Multi-strategy adaptive data augmentation for Graph Neural Networks

Structural Imbalance Aware Graph Augmentation Learning

A Simple Data Augmentation for Graph Classification: A Perspective of Equivariance and Invariance

Topological Regularization for Graph Neural Networks Augmentation