Abstract:Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited training data, referred to as over-fitting. This paper proposes Topology Adaptive Edge Dropping (TADropEdge) method as an adaptive data augmentation technique to improve generalization performance and learn robust GNN models. We start by explicitly analyzing how random edge dropping increases the data diversity during training, while indicating i.i.d. edge dropping does not account for graph structural information and could result in noisy augmented data degrading performance. To overcome this issue, we consider graph connectivity as the key property that captures graph topology. TADropEdge incorporates this factor into random edge dropping such that the edge-dropped subgraphs maintain similar topology as the underlying graph, yielding more satisfactory data augmentation. In particular, TADropEdge first leverages the graph spectrum to assign proper weights to graph edges, which represent their criticality for establishing the graph connectivity. It then normalizes the edge weights and drops graph edges adaptively based on their normalized weights. Besides improving generalization performance, TADropEdge reduces variance for efficient training and can be applied as a generic method modular to different GNN models. Intensive experiments on real-life and synthetic datasets corroborate theory and verify the effectiveness of the proposed method.

Drop "Noise" Edge: An Approximation of the Bayesian GNNs.

NED-GNN: Detecting and Dropping Noisy Edges in Graph Neural Networks.

ADEdgeDrop: Adversarial Edge Dropping for Robust Graph Neural Networks

DEGNN: Dual Experts Graph Neural Network Handling Both Edge and Node Feature Noise

xAI-Drop: Don't Use What You Cannot Explain

Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

DropAGG: Robust Graph Neural Networks via Drop Aggregation.

DropEdge: Towards Deep Graph Convolutional Networks on Node Classification.

Dropedge: towards deep graph convolu-

Denoising Aggregation of Graph Neural Networks by Using Principal Component Analysis.

Training Robust Graph Neural Networks with Topology Adaptive Edge Dropping

Graph Representation Learning on Noise and Sparse Labels.

GNN Cleaner: Label Cleaner for Graph Structured Data

Are All Edges Necessary? A Unified Framework for Graph Purification

Utilizing Edge Features in Graph Neural Networks Via Variational Information Maximization

Combating Bilateral Edge Noise for Robust Link Prediction

BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks

Beyond smoothness: A general optimization framework for graph neural networks with negative Laplacian regularization

Graph Elimination Networks

How Powerful is Implicit Denoising in Graph Neural Networks

Understanding Graph Neural Networks from Graph Signal Denoising Perspectives