Abstract:In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations of each node are learned by recursively aggregating features of its neighbors. However, this mechanism brings severe over-smoothing and efficiency issues over high-degree graphs (HDGs), wherein most nodes have dozens (or even hundreds) of neighbors, such as social networks, transaction graphs, power grids, etc. Additionally, such graphs usually encompass rich and complex structure semantics, which are hard to capture merely by feature aggregations in GNNs. Motivated by the above limitations, we propose TADA, an efficient and effective front-mounted data augmentation framework for GNNs on HDGs. Under the hood, TADA includes two key modules: (i) feature expansion with structure embeddings, and (ii) topology- and attribute-aware graph sparsification. The former obtains augmented node features and enhanced model capacity by encoding the graph structure into high-quality structure embeddings with our highly-efficient sketching method. Further, by exploiting task-relevant features extracted from graph structures and attributes, the second module enables the accurate identification and reduction of numerous redundant/noisy edges from the input graph, thereby alleviating over-smoothing and facilitating faster feature aggregations over HDGs. Empirically, TADA considerably improves the predictive performance of mainstream GNN models on 8 real homophilic/heterophilic HDGs in terms of node classification, while achieving efficient training and inference processes.

Improving Graph Neural Network Training Efficiency By Using Top Non-Robust Samples In The Training Set

GNN Cleaner: Label Cleaner for Graph Structured Data

Feature-Oriented Sampling for Fast and Scalable GNN Training.

Robust Graph Neural Network based on Graph Denoising

Self-Enhanced GNN: Improving Graph Neural Networks Using Model Outputs

From Decoupling to Reconstruction: A Robust Graph Neural Network Against Topology Attacks.

Improving Your Graph Neural Networks: A High-Frequency Booster

Training Robust Graph Neural Networks with Topology Adaptive Edge Dropping

You Can't Ignore Either: Unifying Structure and Feature Denoising for Robust Graph Learning

Evaluating graph neural networks under graph sampling scenarios

Soft-GNN: Towards Robust Graph Neural Networks Via Self-Adaptive Data Utilization

Self-supervised robust Graph Neural Networks against noisy graphs and noisy labels

IncreGNN: Incremental Graph Neural Network Learning by Considering Node and Parameter Importance

Mitigating Label Noise on Graphs Via Topological Sample Selection

Mitigating Label Noise on Graph via Topological Sample Selection

TurboGNN: Improving the End-to-End Performance for Sampling-Based GNN Training on GPUs

Efficient Topology-aware Data Augmentation for High-Degree Graph Neural Networks

Towards Robust Graph Neural Networks for Noisy Graphs with Sparse Labels

Enhancing the Resilience of Graph Neural Networks to Topological Perturbations in Sparse Graphs

GARNET: Reduced-Rank Topology Learning for Robust and Scalable Graph Neural Networks

A Novel Composite Graph Neural Network