Abstract:Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial robustness of such pre-trained graph learning models remains largely unexplored. More importantly, most existing defense techniques designed for end-to-end graph representation learning methods require pre-specified label definitions, and thus cannot be directly applied to the pre-training methods. In this paper, we propose an unsupervised defense technique to robustify pre-trained deep graph models, so that the perturbations on the input graph can be successfully identified and blocked before the model is applied to different downstream tasks. Specifically, we introduce a mutual information-based measure, graph representation vulnerability (GRV), to quantify the robustness of graph encoders on the representation space. We then formulate an optimization problem to learn the graph representation by carefully balancing the trade-off between the expressive power and the robustness (i.e., GRV) of the graph encoder. The discrete nature of graph topology and the joint space of graph data make the optimization problem intractable to solve. To handle the above difficulty and to reduce computational expense, we further relax the problem and thus provide an approximate solution. Additionally, we explore a provable connection between the robustness of the unsupervised graph encoder and that of models on downstream tasks. Extensive experiments demonstrate that even without access to labels and tasks, our model is still able to enhance robustness against adversarial attacks on three downstream tasks (node classification, link prediction, and community detection) by an average of +16.5% compared with existing methods.

Robustness Meets Accuracy in Adversarial Training for Graph Autoencoder

Unsupervised Adversarially-Robust Representation Learning on Graphs

GAAT: Group Adaptive Adversarial Training to Improve the Trade-Off Between Robustness and Accuracy

Feature Augmentation for Adversarial Robustness

DefenseVGAE: Defending against Adversarial Attacks on Graph Data via a Variational Graph Autoencoder

Adversarial Training for Graph Neural Networks via Graph Subspace Energy Optimization

Robust Graph Convolutional Networks with Directional Graph Adversarial Training.

Graph Adversarial Training: Dynamically Regularizing Based on Graph Structure.

A Robust and Generalized Framework for Adversarial Graph Embedding

A Robust graph attention network with dynamic adjusted Graph

A Dual Robust Graph Neural Network Against Graph Adversarial Attacks

Adversarially Robust Neural Architecture Search for Graph Neural Networks

Spectral Adversarial Training for Robust Graph Neural Network

On Generalization of Graph Autoencoders with Adversarial Training

Efficient Adversarial Training with Multi-Fidelity Optimization for Robust Neural Network

GReAT: A Graph Regularized Adversarial Training Method

CAP: Co-Adversarial Perturbation on Weights and Features for Improving Generalization of Graph Neural Networks

HAT-GAE: Self-Supervised Graph Auto-encoders with Hierarchical Adaptive Masking and Trainable Corruption

HC-Ref: Hierarchical Constrained Refinement for Robust Adversarial Training of GNNs

Graph Structure Reshaping Against Adversarial Attacks on Graph Neural Networks

Graph Augmentation Against Structural Poisoning Attacks Via Structure and Attribute Reconciliation