Abstract:Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial robustness of such pre-trained graph learning models remains largely unexplored. More importantly, most existing defense techniques designed for end-to-end graph representation learning methods require pre-specified label definitions, and thus cannot be directly applied to the pre-training methods. In this paper, we propose an unsupervised defense technique to robustify pre-trained deep graph models, so that the perturbations on the input graph can be successfully identified and blocked before the model is applied to different downstream tasks. Specifically, we introduce a mutual information-based measure, graph representation vulnerability (GRV), to quantify the robustness of graph encoders on the representation space. We then formulate an optimization problem to learn the graph representation by carefully balancing the trade-off between the expressive power and the robustness (i.e., GRV) of the graph encoder. The discrete nature of graph topology and the joint space of graph data make the optimization problem intractable to solve. To handle the above difficulty and to reduce computational expense, we further relax the problem and thus provide an approximate solution. Additionally, we explore a provable connection between the robustness of the unsupervised graph encoder and that of models on downstream tasks. Extensive experiments demonstrate that even without access to labels and tasks, our model is still able to enhance robustness against adversarial attacks on three downstream tasks (node classification, link prediction, and community detection) by an average of +16.5% compared with existing methods.

Abstract Interpretation Based Robustness Certification For Graph Convolutional Networks

Robustness of Deep Learning Models on Graphs: A Survey

Certifying Robustness of Graph Convolutional Networks for Node Perturbation with Polyhedra Abstract Interpretation

Unsupervised Adversarially-Robust Representation Learning on Graphs

Certified Robustness of Graph Neural Networks against Adversarial Structural Perturbation

Robust Graph Convolutional Networks Against Adversarial Attacks

GraphDefense: Towards Robust Graph Convolutional Networks

Turning Strengths into Weaknesses: A Certified Robustness Inspired Attack Framework against Graph Neural Networks

Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks

Understanding Structural Vulnerability in Graph Convolutional Networks

Uncovering Hidden Vulnerabilities in Convolutional Neural Networks through Graph-based Adversarial Robustness Evaluation

Exploring Robustness of GNN Against Universal Injection Attack from a Worst-case Perspective

Certifiably Robust Graph Contrastive Learning

Power Up! Robust Graph Convolutional Network Via Graph Powering.

Certifying Global Robustness for Deep Neural Networks

CC-CERT: A Probabilistic Approach to Certify General Robustness of Neural Networks

Formal Verification of Graph Convolutional Networks with Uncertain Node Features and Uncertain Graph Structure

Collective Certified Robustness against Graph Injection Attacks

Towards Certifying the Asymmetric Robustness for Neural Networks: Quantification and Applications

Not All Low-Pass Filters Are Robust in Graph Convolutional Networks

Structure-Aware Robustness Certificates for Graph Classification