Abstract:Unsupervised/self-supervised pre-training methods for graph representation learning have recently attracted increasing research interests, and they are shown to be able to generalize to various downstream applications. Yet, the adversarial robustness of such pre-trained graph learning models remains largely unexplored. More importantly, most existing defense techniques designed for end-to-end graph representation learning methods require pre-specified label definitions, and thus cannot be directly applied to the pre-training methods. In this paper, we propose an unsupervised defense technique to robustify pre-trained deep graph models, so that the perturbations on the input graph can be successfully identified and blocked before the model is applied to different downstream tasks. Specifically, we introduce a mutual information-based measure, graph representation vulnerability (GRV), to quantify the robustness of graph encoders on the representation space. We then formulate an optimization problem to learn the graph representation by carefully balancing the trade-off between the expressive power and the robustness (i.e., GRV) of the graph encoder. The discrete nature of graph topology and the joint space of graph data make the optimization problem intractable to solve. To handle the above difficulty and to reduce computational expense, we further relax the problem and thus provide an approximate solution. Additionally, we explore a provable connection between the robustness of the unsupervised graph encoder and that of models on downstream tasks. Extensive experiments demonstrate that even without access to labels and tasks, our model is still able to enhance robustness against adversarial attacks on three downstream tasks (node classification, link prediction, and community detection) by an average of +16.5% compared with existing methods.

Robust Graph Meta-learning for Weakly-supervised Few-shot Node Classification

Unsupervised Adversarially-Robust Representation Learning on Graphs

Node Classification on Graphs with Few-Shot Novel Labels Via Meta Transformed Network Embedding

Meta-GPS++: Enhancing Graph Meta-Learning with Contrastive Learning and Self-Training

Graph Contrastive Learning Meets Graph Meta Learning: A Unified Method for Few-shot Node Tasks

InfoMax Classification-Enhanced Learnable Network for Few-Shot Node Classification

Adaptive-Step Graph Meta-Learner for Few-Shot Graph Classification

Node Importance Specific Meta Learning in Graph Neural Networks

Towards Robust Graph Neural Networks against Label Noise

Structure-Enhanced Meta-Learning for Few-Shot Graph Classification

Few-shot Network Anomaly Detection via Cross-network Meta-learning

Graph Prototypical Networks for Few-shot Learning on Attributed Networks

Inductive Linear Probing for Few-shot Node Classification

MuL-GRN: Multi-Level Graph Relation Network for Few-Shot Node Classification

Meta-Graph: Few Shot Link Prediction via Meta Learning

Task-Equivariant Graph Few-shot Learning

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models

Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphs

Graph Few-shot Learning via Knowledge Transfer

Multi-level self-adaptive prototypical networks for few-shot node classification on attributed networks

CPT: Competence-progressive Training Strategy for Few-shot Node Classification