Abstract:Graph Neural Networks (GNNs) are powerful in learning semantics of graph data. Recently, a new paradigm "pre-train and prompt" has shown promising results in adapting GNNs to various tasks with less supervised data. The success of such paradigm can be attributed to the more consistent objectives of pre-training and task-oriented prompt tuning, where the pre-trained knowledge can be effectively transferred to downstream tasks. Most existing methods are based on the class prototype vector framework. However, in the few-shot scenarios, given few labeled data, class prototype vectors are difficult to be accurately constructed or learned. Meanwhile, the structure information of graph is usually exploited during pre-training for learning node representations, while neglected in the prompt tuning stage for learning more accurate prototype vectors. In addition, they generally ignore the impact of heterophilous neighborhoods on node representation and are not suitable for heterophilous graphs. To bridge these gaps, we propose a novel pre-training and structure prompt tuning framework for GNNs, namely PSP, which consistently exploits structure information in both pre-training and prompt tuning stages. In particular, PSP 1) employs a dual-view contrastive learning to align the latent semantic spaces of node attributes and graph structure, and 2) incorporates structure information in prompted graph to construct more accurate prototype vectors and elicit more pre-trained knowledge in prompt tuning. We conduct extensive experiments on node classification and graph classification tasks to evaluate the effectiveness of PSP. We show that PSP can lead to superior performance in few-shot scenarios on both homophilous and heterophilous graphs. The implemented code is available at <a class="link-external link-https" href="https://github.com/gqq1210/PSP" rel="external noopener nofollow">this https URL</a>.

Voucher Abuse Detection with Prompt-based Fine-tuning on Graph Neural Networks

DGA-GNN: Dynamic Grouping Aggregation GNN for Fraud Detection

ULTRA-DP: Unifying Graph Pre-training with Multi-task Graph Dual Prompt.

Graph Structure Prompt Learning: A Novel Methodology to Improve Performance of Graph Neural Networks

Self-Pro: A Self-Prompt and Tuning Framework for Graph Neural Networks

SGL-PT: A Strong Graph Learner with Graph Prompt Tuning

Reliable and Compact Graph Fine-tuning via GraphSparse Prompting

GraphPrompt: Unifying Pre-Training and Downstream Tasks for Graph Neural Networks

Prompt Tuning on Graph-augmented Low-resource Text Classification

A Unified Graph Selective Prompt Learning for Graph Neural Networks

MultiGPrompt for Multi-Task Pre-Training and Prompting on Graphs

Universal Prompt Tuning for Graph Neural Networks

DMBGN: Deep Multi-Behavior Graph Networks for Voucher Redemption Rate Prediction

HGPROMPT: Bridging Homogeneous and Heterogeneous Graphs for Few-shot Prompt Learning

G-Prompt: Graphon-based Prompt Tuning for graph classification

Prompt-based Node Feature Extractor for Few-shot Learning on Text-Attributed Graphs

Instance-Aware Graph Prompt Learning

PSP: Pre-Training and Structure Prompt Tuning for Graph Neural Networks

GNNavi: Navigating the Information Flow in Large Language Models by Graph Neural Network

Pick and Choose: A GNN-based Imbalanced Learning Approach for Fraud Detection

Human-Free Automated Prompting for Vision-Language Anomaly Detection: Prompt Optimization with Meta-guiding Prompt Scheme