Abstract:Graph data contains rich node features and unique edge information, which have been applied across various domains, such as citation networks or recommendation systems. Graph Neural Networks (GNNs) are specialized for handling such data and have shown impressive performance in many applications. However, GNNs may contain of sensitive information and susceptible to privacy attacks. For example, link stealing is a type of attack in which attackers infer whether two nodes are linked or not. Previous link stealing attacks primarily relied on posterior probabilities from the target GNN model, neglecting the significance of node features. Additionally, variations in node classes across different datasets lead to different dimensions of posterior probabilities. The handling of these varying data dimensions posed a challenge in using a single model to effectively conduct link stealing attacks on different datasets. To address these challenges, we introduce Large Language Models (LLMs) to perform link stealing attacks on GNNs. LLMs can effectively integrate textual features and exhibit strong generalizability, enabling attacks to handle diverse data dimensions across various datasets. We design two distinct LLM prompts to effectively combine textual features and posterior probabilities of graph nodes. Through these designed prompts, we fine-tune the LLM to adapt to the link stealing attack task. Furthermore, we fine-tune the LLM using multiple datasets and enable the LLM to learn features from different datasets simultaneously. Experimental results show that our approach significantly enhances the performance of existing link stealing attack tasks in both white-box and black-box scenarios. Our method can execute link stealing attacks across different datasets using only a single model, making link stealing attacks more applicable to real-world scenarios.

Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining

Graph Machine Learning in the Era of Large Language Models (LLMs)

A Survey of Large Language Models for Graphs

A Survey of Graph Meets Large Language Model: Progress and Future Directions

Large Language Models on Graphs: A Comprehensive Survey

A Survey of Large Language Models on Generative Graph Analytics: Query, Learning, and Applications

Graph Learning in the Era of LLMs: A Survey from the Perspective of Data, Models, and Tasks

Exploring the Potential of Large Language Models (LLMs) in Learning on Graphs

Graph Meets LLMs: Towards Large Graph Models

Integrating Graphs With Large Language Models: Methods and Prospects

Advancing Graph Representation Learning with Large Language Models: A Comprehensive Survey of Techniques

GPT4Graph: Can Large Language Models Understand Graph Structured Data ? an Empirical Evaluation and Benchmarking.

Graph2text or Graph2token: A Perspective of Large Language Models for Graph Learning

Large Language Models as Topological Structure Enhancers for Text-Attributed Graphs

Exploring the Potential of Large Language Models in Graph Generation

LLM-Enhanced User-Item Interactions: Leveraging Edge Information for Optimized Recommendations

Graph Learning and Its Advancements on Large Language Models: A Holistic Survey

Large Language Models for Link Stealing Attacks Against Graph Neural Networks

All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks