Abstract:Graph neural networks (GNNs) have attracted considerable attention due to their diverse applications. However, the scarcity and quality limitations of graph data present challenges to their training process in practical settings. To facilitate the development of effective GNNs, companies and researchers often seek external collaboration. Yet, directly sharing data raises privacy concerns, motivating data owners to train GNNs on their private graphs and share the trained models. Unfortunately, these models may still inadvertently disclose sensitive properties of their training graphs (e.g., average default rate in a transaction network), leading to severe consequences for data owners. In this work, we study graph property inference attack to identify the risk of sensitive property information leakage from shared models. Existing approaches typically train numerous shadow models for developing such attack, which is computationally intensive and impractical. To address this issue, we propose an efficient graph property inference attack by leveraging model approximation techniques. Our method only requires training a small set of models on graphs, while generating a sufficient number of approximated shadow models for attacks. To enhance diversity while reducing errors in the approximated models, we apply edit distance to quantify the diversity within a group of approximated models and introduce a theoretically guaranteed criterion to evaluate each model's error. Subsequently, we propose a novel selection mechanism to ensure that the retained approximated models achieve high diversity and low error. Extensive experiments across six real-world scenarios demonstrate our method's substantial improvement, with average increases of 2.7% in attack accuracy and 4.1% in ROC-AUC, while being 6.5$\times$ faster compared to the best baseline.

Toward Secure Graph Data Collaboration in a Data-Sharing-Free Manner: A Novel Privacy-Preserving Graph Pre-training Model

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Privacy-Preserving Collaborative Model Learning: the Case of Word Vector Training

Private Knowledge Transfer via Model Distillation with Generative Adversarial Networks

P$$^2$$CG: a Privacy Preserving Collaborative Graph Neural Network Training Framework

Training Encrypted Models with Privacy-preserved Data on Blockchain

Privacy-Preserving Graph Machine Learning from Data to Computation: A Survey

Privacy-preserving Graph Analytics: Secure Generation and Federated Learning

Can Graph Neural Networks Expose Training Data Properties? An Efficient Risk Assessment Approach

Data Privacy Protection Model Based on Graph Convolutional Neural Network

Social Network De-Anonymization and Privacy Inference with Knowledge Graph Model

Devil in Disguise: Breaching Graph Neural Networks Privacy through Infiltration

Differentially Private Pre-Trained Model Fusion using Decentralized Federated Graph Matching

Adversarial Privacy-Preserving Graph Embedding Against Inference Attack

A Blockchain-Based Fairness Guarantee Approach for Privacy-Preserving Collaborative Training in Computing Force Network

Privacy-Preserving Representation Learning on Graphs

Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment

Privacy-Enhanced Graph Neural Network for Decentralized Local Graphs

Releasing Graph Neural Networks with Differential Privacy Guarantees

De-anonymizing Social Networks and Inferring Private Attributes Using Knowledge Graphs

Privacy-Preserving Representation Learning on Graphs: A Mutual Information Perspective