Abstract:Graph Neural Networks (GNNs), which outperform traditional deep learning algorithms in domains such as protein interaction prediction and molecular structure elucidation, have demonstrated superior performance in processing graph data. Despite the successful application of Differential Privacy Stochastic Gradient Descent (DP-SGD) in deep learning, its adaptation to GNNs presents challenges due to the complexities inherent in GNN architectures and their distinctive message-passing mechanism. To solve the problem, this study delves into the challenges encountered when implementing DP-SGD in GNNs (DPGNNs), focusing on factors associated with the GNN model including the choice of learning rates, GNN frameworks, batch size, and gradient clipping thresholds, alongside parameters related to the Differential Privacy (DP) algorithm such as sensitivity, dataset size, privacy budget. The study reveals the impact of these factors on the performance of DPGNNs and provides recommendations for parameter values. Furthermore, we propose two adaptive optimization strategies to address the unique effects of learning rate and privacy budget on DPGNNs: adaptive learning rates and adaptive noise scales. These adaptive strategies automate parameter tuning, eliminating complex manual adjustments, significantly reducing training time and energy consumption, while achieving an optimal balance between privacy protection and model performance enhancement. Extensive experiments on graph classification tasks across multiple real-world datasets have validated the effectiveness of these strategies, significantly improving the classification accuracy and robustness of DPGNNs while ensuring data privacy.

Differentially Private Graph Neural Networks for Graph Classification and Its Adaptive Optimization

Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment

Efficient Privacy Preserving Graph Neural Network for Node Classification

Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks

Differentially Private Graph Neural Networks for Link Prediction

A Graph Neural Network Based Decentralized Learning Scheme

GraphPub: Generation of Differential Privacy Graph with High Availability

LPGNet: Link Private Graph Networks for Node Classification

GCON: Differentially Private Graph Convolutional Network via Objective Perturbation

Local Differential Privacy in Graph Neural Networks: a Reconstruction Approach

Differentially Private Convolutional Neural Networks with Adaptive Gradient Descent.

Privacy-Preserving Graph Convolutional Networks for Text Classification

A PATE-based Approach for Training Graph Neural Networks under Label Differential Privacy

Privacy-Enhanced Graph Neural Network for Decentralized Local Graphs

P$$^2$$CG: a Privacy Preserving Collaborative Graph Neural Network Training Framework

Releasing Graph Neural Networks with Differential Privacy Guarantees

Graph Neural Networks for Privacy-Preserving Recommendation with Secure Hardware

A Privacy-Preserving Subgraph-Level Federated Graph Neural Network via Differential Privacy

Local Differential Private Spatio- Temporal Dynamic Graph Learning for Wireless Social Networks

A Privacy Preserving Graph Neural Networks Framework by Protecting User’s Attributes

Fair and Privacy-Preserving Graph Neural Network.