Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

LinkGuard: Link Locally Privacy-Preserving Graph Neural Networks with Integrated Denoising and Private Learning

GELU-Net: A Globally Encrypted, Locally Unencrypted Deep Neural Network for Privacy-Preserved Learning.

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Industrial Scale Privacy Preserving Deep Neural Network

Privacy-Preserving Decentralized Inference with Graph Neural Networks in Wireless Networks

Privacy-Enhanced Graph Neural Network for Decentralized Local Graphs

Differentially Private Graph Neural Networks for Link Prediction

Devil in Disguise: Breaching Graph Neural Networks Privacy through Infiltration

Local Differential Privacy in Graph Neural Networks: a Reconstruction Approach

Locally Differentially Private Graph Learning on Decentralized Social Graph

Individual Fairness for Local Private Graph Neural Network

Releasing Graph Neural Networks with Differential Privacy Guarantees

A Privacy Preserving Graph Neural Networks Framework by Protecting User’s Attributes

Secure Network Release with Link Privacy

Efficient Privacy Preserving Graph Neural Network for Node Classification

Unveiling the Role of Message Passing in Dual-Privacy Preservation on GNNs

A Graph Neural Network Based Decentralized Learning Scheme

Achieving Adaptive Privacy-Preserving Graph Neural Networks Training in Cloud Environment

Calibrating Privacy Budgets for Locally Private Graph Neural Networks

LPGNet: Link Private Graph Networks for Node Classification

Secure Deep Graph Generation with Link Differential Privacy