Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

Privacy Protection Technology Based on Machine Learning and Intelligent Data Recognition

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Consideration of Data Security and Privacy Using Machine Learning Techniques

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

A New Noise Generating Method Based on Gaussian Sampling for Privacy Preservation

Privacy Threats and Protection in Machine Learning

AI-Driven Anonymization: Protecting Personal Data Privacy While Leveraging Machine Learning

A Review of Privacy-Preserving Machine Learning Classification

Deep Learning with Gaussian Differential Privacy

Privacy at a Price: Exploring its Dual Impact on AI Fairness

Research on the Privacy Security of Face Recognition Technology

Deep Learning with Differential Privacy

An Improved Privacy-Preserving Stochastic Gradient Descent Algorithm

When Machine Learning Meets Privacy: A Survey and Outlook

Balancing Innovation and Privacy: Data Security Strategies in Natural Language Processing Applications

Crowdlearning: Crowded Deep Learning with Data Privacy

A Novel Generation Method for Diverse Privacy Image Based on Machine Learning

Adaptive Differential Privacy Mechanism Based on Entropy Theory for Preserving Deep Neural Networks

Differentially private stochastic gradient descent with low-noise

Differential Privacy With Variant-Noise For Gaussian Processes Classification

Harnessing Inherent Noises for Privacy Preservation in Quantum Machine Learning