Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

A privacy-preserving deep learning approach for face recognition with edge computing

Learning from Differentially Private Neural Activations with Edge Computing

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Edge-Enabled Distributed Deep Learning for 5G Privacy Protection

A Privacy-Preserving Deep Learning Scheme for Edge-enhanced Smart Homes

Privacy‐preserving task offloading in mobile edge computing: A deep reinforcement learning approach

Understanding Sensor Data Using Deep Learning Methods on Resource-Constrained Edge Devices.

Fed-PEMC: A Privacy-Enhanced Federated Deep Learning Algorithm for Consumer Electronics in Mobile Edge Computing

A privacy protection approach in edge-computing based on maximized dnn partition strategy with energy saving

Privacy-Preserving Compressive Model for Enhanced Deep-Learning-Based Service Provision System in Edge Computing.

Privacy-Preserving Computation Offloading for Parallel Deep Neural Networks Training

Privacy for Rescue: A New Testimony Why Privacy is Vulnerable In Deep Models

Not just privacy: Improving performance of private deep learning in mobile cloud

Lightweight and Unobtrusive Privacy Preservation for Remote Inference Via Edge Data Obfuscation

Inductive learning and local differential privacy for privacy-preserving offloading in mobile edge intelligent systems

Accurate Differentially Private Deep Learning on the Edge

EdgeSanitizer: Locally Differentially Private Deep Inference at the Edge for Mobile Data Analytics

PriPHiT: Privacy-Preserving Hierarchical Training of Deep Neural Networks

Keep Your Data Locally: Federated-Learning-Based Data Privacy Preservation in Edge Computing

A Privacy-Preserving Edge Computation-Based Face Verification System for User Authentication.