Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

Game Theory Based Privacy Preserving Approach for Collaborative Deep Learning in IoT

Learner's Dilemma: IoT Devices Training Strategies in Collaborative Deep Learning

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

A Trusted and Collaborative Framework for Deep Learning in IoT

Privacy-Preserving Collaborative Learning for Multiarmed Bandits in IoT

Evolutionary privacy-preserving learning strategies for edge-based IoT data sharing schemes

Privacy-Preserving Collaborative Intrusion Detection in Edge of Internet of Things: A Robust and Efficient Deep Generative Learning Approach

Leveraging Edge Learning and Game Theory for Intrusion Detection in Internet of Things

Secure Collaborative Deep Learning Against GAN Attacks in the Internet of Things

Incorporating Social Interaction into Three-Party Game Towards Privacy Protection in IoT

A Survey on Collaborative Deep Learning and Privacy-Preserving.

Digital Ethics in Federated Learning

Intrusion Detection Based on Data Privacy in Cloud-Edge Collaborative Computing Using Federated Learning

Approximate to Be Great: Communication Efficient and Privacy-Preserving Large-Scale Distributed Deep Learning in Internet of Things

Collaborative Inference for AI-Empowered IoT Devices

Breaking Hardware Boundaries of IoT Devices via Inverse Feature Completion

Deep Learning-Based Privacy Preservation and Data Analytics for IoT Enabled Healthcare

A Review of Privacy-Preserving Federated Learning for the Internet-of-Things

Federated Deep Learning Approaches for the Privacy and Security of IoT Systems

PADL: Privacy-Aware and Asynchronous Deep Learning for IoT Applications