Abstract:With powerful parallel computing GPUs and massive user data, neural-network-based deep learning can well exert its strong power in problem modeling and solving, and has archived great success in many applications such as image classification, speech recognition and machine translation etc. While deep learning has been increasingly popular, the problem of privacy leakage becomes more and more urgent. Given the fact that the training data may contain highly sensitive information, e.g., personal medical records, directly sharing them among the users (i.e., participants) or centrally storing them in one single location may pose a considerable threat to user privacy. In this paper, we present a practical privacy-preserving collaborative deep learning system that allows users to cooperatively build a collective deep learning model with data of all participants, without direct data sharing and central data storage. In our system, each participant trains a local model with their own data and only shares model parameters with the others. To further avoid potential privacy leakage from sharing model parameters, we use functional mechanism to perturb the objective function of the neural network in the training process to achieve $\epsilon $ -differential privacy. In particular, for the first time, we consider the existence of unreliable participants , i.e., the participants with low-quality data, and propose a solution to reduce the impact of these participants while protecting their privacy. We evaluate the performance of our system on two well-known real-world datasets for regression and classification tasks. The results demonstrate that the proposed system is robust against unreliable participants, and achieves high accuracy close to the model trained in a traditional centralized manner while ensuring rigorous privacy protection.

SMCD: Privacy-preserving Deep Learning Based Malicious Code Detection

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

A Distributed Privacy-Preserving Framework for Deep Learning with Edge-Cloud Computing.

SecureML: A System for Scalable Privacy-Preserving Machine Learning

A Hybrid Deep Learning Model for Malicious Behavior Detection

DeepMal: maliciousness-Preserving adversarial instruction learning against static malware detection

PPCL: Privacy-preserving collaborative learning for mitigating indirect information leakage

A deep learning approach for detecting malicious JavaScript code

The Communication-Friendly Privacy-Preserving Machine Learning against Malicious Adversaries

Collaborative Machine Learning: Schemes, Robustness, and Privacy

A Robust Adversary Detection-Deactivation Method for Metaverse-oriented Collaborative Deep Learning

MSDP: multi-scheme privacy-preserving deep learning via differential privacy

Detection of Malicious Code Variants Based on Deep Learning

PDLM: Privacy-Preserving Deep Learning Model on Cloud with Multiple Keys

SecCL: Securing Collaborative Learning Systems Via Trusted Bulletin Boards.

Enabling Privacy-Preserving Cyber Threat Detection with Federated Learning

Privacy-preserving Decentralized Deep Learning with Multiparty Homomorphic Encryption

DeepDIST: A Black-Box Anti-Collusion Framework for Secure Distribution of Deep Models

Robust and Privacy-Preserving Collaborative Learning: A Comprehensive Survey

New Era of Deeplearning-Based Malware Intrusion Detection: The Malware Detection and Prediction Based On Deep Learning

Safe: Synergic Data Filtering for Federated Learning in Cloud-Edge Computing.