Abstract:Machine learning benefits from large training datasets, which may not always be possible to collect by any single entity, especially when using privacy-sensitive data. In many contexts, such as healthcare and finance, separate parties may wish to collaborate and learn from each other's data but are prevented from doing so due to privacy regulations. Some regulations prevent explicit sharing of data between parties by joining datasets in a central location (confidentiality). Others also limit implicit sharing of data, e.g., through model predictions (privacy). There is currently no method that enables machine learning in such a setting, where both confidentiality and privacy need to be preserved, to prevent both explicit and implicit sharing of data. Federated learning only provides confidentiality, not privacy, since gradients shared still contain private information. Differentially private learning assumes unreasonably large datasets. Furthermore, both of these learning paradigms produce a central model whose architecture was previously agreed upon by all parties rather than enabling collaborative learning where each party learns and improves their own local model. We introduce Confidential and Private Collaborative (CaPC) learning, the first method provably achieving both confidentiality and privacy in a collaborative setting. We leverage secure multi-party computation (MPC), homomorphic encryption (HE), and other techniques in combination with privately aggregated teacher models. We demonstrate how CaPC allows participants to collaborate without having to explicitly join their training sets or train a central model. Each party is able to improve the accuracy and fairness of their model, even in settings where each party has a model that performs well on their own dataset or when datasets are not IID and model architectures are heterogeneous across parties.

MPCPA: Multi-Center Privacy Computing with Predictions Aggregation Based on Denoising Diffusion Probabilistic Model

Privacy Preserving PCA for Multiparty Modeling

Privacy-Preserving Collaborative Deep Learning with Unreliable Participants.

Multi-Step Denoising Scheduled Sampling: Towards Alleviating Exposure Bias for Diffusion Models

CaPC Learning: Confidential and Private Collaborative Learning

PAC Privacy Preserving Diffusion Models

Two-Phase Multi-Party Computation Enabled Privacy-Preserving Federated Learning

Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy

Privacy-preserving multi-party logistic regression in cloud computing

Privacy preserving distributed machine learning with federated learning

Personalized and privacy-preserving federated heterogeneous medical image analysis with PPPML-HMI

PRICURE: Privacy-Preserving Collaborative Inference in a Multi-Party Setting

FedMCC: Federated multi-center clustering algorithm to improve privacy healthcare

PPDP: an Efficient and Privacy-Preserving Disease Prediction Scheme in Cloud-Based E-Healthcare System

Privacy-preserving Decentralized Aggregation for Federated Learning

Differentially Private Support Vector Machines with Knowledge Aggregation

Insuring against the perils in distributed learning: privacy-preserving empirical risk minimization

Towards Efficient and Privacy-Preserving Federated Deep Learning

Privacy-preserving Decentralized Deep Learning with Multiparty Homomorphic Encryption

Privacy-preserving, Efficient, and Effective Machine Learning