Abstract:Federated Learning (FL) has gained lots of traction recently, both in industry and academia. In FL, a machine learning model is trained using data from various end-users arranged in committees across several rounds. Since such data can often be sensitive, a primary challenge in FL is providing privacy while still retaining utility of the model. Differential Privacy (DP) has become the main measure of privacy in the FL setting. DP comes in two flavors: central and local. In the former, a centralized server is trusted to receive the users' raw gradients from a training step, and then perturb their aggregation with some noise before releasing the next version of the model. In the latter (more private) setting, noise is applied on users' local devices, and only the aggregation of users' noisy gradients is revealed even to the server. Great strides have been made in increasing the privacy-utility trade-off in the central DP setting, by utilizing the so-called matrix mechanism. However, progress has been mostly stalled in the local DP setting. In this work, we introduce the distributed matrix mechanism to achieve the best-of-both-worlds; local DP and also better privacy-utility trade-off from the matrix mechanism. We accomplish this by proposing a cryptographic protocol that securely transfers sensitive values across rounds, which makes use of packed secret sharing. This protocol accommodates the dynamic participation of users per training round required by FL, including those that may drop out from the computation. We provide experiments which show that our mechanism indeed significantly improves the privacy-utility trade-off of FL models compared to previous local DP mechanisms, with little added overhead.

Toward the Application of Differential Privacy to Data Collaboration

Projected Federated Averaging with Heterogeneous Differential Privacy.

Accuracy and Privacy Evaluations of Collaborative Data Analysis

Federated Transfer Learning with Differential Privacy

FedDCL: a federated data collaboration learning as a hybrid-type privacy-preserving framework based on federated learning and data collaboration

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off

Federated Learning with Differential Privacy

The Impact of Differential Privacy on Model Fairness in Federated Learning.

Differential Privacy Meets Federated Learning under Communication Constraints

A Theoretical Perspective on Differentially Private Federated Multi-task Learning

Using Decentralized Aggregation for Federated Learning with Differential Privacy

Differentially Private Federated Learning with Laplacian Smoothing

Asynchronous Federated Learning with Differential Privacy for Edge Intelligence

Enhancing Federated Learning with Adaptive Differential Privacy and Priority-Based Aggregation

Differentially Private Support Vector Machines with Knowledge Aggregation

DMM: Distributed Matrix Mechanism for Differentially-Private Federated Learning using Packed Secret Sharing

Scalable and Privacy-Preserving Federated Principal Component Analysis

Client-based differential privacy federated learning

Vision Through the Veil: Differential Privacy in Federated Learning for Medical Image Classification

Federated Learning and Differential Privacy: Software tools analysis, the Sherpa.ai FL framework and methodological guidelines for preserving data privacy

Differential Privacy in Privacy-Preserving Big Data and Learning: Challenge and Opportunity