Abstract:Deep neural networks have strong capabilities of memorizing the underlying training data, which can be a serious privacy concern. An effective solution to this problem is to train models with differential privacy, which provides rigorous privacy guarantees by injecting random noise to the gradients. This paper focuses on the scenario where sensitive data are distributed among multiple participants, who jointly train a model through federated learning (FL), using both secure multiparty computation (MPC) to ensure the confidentiality of each gradient update, and differential privacy to avoid data leakage in the resulting model. A major challenge in this setting is that common mechanisms for enforcing DP in deep learning, which inject real-valued noise, are fundamentally incompatible with MPC, which exchanges finite-field integers among the participants. Consequently, most existing DP mechanisms require rather high noise levels, leading to poor model utility. Motivated by this, we propose Skellam mixture mechanism (SMM), an approach to enforce DP on models built via FL. Compared to existing methods, SMM eliminates the assumption that the input gradients must be integer-valued, and, thus, reduces the amount of noise injected to preserve DP. Further, SMM allows tight privacy accounting due to the nice composition and sub-sampling properties of the Skellam distribution, which are key to accurate deep learning with DP. The theoretical analysis of SMM is highly non-trivial, especially considering (i) the complicated math of differentially private deep learning in general and (ii) the fact that the mixture of two Skellam distributions is rather complex, and to our knowledge, has not been studied in the DP literature. Extensive experiments on various practical settings demonstrate that SMM consistently and significantly outperforms existing solutions in terms of the utility of the resulting model.

SPM-FL: A Federated Learning Privacy-Protection Mechanism Based on Local Differential Privacy

Projected Federated Averaging with Heterogeneous Differential Privacy.

Performance-Enhanced Federated Learning with Differential Privacy for Internet of Things

PLDP-FL: Federated Learning with Personalized Local Differential Privacy

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

Efficient federated learning privacy preservation method with heterogeneous differential privacy

FedDP-SA: Boosting Differentially Private Federated Learning Via Local Dataset Splitting

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Differentially Private Federated Learning with Laplacian Smoothing

Safeguarding cross-silo federated learning with local differential privacy

An Adaptive Differential Privacy Method Based on Federated Learning

Federated Learning with Differential Privacy

Enhancing Federated Learning with Adaptive Differential Privacy and Priority-Based Aggregation

FDP-FL: Differentially Private Federated Learning with Flexible Privacy Budget Allocation

Differentially Private Federated Learning without Noise Addition: When is it Possible?

Differentially Private Federated Learning with an Adaptive Noise Mechanism

Privacy, accuracy, and model fairness trade-offs in federated learning

Federated learning with differential privacy via fast Fourier transform for tighter-efficient combining

Skellam Mixture Mechanism: a Novel Approach to Federated Learning with Differential Privacy

Lightweight Federated Learning with Differential Privacy and Straggler Resilience