Abstract:Federated learning(FL) is an emerging distributed learning paradigm with default client privacy because clients can keep sensitive data on their devices and only share local training parameter updates with the federated server. However, recent studies reveal that gradient leakages in FL may compromise the privacy of client training data. This paper presents a gradient leakage resilient approach to privacy-preserving federated learning with per training example-based client differential privacy, coined as Fed-CDP. It makes three original contributions. First, we identify three types of client gradient leakage threats in federated learning even with encrypted client-server communications. We articulate when and why the conventional server coordinated differential privacy approach, coined as Fed-SDP, is insufficient to protect the privacy of the training data. Second, we introduce Fed-CDP, the per example-based client differential privacy algorithm, and provide a formal analysis of Fed-CDP with the $(\epsilon, \delta)$ differential privacy guarantee, and a formal comparison between Fed-CDP and Fed-SDP in terms of privacy accounting. Third, we formally analyze the privacy-utility trade-off for providing differential privacy guarantee by Fed-CDP and present a dynamic decay noise-injection policy to further improve the accuracy and resiliency of Fed-CDP. We evaluate and compare Fed-CDP and Fed-CDP(decay) with Fed-SDP in terms of differential privacy guarantee and gradient leakage resilience over five benchmark datasets. The results show that the Fed-CDP approach outperforms conventional Fed-SDP in terms of resilience to client gradient leakages while offering competitive accuracy performance in federated learning.

Client-based differential privacy federated learning

A Federated Learning Scheme Meets Dynamic Differential Privacy

A Privacy-Enhanced Federated Learning Model Training Method

Local Differential Privacy-Based Federated Learning under Personalized Settings

A Novel Federated Learning with Bidirectional Adaptive Differential Privacy.

Model Level Contrastive Federated Learning with Differential Privacy

A Differential Privacy Strategy Based on Local Features of Non-Gaussian Noise in Federated Learning

The Impact of Differential Privacy on Model Fairness in Federated Learning.

Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy

A Systematic Survey for Differential Privacy Techniques in Federated Learning

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

Differentially Private Federated Learning: Algorithm, Analysis and Optimization

A Lightweight and Accuracy-Lossless Privacy-Preserving Method in Federated Learning

Federated f-Differential Privacy

An Adaptive Differential Privacy Method Based on Federated Learning

Gradient-Leakage Resilient Federated Learning

Privacy, accuracy, and model fairness trade-offs in federated learning

A Robust Game-theoretical Federated Learning Framework with Joint Differential Privacy

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

Hierarchical federated learning with global differential privacy

Federated Transfer Learning with Differential Privacy