Abstract:As a means of decentralized machine learning, federated learning (FL) has recently drawn considerable attentions. One of the prominent advantages of FL is its capability of preventing clients' data from being directly exposed to external adversaries. Nevertheless, via a viewpoint of information theory, it is still possible for an attacker to steal private information from eavesdropping upon the shared models uploaded by FL clients. In order to address this problem, we develop a novel privacy preserving FL framework based on the concept of differential privacy (DP). To be specific, we first borrow the concept of local DP and introduce a client-level DP (CDP) by adding artificial noises to the shared models before uploading them to servers. Then, we prove that our proposed CDP algorithm can satisfy the DP guarantee with adjustable privacy protection levels by varying the variances of the artificial noises. More importantly, we derive a theoretical convergence upper-bound of the CDP algorithm. Our derived upper-bound reveals that there exists an optimal number of communication rounds to achieve the best convergence performance in terms of loss function values for a given privacy protection level. Furthermore, to obtain this optimal number of communication rounds, which cannot be derived in a closed-form expression, we propose a communication rounds discounting (CRD) method. Compared with the heuristic searching method, our proposed CRD can achieve a much better trade-off between the computational complexity of searching for the optimal number and the convergence performance. Extensive experiments indicate that our CDP algorithm with an optimization on the number of communication rounds using the proposed CRD can effectively improve both the FL training efficiency and FL model quality for a given privacy protection level.

FL-MAC-RDP: Federated Learning over Multiple Access Channels with Rényi Differential Privacy

Joint Communication and Learning Design of Differential Privacy for Federated Learning over Multi-cell Networks.

RAFLS: RDP-Based Adaptive Federated Learning with Shuffle Model

Privacy Amplification for Wireless Federated Learning with Rényi Differential Privacy and Subsampling

A Novel Privacy Enhancement Scheme with Dynamic Quantization for Federated Learning

A novel local differential privacy federated learning under multi-privacy regimes

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Low-Latency Federated Learning over Wireless Channels with Differential Privacy

Universally Harmonizing Differential Privacy Mechanisms for Federated Learning: Boosting Accuracy and Convergence

The Effect of Quantization in Federated Learning: A Rényi Differential Privacy Perspective

Practical Locally Private Federated Learning with Communication Efficiency

Randomized Quantization is All You Need for Differential Privacy in Federated Learning

Differentially Private Federated Learning: Algorithm, Analysis and Optimization

Communication Reducing Quantization for Federated Learning with Local Differential Privacy Mechanism.

LDP-Fed+: A robust and privacy-preserving federated learning based classification framework enabled by local differential privacy

Differentially Private Federated Learning with Local Momentum Updates and Gradients Filtering

Balancing Privacy Protection and Interpretability in Federated Learning

A Fine-Grained Differentially Private Federated Learning Against Leakage from Gradients

HFL-DP: Hierarchical Federated Learning with Differential Privacy

Optimizing the Numbers of Queries and Replies in Convex Federated Learning with Differential Privacy

Privacy-Preserving and Reliable Decentralized Federated Learning