Abstract:As a means of decentralized machine learning, federated learning (FL) has recently drawn considerable attentions. One of the prominent advantages of FL is its capability of preventing clients' data from being directly exposed to external adversaries. Nevertheless, via a viewpoint of information theory, it is still possible for an attacker to steal private information from eavesdropping upon the shared models uploaded by FL clients. In order to address this problem, we develop a novel privacy preserving FL framework based on the concept of differential privacy (DP). To be specific, we first borrow the concept of local DP and introduce a client-level DP (CDP) by adding artificial noises to the shared models before uploading them to servers. Then, we prove that our proposed CDP algorithm can satisfy the DP guarantee with adjustable privacy protection levels by varying the variances of the artificial noises. More importantly, we derive a theoretical convergence upper-bound of the CDP algorithm. Our derived upper-bound reveals that there exists an optimal number of communication rounds to achieve the best convergence performance in terms of loss function values for a given privacy protection level. Furthermore, to obtain this optimal number of communication rounds, which cannot be derived in a closed-form expression, we propose a communication rounds discounting (CRD) method. Compared with the heuristic searching method, our proposed CRD can achieve a much better trade-off between the computational complexity of searching for the optimal number and the convergence performance. Extensive experiments indicate that our CDP algorithm with an optimization on the number of communication rounds using the proposed CRD can effectively improve both the FL training efficiency and FL model quality for a given privacy protection level.

An Improvement Paillier Algorithm Applied to Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

EPFed: Achieving Optimal Balance between Privacy and Efficiency in Federated Learning

BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

VPiP: Values Packing in Paillier for Communication Efficient Oblivious Linear Computations

QuanCrypt-FL: Quantized Homomorphic Encryption with Pruning for Secure Federated Learning

FPGA-Based Hardware Accelerator of Homomorphic Encryption for Efficient Federated Learning

Computation-efficient Deep Model Training for Ciphertext-based Cross-silo Federated Learning

A Stealthy Communication Model for Protecting Aggregated Results Integrity in Federated Learning

A New Implementation of Federated Learning for Privacy and Security Enhancement

FLCP: federated learning framework with communication-efficient and privacy-preserving

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Efficient Vertical Federated Learning with Secure Aggregation

A Security-Enhanced Federated Learning Scheme Based on Homomorphic Encryption and Secret Sharing

Optimized Paillier's Cryptosystem with Fast Encryption and Decryption.

Efficient and Straggler-Resistant Homomorphic Encryption for Heterogeneous Federated Learning

Privacy Preserving on Updated Parameters in Federated Learning

PVD-FL: A Privacy-Preserving and Verifiable Decentralized Federated Learning Framework

Federated learning with differential privacy via fast Fourier transform for tighter-efficient combining

Fedlabx: a Practical and Privacy-Preserving Framework for Federated Learning