Abstract:Federated learning is a popular distributed machine learning paradigm that enables collaborative model training at multiple entities via exchanging intermediate learning results. Security and communication efficiency are crucial for successful applications of federated learning in various privacy-sensitive services. However, existing work focused on gradient defense and communication efficiency separately, and also incurred additional computation, signaling, and accuracy overhead. A lightweight (in terms of time-complexity and signaling) technique that simultaneously achieves security and communication efficiency is critical for massive resource-constrained devices (e.g., Internet-of-Things generating the data), but has yet to be established. This paper proposes a secure and efficient federated learning framework with provable communication-accuracy-security performance guarantees. A low-complexity and signaling-free stochastic quantization module is added at the client side that quantizes the original local gradients to discrete values for communication-efficient global aggregation. The stochastic quantization module is shown to be interpreted as triangular or Gaussian-multiply-triangular noises under uniform or Gaussian distributions of local gradients, hence protecting data privacy. We prove that the proposed framework exhibits an { O (log 2 1/δ), O (δ 2 ), O (1/δ)}-tradeoff between the communication overhead, model accuracy, and data protection, where δ is an adjustable quantization interval. Experimental results validate the tradeoff and the superiority of the proposed stochastic quantization technique in terms of communication efficiency (only 14.1% of differential privacy and 0.2% of homomorphic encryption) and computation complexity (similar to differential privacy and only 0.03% of homomorphic encryption). Under the same data protection performance, the proposed approach also outperforms (in terms of accuracy) differential privacy in all the 9 comparison settings on CIFAR10 dataset.

A Novel Privacy Enhancement Scheme with Dynamic Quantization for Federated Learning

Communication Reducing Quantization for Federated Learning with Local Differential Privacy Mechanism.

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Performance Analysis and Optimization in Privacy-Preserving Federated Learning

Joint Privacy Enhancement and Quantization in Federated Learning

Practical Locally Private Federated Learning with Communication Efficiency

Secure and Efficient Federated Learning with Provable Performance Guarantees Via Stochastic Quantization

The Effect of Quantization in Federated Learning: A Rényi Differential Privacy Perspective

LF3PFL: A Practical Privacy-Preserving Federated Learning Algorithm Based on Local Federalization Scheme

Privacy-Preserving and Reliable Decentralized Federated Learning

A Privacy-Enhanced Federated Learning Scheme with Identity Protection

Privacy-Preserving Federated Learning Framework Based on Chained Secure Multiparty Computing

Optimal Privacy Preserving for Federated Learning in Mobile Edge Computing

Differentially Private Federated Learning: Algorithm, Analysis and Optimization

Social-Aware Clustered Federated Learning With Customized Privacy Preservation

QMGeo: Differentially Private Federated Learning via Stochastic Quantization with Mixed Truncated Geometric Distribution

A New Implementation of Federated Learning for Privacy and Security Enhancement

FL-MAC-RDP: Federated Learning over Multiple Access Channels with Rényi Differential Privacy

FLCP: federated learning framework with communication-efficient and privacy-preserving

Distributed additive encryption and quantization for privacy preserving federated deep learning