Abstract:Federated learning is a popular distributed machine learning paradigm that enables collaborative model training at multiple entities via exchanging intermediate learning results. Security and communication efficiency are crucial for successful applications of federated learning in various privacy-sensitive services. However, existing work focused on gradient defense and communication efficiency separately, and also incurred additional computation, signaling, and accuracy overhead. A lightweight (in terms of time-complexity and signaling) technique that simultaneously achieves security and communication efficiency is critical for massive resource-constrained devices (e.g., Internet-of-Things generating the data), but has yet to be established. This paper proposes a secure and efficient federated learning framework with provable communication-accuracy-security performance guarantees. A low-complexity and signaling-free stochastic quantization module is added at the client side that quantizes the original local gradients to discrete values for communication-efficient global aggregation. The stochastic quantization module is shown to be interpreted as triangular or Gaussian-multiply-triangular noises under uniform or Gaussian distributions of local gradients, hence protecting data privacy. We prove that the proposed framework exhibits an { O (log 2 1/δ), O (δ 2 ), O (1/δ)}-tradeoff between the communication overhead, model accuracy, and data protection, where δ is an adjustable quantization interval. Experimental results validate the tradeoff and the superiority of the proposed stochastic quantization technique in terms of communication efficiency (only 14.1% of differential privacy and 0.2% of homomorphic encryption) and computation complexity (similar to differential privacy and only 0.03% of homomorphic encryption). Under the same data protection performance, the proposed approach also outperforms (in terms of accuracy) differential privacy in all the 9 comparison settings on CIFAR10 dataset.

Communication-Efficient and Secure Federated Learning Based on Adaptive One-Bit Compressed Sensing

Enabling Communication-Efficient Federated Learning via Distributed Compressed Sensing.

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

Secure Federated Learning with Model Compression.

Communication-Efficient Federated Learning Based on Chained Secure Multiparty Computing and Compressed Sensing.

Compressed Federated Learning Based on Adaptive Local Differential Privacy.

Secure and efficient federated learning via novel multi-party computation and compressed sensing

Secure Model-Contrastive Federated Learning With Improved Compressive Sensing

Secure Federated Learning over Wireless Communication Networks with Model Compression

Secure and Efficient Federated Learning Via Novel Authenticable Multi-Party Computation and Compressed Sensing

Efficient Privacy-Preserving Federated Learning with Improved Compressed Sensing

Optimized Compressed Sensing for Communication Efficient Federated Learning.

Communication-efficient federated learning based on compressed sensing and ternary quantization

Practical Locally Private Federated Learning with Communication Efficiency

FL-OTCSEnc: Towards Secure Federated Learning with Deep Compressed Sensing

Communication-Efficient Federated Learning via Quantized Compressed Sensing

Communication-Efficient and Byzantine-Robust Differentially Private Federated Learning

Secure and Efficient Federated Learning with Provable Performance Guarantees Via Stochastic Quantization

Communication-efficient Federated Learning Through 1-Bit Compressive Sensing and Analog Aggregation.

Efficient Byzantine-Robust and Privacy-Preserving Federated Learning on Compressive Domain