Abstract:Unprotected gradient exchange in federated learning (FL) systems may lead to gradient leakage-related attacks. CKKS is a promising approximate homomorphic encryption scheme to protect gradients, owing to its unique capability of performing operations directly on ciphertexts. However, configuring CKKS security parameters involves a trade-off between correctness, efficiency, and security. An evaluation gap exists regarding how these parameters impact computational performance. Additionally, the maximum vector length that CKKS can once encrypt, recommended by Homomorphic Encryption Standardization, is 16384, hampers its widespread adoption in FL when encrypting layers with numerous neurons. To protect gradients’ privacy in FL systems while maintaining practical performance, we comprehensively analyze the influence of security parameters such as polynomial modulus degree and coefficient modulus on homomorphic operations. Derived from our evaluation findings, we provide a method for selecting the optimal multiplication depth while meeting operational requirements. Then, we introduce an adaptive segmented encryption method tailored for CKKS, circumventing its encryption length constraint and enhancing its processing ability to encrypt neural network models. Finally, we present FedSHE, a privacy-preserving and efficient Federated learning scheme with adaptive Segmented CKKS Homomorphic Encryption. FedSHE is implemented on top of the federated averaging (FedAvg) algorithm and is available at https://github.com/yooopan/FedSHE . Our evaluation results affirm the correctness and effectiveness of our proposed method, demonstrating that FedSHE outperforms existing homomorphic encryption-based federated learning research efforts in terms of model accuracy, computational efficiency, communication cost, and security level.

Efficient and Straggler-Resistant Homomorphic Encryption for Heterogeneous Federated Learning

Projected Federated Averaging with Heterogeneous Differential Privacy.

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Dubhe: Towards Data Unbiasedness with Homomorphic Encryption in Federated Learning Client Selection

FedML-HE: An Efficient Homomorphic-Encryption-Based Privacy-Preserving Federated Learning System

Efficient Secure Federated Learning Aggregation Framework Based on Homomorphic Encryption

Privacy preserving federated learning for full heterogeneity

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

FedSHE: Privacy Preserving and Efficient Federated Learning with Adaptive Segmented CKKS Homomorphic Encryption

HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

Efficient Vertical Federated Learning with Secure Aggregation

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

pFedES: Model Heterogeneous Personalized Federated Learning with Feature Extractor Sharing

FedHM: Efficient Federated Learning for Heterogeneous Models via Low-rank Factorization

AegisFL: Efficient and Flexible Privacy-Preserving Byzantine-Robust Cross-silo Federated Learning

SecFed: A Secure and Efficient Federated Learning Based on Multi-Key Homomorphic Encryption

FedRich: Towards Efficient Federated Learning for Heterogeneous Clients Using Heuristic Scheduling

FLASHE: Additively Symmetric Homomorphic Encryption for Cross-Silo Federated Learning

BatchCrypt: Efficient Homomorphic Encryption for Cross-Silo Federated Learning

HERL: Tiered Federated Learning with Adaptive Homomorphic Encryption using Reinforcement Learning

Local differentially private federated learning with homomorphic encryption