Abstract:With the emergence of privacy leaks in federated learning, secure aggregation protocols that mainly adopt either homomorphic encryption or threshold secret sharing have been widely developed for federated learning to protect the privacy of the local training data of each client. However, these existing protocols suffer from many shortcomings, such as the dependence on a trusted third party, the vulnerability to clients being corrupted, low efficiency, the trade-off between security and fault tolerance, etc. To solve these disadvantages, we propose an efficient and multi-private key secure aggregation scheme for federated learning. Specifically, we skillfully modify the variant ElGamal encryption technique to achieve homomorphic addition operation, which has two important advantages: 1) The server and each client can freely select public and private keys without introducing a trust third party and 2) Compared to the variant ElGamal encryption, the plaintext space is relatively large, which is more suitable for the deep model. Besides, for the high dimensional deep model parameter, we introduce a super-increasing sequence to compress multi-dimensional data into 1-D, which can greatly reduce encryption and decryption times as well as communication for ciphertext transmission. Detailed security analyses show that our proposed scheme achieves the semantic security of both individual local gradients and the aggregated result while achieving optimal robustness in tolerating both client collusion and dropped clients. Extensive simulations demonstrate that the accuracy of our scheme is almost the same as the non-private approach, while the efficiency of our scheme is much better than the state-of-the-art homomorphic encryption-based secure aggregation schemes. More importantly, the efficiency advantages of our scheme will become increasingly prominent as the number of model parameters increases.

A Federated Learning Aggregation That Integrates Clustering and Momentum Correction Based on Historical High-Quality Gradients

A High-Performance Federated Learning Aggregation Algorithm Based on Learning Rate Adjustment and Client Sampling

Lazy Aggregation for Heterogeneous Federated Learning

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.

FedAG:A Federated Learning Method Based on Data Importance Weighted Aggregation

Federated Learning Aggregation: New Robust Algorithms with Guarantees

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Fedcm: Federated learning with client-level momentum

Momentum Benefits Non-iid Federated Learning Simply and Provably

A Novel Server-side Aggregation Strategy for Federated Learning in Non-IID Situations

Privacy-preserving Decentralized Aggregation for Federated Learning

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

Dual-Criterion Model Aggregation in Federated Learning: Balancing Data Quantity and Quality

An Efficient and Multi-Private Key Secure Aggregation Scheme for Federated Learning

Clustered Federated Learning Based on Momentum Gradient Descent for Heterogeneous Data

Enabling Quartile-based Estimated-Mean Gradient Aggregation As Baseline for Federated Image Classifications

Robust Model Aggregation for Federated Learning with Heterogeneous Clients

AAIA: an efficient aggregation scheme against inverting attack for federated learning

Robust Federated Learning: Maximum Correntropy Aggregation Against Byzantine Attacks

Communication-Efficient Federated Learning with Acceleration of Global Momentum