Abstract:With the emergence of privacy leaks in federated learning, secure aggregation protocols that mainly adopt either homomorphic encryption or threshold secret sharing have been widely developed for federated learning to protect the privacy of the local training data of each client. However, these existing protocols suffer from many shortcomings, such as the dependence on a trusted third party, the vulnerability to clients being corrupted, low efficiency, the trade-off between security and fault tolerance, etc. To solve these disadvantages, we propose an efficient and multi-private key secure aggregation scheme for federated learning. Specifically, we skillfully modify the variant ElGamal encryption technique to achieve homomorphic addition operation, which has two important advantages: 1) The server and each client can freely select public and private keys without introducing a trust third party and 2) Compared to the variant ElGamal encryption, the plaintext space is relatively large, which is more suitable for the deep model. Besides, for the high dimensional deep model parameter, we introduce a super-increasing sequence to compress multi-dimensional data into 1-D, which can greatly reduce encryption and decryption times as well as communication for ciphertext transmission. Detailed security analyses show that our proposed scheme achieves the semantic security of both individual local gradients and the aggregated result while achieving optimal robustness in tolerating both client collusion and dropped clients. Extensive simulations demonstrate that the accuracy of our scheme is almost the same as the non-private approach, while the efficiency of our scheme is much better than the state-of-the-art homomorphic encryption-based secure aggregation schemes. More importantly, the efficiency advantages of our scheme will become increasingly prominent as the number of model parameters increases.

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

A High-Performance Federated Learning Aggregation Algorithm Based on Learning Rate Adjustment and Client Sampling

Federated Learning Aggregation: New Robust Algorithms with Guarantees

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

A Federated Learning Aggregation That Integrates Clustering and Momentum Correction Based on Historical High-Quality Gradients

A Novel Server-side Aggregation Strategy for Federated Learning in Non-IID Situations

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Federated Learning Model Aggregation in Heterogenous Aerial and Space Networks

Robust Aggregation for Federated Learning

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Federated Learning Aggregation based on Weight Distribution Analysis

Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

FedPA: An adaptively partial model aggregation strategy in Federated Learning

Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation

Dual-Criterion Model Aggregation in Federated Learning: Balancing Data Quantity and Quality

An Efficient and Multi-Private Key Secure Aggregation Scheme for Federated Learning

AggEnhance: Aggregation Enhancement by Class Interior Points in Federated Learning with Non-IID Data.

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Communication-Efficient Federated Learning with Acceleration of Global Momentum