Abstract:Secure aggregation, which is a core component of federated learning, aggregates locally trained models from distributed users at a central server. The "secure" nature of such aggregation consists of the fact that no information about the local users' data must be leaked to the server except the aggregated local models. In order to guarantee security, some keys may be shared among the users (this is referred to as the key sharing phase). After the key sharing phase, each user masks its trained model which is then sent to the server (this is referred to as the model aggregation phase). This paper follows the information theoretic secure aggregation problem originally formulated by Zhao and Sun, with the objective to characterize the minimum communication cost from the users in the model aggregation phase. Due to user dropouts, which are common in real systems, the server may not receive all messages from the users. A secure aggregation scheme should tolerate the dropouts of at most users, where is a system parameter. The optimal communication cost is characterized by Zhao and Sun, but with the assumption that the keys stored by the users could be any random variables with arbitrary dependency. On the motivation that uncoded groupwise keys are more convenient to be shared and could be used in large range of applications besides federated learning, in this paper we add one constraint into the above problem, namely, that the key variables are mutually independent and each key is shared by a group of users, where is another system parameter. To the best of our knowledge, all existing secure aggregation schemes (with information theoretic security or computational security) assign coded keys to the users. We show that if , a new secure aggregation scheme with uncoded groupwise keys can achieve the same optimal communication cost as the best scheme with coded keys; if , uncoded groupwise key sharing is strictly sub-optimal. Finally, we also implement our proposed secure aggregation scheme into Amazon EC2, which are then compared with the existing secure aggregation schemes with offline key sharing.

SoK: Secure Aggregation Based on Cryptographic Schemes for Federated Learning

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

An Efficient and Multi-Private Key Secure Aggregation Scheme for Federated Learning

Secure Aggregation for Clustered Federated Learning with Passive Adversaries

Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

FSSA: Efficient 3-Round Secure Aggregation for Privacy-Preserving Federated Learning

Uncovering Attacks and Defenses in Secure Aggregation for Federated Deep Learning

Secure Weighted Aggregation in Federated Learning

On the Information Theoretic Secure Aggregation With Uncoded Groupwise Keys

Secure Weighted Aggregation for Federated Learning

SEAR: Secure and Efficient Aggregation for Byzantine-Robust Federated Learning

Secure Aggregation Protocol Based on DC-Nets and Secret Sharing for Decentralized Federated Learning

Robust Aggregation for Federated Learning

Efficient Secure Aggregation for Privacy-Preserving Federated Machine Learning

AHSecAgg and TSKG: Lightweight Secure Aggregation for Federated Learning Without Compromise

SVFLC: Secure and Verifiable Federated Learning With Chain Aggregation

Practical and Efficient Secure Aggregation for Privacy-Preserving Machine Learning.

Eluding Secure Aggregation in Federated Learning via Model Inconsistency

Smart contract assisted secure aggregation scheme for model update in federated learning

Sparsified Secure Aggregation for Privacy-Preserving Federated Learning

An Efficient and Robust Aggregation Algorithm for Learning Federated CNN.