Abstract:Secure aggregation, which is a core component of federated learning, aggregates locally trained models from distributed users at a central server. The "secure" nature of such aggregation consists of the fact that no information about the local users' data must be leaked to the server except the aggregated local models. In order to guarantee security, some keys may be shared among the users (this is referred to as the key sharing phase). After the key sharing phase, each user masks its trained model which is then sent to the server (this is referred to as the model aggregation phase). This paper follows the information theoretic secure aggregation problem originally formulated by Zhao and Sun, with the objective to characterize the minimum communication cost from the users in the model aggregation phase. Due to user dropouts, which are common in real systems, the server may not receive all messages from the users. A secure aggregation scheme should tolerate the dropouts of at most users, where is a system parameter. The optimal communication cost is characterized by Zhao and Sun, but with the assumption that the keys stored by the users could be any random variables with arbitrary dependency. On the motivation that uncoded groupwise keys are more convenient to be shared and could be used in large range of applications besides federated learning, in this paper we add one constraint into the above problem, namely, that the key variables are mutually independent and each key is shared by a group of users, where is another system parameter. To the best of our knowledge, all existing secure aggregation schemes (with information theoretic security or computational security) assign coded keys to the users. We show that if , a new secure aggregation scheme with uncoded groupwise keys can achieve the same optimal communication cost as the best scheme with coded keys; if , uncoded groupwise key sharing is strictly sub-optimal. Finally, we also implement our proposed secure aggregation scheme into Amazon EC2, which are then compared with the existing secure aggregation schemes with offline key sharing.

KVSAgg: Secure Aggregation of Distributed Key-Value Sets.

Secret Sharing based Secure Regressions with Applications

On the Information Theoretic Secure Aggregation With Uncoded Groupwise Keys

AHSecAgg and TSKG: Lightweight Secure Aggregation for Federated Learning Without Compromise

A Generic Service to Provide In-Network Aggregation for Key-Value Streams

Samplable Anonymous Aggregation for Private Federated Data Analysis

Optimal Communication and Key Rate Region for Hierarchical Secure Aggregation with User Collusion

An Efficient and Robust Data Aggregation Scheme Without a Trusted Authority for Smart Grid

ScionFL: Efficient and Robust Secure Quantized Aggregation

Data Aggregation without Secure Channel: How to Evaluate a Multivariate Polynomial Securely

Practical and Efficient Secure Aggregation for Privacy-Preserving Machine Learning.

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

An Efficient and Multi-Private Key Secure Aggregation Scheme for Federated Learning

SVFLC: Secure and Verifiable Federated Learning With Chain Aggregation

Privacy-preserving Data Aggregation Without Secure Channel: Multivariate Polynomial Evaluation

Secure Single-Server Aggregation with (Poly)Logarithmic Overhead

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

VPAS: Publicly Verifiable and Privacy-Preserving Aggregate Statistics on Distributed Datasets

Secure Aggregation with an Oblivious Server

SoK: Secure Aggregation Based on Cryptographic Schemes for Federated Learning