Abstract:In order to protect each node's local learning parameters from model inversion attacks, secure aggregation has become the essential technique for federated learning so that the federated learning server knows only the combined result of all local parameters. In this paper, we introduced a novel cluster-based secure aggregation model that effectively deals with dropout nodes while reducing communicational and computational overheads. Specifically, we considered a federated learning environment with heterogeneous devices deployed across the country. The computing power of each node and the amount of training data can be heterogeneous. Because of this, each node had a different local processing time, and the response time to the server is also different. To clearly determine the dropout nodes in this environment, our model clusters nodes with similar response times based on each node's local processing time and location and then performs the aggregation on a pre-cluster basis. In addition, we propose a new practical additive sharing-based masking protocol to hide the actual local updates of nodes during aggregation. The new masking protocol makes it easy to remove the share of dropout nodes from the aggregation without using a (t, n) threshold scheme, and updates from dropout nodes are still secure even if they are delivered to the server after the dropout shares have been revealed. In addition, our model provides mask verification for reliable aggregation. Nodes can publicly verify the correctness and integrity of the masks received from others using a discrete logarithm problem before the aggregation. As a result, the proposed aggregation model is robust to dropout nodes and ensures the privacy of local updates if at least three honest nodes are alive in each cluster. Since the masking process is performed on a cluster basis, our model effectively reduces the overhead of generating and sharing the masking value. For an average cluster size C and a total number of nodes N, the computation and communication cost of each node is O(C), the computation cost of the server is O(N), and the communication cost is O(NC). We analyzed the security and efficiency of our protocol by simulating diverse dropout scenarios. The simulated results showed that our cluster-based secure aggregation outputs about a 91% learning accuracy regardless of dropout rate with four clusters for one hundred nodes.

Secure Aggregation for Clustered Federated Learning with Passive Adversaries

Sparsified Secure Aggregation for Privacy-Preserving Federated Learning

Lightweight Federated Learning Secure Aggregation Protocols

Securing Secure Aggregation: Mitigating Multi-Round Privacy Leakage in Federated Learning

Privacy-preserving Decentralized Aggregation for Federated Learning

An Efficient and Multi-private Key Secure Aggregation for Federated Learning

Cluster-Based Secure Aggregation for Federated Learning

Fast Secure Aggregation with High Dropout Resilience for Federated Learning

An Efficient and Multi-Private Key Secure Aggregation Scheme for Federated Learning

An efficient privacy-preserving and verifiable scheme for federated learning

Client-specific Property Inference against Secure Aggregation in Federated Learning

Secure Partial Aggregation: Making FederatedLearning More Robust for Industry 4.0 Applications

Efficient Vertical Federated Learning with Secure Aggregation

PFED-AGG: A Personalized Private Federated Learning Aggregation Algorithm.

Uncovering Attacks and Defenses in Secure Aggregation for Federated Deep Learning

Secure Byzantine-Robust Distributed Learning via Clustering

Eluding Secure Aggregation in Federated Learning via Model Inconsistency

Secure Aggregation Is Not All You Need: Mitigating Privacy Attacks with Noise Tolerance in Federated Learning

FSSA: Efficient 3-Round Secure Aggregation for Privacy-Preserving Federated Learning

Secure Weighted Aggregation in Federated Learning

Secure Aggregation is Not Private Against Membership Inference Attacks