ScionFL: Efficient and Robust Secure Quantized Aggregation

Yaniv Ben-Itzhak,Helen Möllering,Benny Pinkas,Thomas Schneider,Ajith Suresh,Oleksandr Tkachenko,Shay Vargaftik,Christian Weinert,Hossein Yalame,Avishay Yanai
DOI: https://doi.org/10.1109/SaTML59370.2024.00031
2024-05-17
Abstract:Secure aggregation is commonly used in federated learning (FL) to alleviate privacy concerns related to the central aggregator seeing all parameter updates in the clear. Unfortunately, most existing secure aggregation schemes ignore two critical orthogonal research directions that aim to (i) significantly reduce client-server communication and (ii) mitigate the impact of malicious clients. However, both of these additional properties are essential to facilitate cross-device FL with thousands or even millions of (mobile) participants.
Cryptography and Security,Information Theory,Machine Learning
What problem does this paper attempt to address?
The problems that this paper attempts to solve mainly focus on two aspects: 1. **Reducing the communication overhead between the client and the server**: In Federated Learning (FL), in order to protect data privacy, secure aggregation techniques are usually used, but these techniques often overlook the optimization of communication efficiency. As the number of participating devices increases, especially when conducting cross - device Federated Learning on mobile devices, the communication cost has become an important bottleneck. Therefore, the paper proposes a secure aggregation framework that can efficiently process quantized inputs, aiming to significantly reduce the amount of communication between the client and the server. 2. **Enhancing the robustness against malicious clients**: Besides communication efficiency, existing secure aggregation schemes have not effectively dealt with the influence of malicious clients. Malicious clients may undermine the performance of the global model by tampering with their local model updates. The method proposed in the paper can not only operate efficiently on quantized inputs but also provide robustness against malicious clients, ensuring high model accuracy even in the presence of malicious participants. In conclusion, the main objective of the paper "ScionFL: Efficient and Robust Secure Quantized Aggregation" is to design a secure aggregation framework that can significantly reduce communication overhead and effectively resist malicious attacks, in order to support the application of large - scale cross - device Federated Learning.