Robust federated learning with voting and scaling

Xiang-Yu Liang,Heng-Ru Zhang,Wei Tang,Fan Min
DOI: https://doi.org/10.1016/j.future.2023.11.015
IF: 7.307
2023-11-21
Future Generation Computer Systems
Abstract:Federated learning is vulnerable to poisoning attacks due to the inability to verify the authenticity of local data. Existing robust federated learning methods maintain a global model by discarding potentially risky local updates. However, they generally assume that the server knows the number of potentially abnormal clients. In this paper, we propose a robust federated learning method based on voting and scaling that relaxes such assumption. Malicious updates usually manifest in abnormal direction and magnitude. On one hand, the server computes the relative-angle between the target and other local updates. Angles greater than 90° are considered negative votes, otherwise positive votes. If the negative votes exceed a predefined threshold, the target is considered abnormal. On the other hand, the server computes the magnitude median of the remaining updates after filtering out updates in abnormal directions. The magnitudes of local updates above/below the median are scaled down/increased. Experiments are carried out on five datasets in comparison to five state-of-the-art algorithms. Results on the two metrics of poisoning and main task rates show that our method can effectively improve the robustness of federated learning. Source codes are available at https://github.com/liangxyswpu/lxyCode .
computer science, theory & methods
What problem does this paper attempt to address?