Linear Coded Federated Learning under Multiple Stragglers over Heterogeneous Clients

Yingyao Yang,Jin Wang,Fei Gu
DOI: https://doi.org/10.1109/cscwd54268.2022.9776309
2022-01-01
Abstract:Recently, federated learning (FL) becomes a emerging research area, and the combination of edge computing and FL is one of the important research contents. However, there are many kinds of edge devices in heterogeneous federated learning, such as personal computers, embedded devices, and the resource-limited devices will reduce the efficiency of FL. In this paper, we propose an efficient linear coded federated learning under multiple stragglers (LCFLMS) to (1) accelerate the training speed and improve the efficiency of heterogeneous FL under multiple stragglers and (2) provide the certain level of privacy protection. We design a client-based multiple stragglers task outsourcing (C-MSTO) algorithm and a server-based multiple stragglers task outsourcing (S-MSTO) algorithm to meet the model calculation acceleration in general environment under multiple stragglers. In the process of outsourcing, the raw data are protected by using linear coding computing (LCC) scheme. Finally, the experimental results demonstrate that LCFLMS reduces the training time by 90.22% when the performance difference between clients in FL system is large.
What problem does this paper attempt to address?