Convergence Analysis and Design Principle for Federated Learning in Wireless Network.

Shuo Wan,Jiaxun Lu,Pingyi Fan,Yunfeng Shao,Chenghui Peng,Khaled B. Letaief
DOI: https://doi.org/10.1109/globecom46510.2021.9685504
2021-01-01
Abstract:Recently, federated learning (FL) has been treated as an important and promising learning scheme in IoT, enabling devices to jointly learn a model without sharing their data sets. Different from centralized training on some collected data sets, FL training suffers a lot of constraints from limited resources in the network. Therein, the bandwidth and package loss restrict interactions in training. Meanwhile, the highly distributed data sets and limited computation could also affect its convergence. To figure out the specific impact, we analyze the convergence rate of FL training considering both communication and training. Further taking in training costs in terms of time and power, the closed-form optimal settings for communication networks are proposed with principles to assist the parameter selection. The results build a bridge between AI and communication, giving us an intuitive knowledge of how the background system could influence the distributed training process.
What problem does this paper attempt to address?