Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning

Bingqing Jiang,Jun Du,Chunxiao Jiang,Yuanming Shi,Zhu Han
DOI: https://doi.org/10.1109/GLOBECOM48099.2022.10000727
2022-01-01
Abstract:Artificial intelligence (AI) is expected as a revolutionary technology to be widely used in Internet-of-Things (IoT) networks for computationally intensive tasks. However, the traditional centralized training framework imposes large latency, network burdens and high risk of privacy disclosure. As a promising distributed solution, federated learning involves the collaborative model training among edge devices, with the orchestration of a server to carry the capacities of low-latency and privacy preservation for AI-driven networks. To further improve the communication efficiency, over-the-air computation (AirComp) is capable of computing while transmitting data by exploiting the superposition property of wireless channels to harness the interference. However, gradient aggregation suffers from channel distortion induced by channel fading and noise, which may degrade the training performance. Moreover, it is beneficial to schedule the informative edge devices in federated learning under limited energy resources. In this work, we propose a dynamic device scheduling scheme for AirComp enabled federated learning systems. In this scheme, a proper number of qualified edge devices with channel inversion based power control are scheduled to participate the model training, where local updates diversity, channel condition and energy consumption are exploited jointly. Inspired by the Lyapunov drift-plus-penalty method, we formulate the optimization problem to attain the device selection strategy. Simulation results validate that the proposed scheme can achieve a close-to-optimal test accuracy with fast convergence rate, and present good performance of robustness under different channel conditions.
What problem does this paper attempt to address?