Aggregation Design and Resource Allocation for Decentralized Learning over Wireless Networks.

Yu Wang,Benshun Yin,Zhiyong Chen,Bin Xia
DOI: https://doi.org/10.1109/ICCC57788.2023.10233435
2023-01-01
Abstract:Decentralized learning has emerged as a promising paradigm for collaborative learning in a server-less manner. However, the unstable connectivity among devices in wireless networks can hinder the acquisition of global information. To address this issue, this paper proposes reusing outdated models to assist devices in utilizing global information, thereby improving model performance. We introduce age of update (AoU) as a metric to measure the staleness of neighboring model, which can be employed to ensure the interaction frequency among devices. The lower the AoU, the more frequently information is exchanged among devices, which leads to better learning performance, but also results in higher latency and energy consumption of devices. To find the trade-off among AoU, energy consumption and latency, we optimize the allocation of transmission power, CPU-cycle frequency, and broadcast data rate of devices. Without a central scheduler, we design a communication-efficient decentralized proximal policy optimization (CD-PPO) algorithm to solve the optimization problem, which provides global latency information for each device with little communication overhead. Simulation results demonstrate that the proposed algorithm maintains close performance to centralized algorithm, achieving satisfactory energy and latency performance while reducing AoU.
What problem does this paper attempt to address?