Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach

Xiumin Wang,Enwei Guo,Weiwei Wu
DOI: https://doi.org/10.5555/3535850.3536051
Abstract:Federated learning (FL) has recently received considerable attention due to its capability of allowing distributed clients to collaboratively train a global model without sharing their private data. However, due to the heterogeneous data distributions/contents of clients, it is non-trivial to accurately evaluate the contributions of local models in global model aggregation. Most existing works simply use the amount of data to assign weights of clients in global model aggregation, e.g., FedAvg, which however is not effective, especially when the data of clients is non-IID. To address this issue, this paper aims to propose a novel FL algorithm, which can accurately evaluate the contributions of clients and aggregate global model in a more efficient manner. More specifically, this paper proposes a Deep Reinforcement Learning (DRL) method to dynamically learn the contributions of clients in each communication round. Based on this, we adaptively assign appropriate weights to clients, which will be used in global model aggregation. By improving the process of global mode aggregation, our proposed scheme greatly improves the performance of federated learning.
Computer Science
What problem does this paper attempt to address?