Abstract:Federated learning (FL) involves training machine learning models over distributed edge nodes (i.e., workers) while facing three critical challenges, edge heterogeneity, Non-IID data and communication resource constraint. In the synchronous FL, the parameter server has to wait for the slowest workers, leading to significant waiting time due to edge heterogeneity. Though asynchronous FL can well tackle the edge heterogeneity, it requires frequent model transfers, resulting in massive communication resource consumption. Moreover, the different relative frequency of workers participating in asynchronous updating may seriously hurt training accuracy, especially on Non-IID data. In this paper, we propose a semi-asynchronous federated learning mechanism (FedSA), where the parameter server aggregates a certain number of local models by their arrival order in each round. We theoretically analyze the quantitative relationship between the convergence bound of FedSA and different factors, e.g., the number of participating workers in each round, the degree of data Non-IID and edge heterogeneity. Based on the convergence bound, we present an efficient algorithm to determine the number of participating workers to minimize the training completion time. To further improve the training accuracy on Non-IID data, FedSA deploys adaptive learning rates for workers by their relative participation frequency. We extend our proposed mechanism to the dynamic and multiple learning tasks scenarios. Experimental results on the testbed show that our proposed mechanism and algorithms address the three challenges more effectively than the state-of-the-art solutions.

Federated Model Search Via Reinforcement Learning

Exploring System-Heterogeneous Federated Learning with Dynamic Model Selection

Towards Efficient Federated Learning Framework Via Selective Aggregation of Models

Asynchronous Federated Learning over Wireless Communication Networks.

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems

A Multi-agent Reinforcement Learning Approach for Efficient Client Selection in Federated Learning

Dynamic Fair Federated Learning Based on Reinforcement Learning

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

A Fair Federated Learning Framework with Reinforcement Learning.

Reinforcement Learning As a Catalyst for Robust and Fair Federated Learning: Deciphering the Dynamics of Client Contributions

FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing

Reinforcement Learning Based Incentive Mechanism for Federated Meta Learning: A Game-Theoretic Perspective

Joint Local Relational Augmentation and Global Nash Equilibrium for Federated Learning with Non-IID Data

FedDRL: A Trustworthy Federated Learning Model Fusion Method Based on Staged Reinforcement Learning

Federated Learning Incentive Mechanism with Supervised Fuzzy Shapley Value

Smart Information Exchange for Unsupervised Federated Learning via Reinforcement Learning

SAM: an Efficient Approach with Selective Aggregation of Models in Federated Learning

Adaptive Federated Learning on Non-IID Data with Resource Constraint

A Novel Federated Reinforcement Learning Algorithm with Historical Model Update Momentum

Federated learning with workload-aware client scheduling in heterogeneous systems