Abstract:Federated learning (FL) is a collaborative machine learning framework that requires different clients (e.g., Internet of Things devices) to participate in the machine learning model training process by training and uploading their local models to an FL server in each global iteration. Upon receiving the local models from all the clients, the FL server generates a global model by aggregating the received local models. This traditional FL process may suffer from the straggler problem in heterogeneous client settings, where the FL server has to wait for slow clients to upload their local models in each global iteration, thus increasing the overall training time. One of the solutions is to set up a deadline and only the clients that can upload their local models before the deadline would be selected in the FL process. This solution may lead to a slow convergence rate and global model overfitting issues due to the limited client selection. In this paper, we propose the Latency awarE Semi-synchronous client Selection and mOdel aggregation for federated learNing (LESSON) method that allows all the clients to participate in the whole FL process but with different frequencies. That is, faster clients would be scheduled to upload their models more frequently than slow clients, thus resolving the straggler problem and accelerating the convergence speed, while avoiding model overfitting. Also, LESSON is capable of adjusting the tradeoff between the model accuracy and convergence rate by varying the deadline. Extensive simulations have been conducted to compare the performance of LESSON with the other two baseline methods, i.e., FedAvg and FedCS. The simulation results demonstrate that LESSON achieves faster convergence speed than FedAvg and FedCS, and higher model accuracy than FedCS.

Federated Learning with Client Availability Budgets

An Online Learning Approach for Client Selection in Federated Edge Learning under Budget Constraint

Federated Learning under Heterogeneous and Correlated Client Availability

Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective

Online Client Selection for Asynchronous Federated Learning With Fairness Consideration

FedLE: Federated Learning Client Selection with Lifespan Extension for Edge IoT Networks

Age-of-Information-Aware Federated Learning

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs

Towards Federated Learning on Fresh Datasets

Client Selection for Federated Learning With Non-IID Data in Mobile Edge Computing

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning

FedCA: Efficient Federated Learning with Client Autonomy

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

FedAR: Addressing Client Unavailability in Federated Learning with Local Update Approximation and Rectification

Efficient Federated Learning against Heterogeneous and Non-stationary Client Unavailability

Communication-Efficient Federated Learning in Channel Constrained Internet of Things

Latency Aware Semi-synchronous Client Selection and Model Aggregation for Wireless Federated Learning

FCFL: A Fairness Compensation-Based Federated Learning Scheme with Accumulated Queues

Fairness-Aware Client Selection for Federated Learning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources