Abstract:Federated learning (FL) is a collaborative machine learning framework that requires different clients (e.g., Internet of Things devices) to participate in the machine learning model training process by training and uploading their local models to an FL server in each global iteration. Upon receiving the local models from all the clients, the FL server generates a global model by aggregating the received local models. This traditional FL process may suffer from the straggler problem in heterogeneous client settings, where the FL server has to wait for slow clients to upload their local models in each global iteration, thus increasing the overall training time. One of the solutions is to set up a deadline and only the clients that can upload their local models before the deadline would be selected in the FL process. This solution may lead to a slow convergence rate and global model overfitting issues due to the limited client selection. In this paper, we propose the Latency awarE Semi-synchronous client Selection and mOdel aggregation for federated learNing (LESSON) method that allows all the clients to participate in the whole FL process but with different frequencies. That is, faster clients would be scheduled to upload their models more frequently than slow clients, thus resolving the straggler problem and accelerating the convergence speed, while avoiding model overfitting. Also, LESSON is capable of adjusting the tradeoff between the model accuracy and convergence rate by varying the deadline. Extensive simulations have been conducted to compare the performance of LESSON with the other two baseline methods, i.e., FedAvg and FedCS. The simulation results demonstrate that LESSON achieves faster convergence speed than FedAvg and FedCS, and higher model accuracy than FedCS.

Heterogeneous Semi-Asynchronous Federated Learning in Internet of Things: A Multi-Armed Bandit Approach

Joint Client Scheduling and Wireless Resource Allocation for Heterogeneous Federated Edge Learning with Non-IID Data

Heterogeneous Training Intensity for Federated Learning: A Deep Reinforcement Learning Approach

FedSA: A Semi-Asynchronous Federated Learning Mechanism in Heterogeneous Edge Computing

Asynchronous Federated Learning on Heterogeneous Devices: A Survey

Asynchronous Federated Learning over Wireless Communication Networks.

Latency Aware Semi-synchronous Client Selection and Model Aggregation for Wireless Federated Learning

AsyFed: Accelerated Federated Learning with Asynchronous Communication Mechanism

Online Client Selection for Asynchronous Federated Learning With Fairness Consideration

AdaptFL: Adaptive Federated Learning Framework for Heterogeneous Devices

Model-Heterogeneous Federated Learning for Internet of Things: Enabling Technologies and Future Directions

FedASA: A Personalized Federated Learning with Adaptive Model Aggregation for Heterogeneous Mobile Edge Computing

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

Robust Model Aggregation for Heterogeneous Federated Learning: Analysis and Optimizations

MSSA-FL: High-Performance Multi-stage Semi-asynchronous Federated Learning with Non-IID Data.

Semi-Federated Learning for Connected Intelligence With Computing-Heterogeneous Devices

Decentralized Federated Learning with Asynchronous Parameter Sharing for Large-scale IoT Networks

Behave Differently when Clustering: A Semi-asynchronous Federated Learning Approach for IoT

Efficient Asynchronous Federated Learning Research in the Internet of Vehicles

Knowledge-Enhanced Semi-Supervised Federated Learning for Aggregating Heterogeneous Lightweight Clients in IoT

Realizing the Heterogeneity: A Self-Organized Federated Learning Framework for IoT