Abstract:The emerging federated learning is a distributed machine learning paradigm which enables training a global model on a massive number of edge devices while protecting the privacy of local data. In the typical federated learning paradigm, the global model is updated with a synchronized protocol, which requires the server to wait for all clients to return their model parameters before updating the global model in each round. However, the straggler effect due to heterogeneous devices may cause a serious degradation in the training efficiency of synchronous federated learning. Asynchronous federated learning can effectively alleviate the inefficiency of training caused by heterogeneous devices, but the asynchronous update protocol makes the global model more vulnerable to heterogeneous data. The global model of asynchronous federated learning may be difficult to converge or even not under non-IID settings. In this paper, we propose an asynchronous federated learning framework with dynamic client scheduling (AFL-DCS) to mitigate the negative impact of data heterogeneity and dynamic clients. By dynamically clustering clients, AFL-DCS can effectively handle the dynamic check-in clients and their non-IID data. We evaluate AFL-DCS on three datasets (MNIST, FashionMNIST and CIFAR-10) under several different types of non-IID settings and compare AFL-DCS with typical asynchronous federated learning frameworks. Experimental results show that AFL-DCS can reduce the number of communication rounds by up to 39.0%, 52.4% and 89.6% on average, and reduce the accuracy variance by up to 88.9%, 80.0% and 76.8% on average, respectively, which confirms that our framework can significantly enhance the learning efficiency, model performance and stability of asynchronous federated learning under various non-IID settings.

K Asynchronous Federated Learning with Cosine Similarity Based Aggregation on Non-IID Data.

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

Towards Efficient and Stable K-Asynchronous Federated Learning with Unbounded Stale Gradients on Non-IID Data

Integrating Staleness and Shapley Value Consistency for Efficient K-Asynchronous Federated Learning

Asynchronous Federated Learning over Wireless Communication Networks.

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

CSMAAFL: Client Scheduling and Model Aggregation in Asynchronous Federated Learning

STAFL: Staleness-Tolerant Asynchronous Federated Learning on Non-iid Dataset

AFL-DCS: An asynchronous federated learning framework with dynamic client scheduling

Robust Asynchronous Federated Learning with Time-weighted and Stale Model Aggregation

Mitigating System Bias in Resource Constrained Asynchronous Federated Learning Systems

A Novel Server-side Aggregation Strategy for Federated Learning in Non-IID Situations

Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

Staleness-Controlled Asynchronous Federated Learning: Accuracy and Efficiency Tradeoff

CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework

SF-CABD: Secure Byzantine fault tolerance federated learning on Non-IID data

Communication-Efficient Federated Deep Learning with Asynchronous Model Update and Temporally Weighted Aggregation

CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Take History as a Mirror in Heterogeneous Federated Learning

Asyn2F: An Asynchronous Federated Learning Framework with Bidirectional Model Aggregation