Abstract:Cross-silo federated learning offers a promising solution to collaboratively train robust and generalized AI models without compromising the privacy of local datasets, e.g., healthcare, financial, as well as scientific projects that lack a centralized data facility. Nonetheless, because of the disparity of computing resources among different clients (i.e., device heterogeneity), synchronous federated learning algorithms suffer from degraded efficiency when waiting for straggler clients. Similarly, asynchronous federated learning algorithms experience degradation in the convergence rate and final model accuracy on non-identically and independently distributed (non-IID) heterogeneous datasets due to stale local models and client drift. To address these limitations in cross-silo federated learning with heterogeneous clients and data, we propose FedCompass, an innovative semi-asynchronous federated learning algorithm with a computing power-aware scheduler on the server side, which adaptively assigns varying amounts of training tasks to different clients using the knowledge of the computing power of individual clients. FedCompass ensures that multiple locally trained models from clients are received almost simultaneously as a group for aggregation, effectively reducing the staleness of local models. At the same time, the overall training process remains asynchronous, eliminating prolonged waiting periods from straggler clients. Using diverse non-IID heterogeneous distributed datasets, we demonstrate that FedCompass achieves faster convergence and higher accuracy than other asynchronous algorithms while remaining more efficient than synchronous algorithms when performing federated learning on heterogeneous clients. The source code for FedCompass is available at <a class="link-external link-https" href="https://github.com/APPFL/FedCompass" rel="external noopener nofollow">this https URL</a>.

Scout: an Efficient Federated Learning Client Selection Algorithm Driven by Heterogeneous Data and Resource

An EMD-Based Adaptive Client Selection Algorithm for Federated Learning in Heterogeneous Data Scenarios

FedSAR for Heterogeneous Federated Learning：a Client Selection Algorithm Based on SARSA.

Federated Dynamic Client Selection for Fairness Guarantee in Heterogeneous Edge Computing

Fast Heterogeneous Federated Learning with Hybrid Client Selection

FedSS: Federated Learning with Smart Selection of clients

Federated Learning Client Selection Mechanism under System and Data Heterogeneity

FedSC: A federated learning algorithm based on client-side clustering

FedSCS: Client Selection for Federated Learning under System Heterogeneity and Client Fairness with a Stackelberg Game Approach.

GraphCS: Graph-based client selection for heterogeneity in federated learning

FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices using a Computing Power Aware Scheduler

Client Selection in Federated Learning: Principles, Challenges, and Opportunities

Tackling Mavericks in Federated Learning via Adaptive Client Selection Strategy

Federated learning with workload-aware client scheduling in heterogeneous systems

Energy-efficient client selection in federated learning with heterogeneous data on edge

Addressing Heterogeneity in Federated Learning with Client Selection via Submodular Optimization

Variance-Reduced Heterogeneous Federated Learning Via Stratified Client Selection

Federated Collaborative Learning with Sparse Gradients for Heterogeneous Data on Resource-Constrained Devices

Emulating Full Client Participation: A Long-Term Client Selection Strategy for Federated Learning

A Holistic Client Selection Scheme in Federated Mobile CrowdSensing Based on Reverse Auction