Abstract:Federated learning (FL) emerges as a promising paradigm to enable a federation of clients to train a machine learning model in a privacy-preserving manner. Most existing works assumed that the central parameter server (PS) determines the participation of clients implying that clients cannot make autonomous participation decisions. The above assumption is unrealistic because the participation in FL training may incur various cost and clients also have strong desire to be rewarded for participation. To address this problem, we design a novel autonomous client participation scheme to incentivize clients. Specifically, the PS provides a certain reward shared among participating clients for each training round. Clients decide whether to participate each FL training round or not based on their own utilities (i.e., reward minus cost). The process can be modeled as a minority game (MG) with incomplete information and clients end up in the minority side win after each training round because the reward of each participating client may not cover its cost if too many clients participate and vice verse. The challenge of autonomous participation schemes lies in lowering the volatility of participating clients in each round due to the lack of coordination among clients. Through solid analysis, we prove that: 1) The volatility of participating clients in each round is very high under the standard MG scheme. 2) The volatility of participating clients can be reduced significantly under the stochastic MG scheme. 3) A coalition based MG is proposed, which can further reduce the volatility in each round. By conducting extensive experiments in real settings, we demonstrate that the stochastic MG-based scheme outperforms other state-of-the-art algorithms in terms of utility and volatility, and the coalition MG-based client participation scheme can further boost the utility by 39%-48% and reduce the volatility by 51%-100%. Moreover, our algorithms can achieve almost the same model accuracy as that obtained by centralized client participation algorithms.

Understanding Server-Assisted Federated Learning in the Presence of Incomplete Client Participation

A Unified Analysis of Federated Learning with Arbitrary Client Participation

Federated Learning with Regularized Client Participation

Accelerating Hybrid Federated Learning Convergence under Partial Participation

Incentive-Aware Autonomous Client Participation in Federated Learning

FedAR: Addressing Client Unavailability in Federated Learning with Local Update Approximation and Rectification

FedSAE: A Novel Self-Adaptive Federated Learning Framework in Heterogeneous Systems

SAFARI: Sparsity enabled Federated Learning with Limited and Unreliable Communications

Federated Learning under Heterogeneous and Correlated Client Availability

SAFA: a Semi-Asynchronous Protocol for Fast Federated Learning with Low Overhead

Stochastic Approximation Approach to Federated Machine Learning

Efficient Semi-Supervised Federated Learning for Heterogeneous Participants

Overcoming Client Data Deficiency in Federated Learning by Exploiting Unlabeled Data on the Server

FedFair^3: Unlocking Threefold Fairness in Federated Learning

FedCA: Efficient Federated Learning with Client Autonomy

CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework

Fairness-Aware Client Selection for Federated Learning

Federated learning with workload-aware client scheduling in heterogeneous systems

Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training

Exploring Server-Side Data in Federated Learning: an Empirical Study

Clients Help Clients: Alternating Collaboration for Semi-Supervised Federated Learning