Abstract:Federated Learning (FL) has become a popular decentralized learning paradigm to train a machine learning model using distributed mobile devices without compromising user privacy. Despite its advantages, there are several technical challenges to achieving efficient FL. First, clients may have different amount of data with various quality, thus leading to different quality of model updates. In an online setting, it is challenging to select clients having high-quality models in advance or to adjust the selection on the fly. Second, it is an impractical assumption that the clients can selflessly engage in model training without incentives. Meanwhile, the training cost is often considered as private information which is not easily accessible. Under incomplete information, how we design an effective incentive mechanism to achieve the expected economic properties? Third, due to the lack of prior knowledge, managing long-run expenditures in real time is challenging. To this end, we propose a combinatorial multi-armed bandit- and auction-based client selection algorithm named CACS to achieve highly efficient model training. Specifically, CACS divides the client selection process into exploration and exploitation. In the former, CACS employs the upper confidence bound (UCB) quality to estimate the learning quality of clients. In the latter, CACS determines winners based on the UCB quality-bid-ratio and adopts the key payment as the payment. Theoretical analysis shows that CACS obtains the sub-linear regret and economic properties, and can be computationally efficient and ensure the convergence of global model. Extensive simulation experiments also confirm the practical advantages of CACS over state-of-the-art client selection approaches for FL.

Personalized Federated Learning with Auction-Based Client Selection and Edge-Enhanced Model Accuracy

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

Like Attracts Like: Personalized Federated Learning in Decentralized Edge Computing

Personalized Federated Learning with Attention-based Client Selection

Auction-based Client Selection for Online Federated Learning

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

Personalized Edge Intelligence via Federated Self-Knowledge Distillation

FedDWA: Personalized Federated Learning with Dynamic Weight Adjustment

Auction-Based Cluster Federated Learning in Mobile Edge Computing Systems

A Personalized Federated Cloud-Edge Collaboration Framework Via Cross-Client Knowledge Distillation

Personalized Federated Learning: an Attentive Collaboration Approach

APCSMA: Adaptive Personalized Client-Selection and Model-Aggregation Algorithm for Federated Learning in Edge Computing Scenarios

Cost-Aware Federated Learning in Mobile Edge Networks

APFed: Attention-based Personalized Federated Learning in Model Heterogeneity Scenario.

FedCR: Personalized Federated Learning Based on Across-Client Common Representation with Conditional Mutual Information Regularization.

Personalized Federated Learning Incorporating Adaptive Model Pruning at the Edge

Feed: Towards Personalization-Effective Federated Learning

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

FedEdge: Accelerating Edge-Assisted Federated Learning

Efficient Personalized Federated Learning via Sparse Model-Adaptation

A Truthful Procurement Auction for Incentivizing Heterogeneous Clients in Federated Learning