Abstract:Federated learning (FL) has emerged as a new paradigm that enables distributed mobile devices to learn a global model collaboratively. Since mobile devices (a.k.a, clients) exhibit diversity in model training quality, client selection (CS) becomes critical for efficient FL. CS faces the following challenges: First, the client's availability, the training data volumes, and the network connection status are time-varying and cannot be easily predicted. Second, clients for training and the number of local iterations would seriously affect the model accuracy. Thus, selecting a subset of available clients and controlling local iterations should guarantee model quality. Third, renting clients for model training needs cost. It is necessary to dynamically administrate the use of the long-term budget without knowledge of future inputs. To this end, we propose a federated edge learning (FedL) framework, which can select appropriate clients and control the number of training iterations in real-time. FedL aims to reduce the completion time while reaching the desired model convergence and satisfying the long-term budget for renting clients. FedL consists of two algorithms: i) the online learning algorithm makes CS and iteration decisions according to historic learning results; ii) the online rounding algorithm translates fractional decisions derived by the online learning algorithm into integers to satisfy feasibility constraints. Rigorous mathematical proof reveals that dynamic regret and dynamic fit have sub-linear upper-bounds with time for a given budget. Extensive experiments based on realistic datasets suggest that FedL outperforms multiple state-of-the-art algorithms. In particular, FedL reduces at least 38% completion time compared with others.

Client Selection for Federated Learning Using Combinatorial Multi-Armed Bandit under Long-Term Energy Constraint

Efficient Client Selection Based on Contextual Combinatorial Multi-Arm Bandits

Auction-based Client Selection for Online Federated Learning

Client Selection and Bandwidth Allocation for Federated Learning: An Online Optimization Perspective

FedAEB: Deep Reinforcement Learning Based Joint Client Selection and Resource Allocation Strategy for Heterogeneous Federated Learning

An Online Learning Approach for Client Selection in Federated Edge Learning under Budget Constraint

Client Selection in Federated Learning: A Dynamic Matching-Based Incentive Mechanism

Efficiency-Boosting Federated Learning in Wireless Networks: A Long-Term Perspective

FedECS: Client Selection for Optimizing Computing Energy in Federated Learning

Towards Stagewise and Energy-Accuracy-balanced Client Selection and Resource Allocation over Dynamic Federated Learning Networks

Online Client Selection for Asynchronous Federated Learning With Fairness Consideration

Client Selection and Bandwidth Allocation in Wireless Federated Learning Networks: A Long-Term Perspective

MAB-based Client Selection for Federated Learning with Uncertain Resources in Mobile Networks

FedSCS: Client Selection for Federated Learning under System Heterogeneity and Client Fairness with a Stackelberg Game Approach.

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning

An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee

The Analysis and Optimization of Volatile Clients in Over-the-Air Federated Learning

Fuzzy Logic Assisted Client Selection and Energy-Efficient Joint Optimization for Hierarchical Federated Learning

Federated Learning Client Selection Mechanism under System and Data Heterogeneity

Two-Stage Client Selection for Federated Learning Against Free-riding Attack: A Multi-Armed Bandits and Auction-Based Approach

Online Client Scheduling for Fast Federated Learning