Abstract:Federated learning (FL) has emerged as a new paradigm that enables distributed mobile devices to learn a global model collaboratively. Since mobile devices (a.k.a, clients) exhibit diversity in model training quality, client selection (CS) becomes critical for efficient FL. CS faces the following challenges: First, the client's availability, the training data volumes, and the network connection status are time-varying and cannot be easily predicted. Second, clients for training and the number of local iterations would seriously affect the model accuracy. Thus, selecting a subset of available clients and controlling local iterations should guarantee model quality. Third, renting clients for model training needs cost. It is necessary to dynamically administrate the use of the long-term budget without knowledge of future inputs. To this end, we propose a federated edge learning (FedL) framework, which can select appropriate clients and control the number of training iterations in real-time. FedL aims to reduce the completion time while reaching the desired model convergence and satisfying the long-term budget for renting clients. FedL consists of two algorithms: i) the online learning algorithm makes CS and iteration decisions according to historic learning results; ii) the online rounding algorithm translates fractional decisions derived by the online learning algorithm into integers to satisfy feasibility constraints. Rigorous mathematical proof reveals that dynamic regret and dynamic fit have sub-linear upper-bounds with time for a given budget. Extensive experiments based on realistic datasets suggest that FedL outperforms multiple state-of-the-art algorithms. In particular, FedL reduces at least 38% completion time compared with others.

Learning for Learning: Predictive Online Control of Federated Learning with Edge Provisioning

Optimize Scheduling of Federated Learning on Battery-powered Mobile Devices

Budget-Aware Online Control of Edge Federated Learning on Streaming Data with Stochastic Inputs

Edge-cloud Collaborative Learning with Federated and Centralized Features

Dynamic Distributed Edge Resource Provisioning Via Online Learning Across Timescales.

An Online Learning Approach for Client Selection in Federated Edge Learning under Budget Constraint

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

Resource-Efficient and Convergence-Preserving Online Participant Selection in Federated Learning

Provisioning Edge Inference As a Service Via Online Learning.

Online Client Scheduling and Resource Allocation for Efficient Federated Edge Learning

Joint Optimization of Resource Allocation and Data Selection for Fast and Cost-Efficient Federated Edge Learning

Online training data acquisition for federated learning in cloud-edge networks

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

Energy-efficient Federated Learning Via Stabilization-aware On-device Update Scaling.

Joint Participant and Learning Topology Selection for Federated Learning in Edge Clouds

Online Control of Cloud and Edge Resources Using Inaccurate Predictions

Online-Learning-Based Fast-Convergent and Energy-Efficient Device Selection in Federated Edge Learning

Edge-Based Communication Optimization for Distributed Federated Learning

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Accelerating Federated Edge Learning via Optimized Probabilistic Device Scheduling