Abstract:Originated from distributed learning, federated learning enables privacy-preserved collaboration on a new abstracted level by sharing the model parameters only. While the current research mainly focuses on optimizing learning algorithms and minimizing communication overhead left by distributed learning, there is still a considerable gap when it comes to the real implementation on mobile devices. In this article, we start with an empirical experiment to demonstrate computation heterogeneity is a more pronounced bottleneck than communication on the current generation of battery-powered mobile devices, and the existing methods are haunted by mobile stragglers. Further, non-identically distributed data across the mobile users makes the selection of participants critical to the accuracy and convergence. To tackle the computational and statistical heterogeneity, we utilize data as a tuning knob and propose two efficient polynomial-time algorithms to schedule different workloads on various mobile devices, when data is identically or non-identically distributed. For identically distributed data, we combine partitioning and linear bottleneck assignment to achieve near-optimal training time without accuracy loss. For non-identically distributed data, we convert it into an average cost minimization problem and propose a greedy algorithm to find a reasonable balance between computation time and accuracy. We also establish an offline profiler to quantify the runtime behavior of different devices, which serves as the input to the scheduling algorithms. We conduct extensive experiments on a mobile testbed with two datasets and up to 20 devices. Compared with the common benchmarks, the proposed algorithms achieve 2-100× speedup epoch-wise, 2–7 percent accuracy gain and boost the convergence rate by more than 100 percent on CIFAR10.

Selective Federated Learning for Mobile Edge Intelligence

Optimize Scheduling of Federated Learning on Battery-powered Mobile Devices

Towards Efficient Scheduling of Federated Mobile Devices under Computational and Statistical Heterogeneity

Towards Energy-efficient Resource Allocation for Federated Learning in Mobile Edge Computing

Toward Resource-Efficient Federated Learning in Mobile Edge Computing

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Towards Efficient Federated Learning Framework Via Selective Aggregation of Models

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Federated Edge Learning with Blurred or Pseudo Data Sharing

Adaptive Federated Learning in Resource Constrained Edge Computing Systems

Joint Participant and Learning Topology Selection for Federated Learning in Edge Clouds

Online-Learning-Based Fast-Convergent and Energy-Efficient Device Selection in Federated Edge Learning

Semi-Decentralized Federated Edge Learning with Data and Device Heterogeneity

Federated Learning in Mobile Edge Computing: An Edge-Learning Perspective for Beyond 5G

Edge-Based Communication Optimization for Distributed Federated Learning