Abstract:Federated learning (FL) is a new paradigm for large-scale learning tasks across mobile devices. However, practical FL deployment over resource constrained mobile devices confronts multiple challenges. For example, it is not clear how to establish an effective wireless network architecture to support FL over mobile devices. Besides, as modern machine learning models are more and more complex, the local on-device training/intermediate model update in FL is becoming too power hungry/radio resource intensive for mobile devices to afford. To address those challenges, in this paper, we try to bridge another recent surging technology, 5G, with FL, and develop a wireless transmission and weight quantization co-design for energy efficient FL over heterogeneous 5G mobile devices. Briefly, the 5G featured high data rate helps to relieve the severe communication concern, and the multi-access edge computing (MEC) in 5G provides a perfect network architecture to support FL. Under MEC architecture, we develop flexible weight quantization schemes to facilitate the on-device local training over heterogeneous 5G mobile devices. Observed the fact that the energy consumption of local computing is comparable to that of the model updates via 5G transmissions, we formulate the energy efficient FL problem into a mixed-integer programming problem to elaborately determine the quantization strategies and allocate the wireless bandwidth for heterogeneous 5G mobile devices. The goal is to minimize the overall FL energy consumption (computing + 5G transmissions) over 5G mobile devices while guaranteeing learning performance and training latency. Generalized Benders’ Decomposition is applied to develop feasible solutions and extensive simulations are conducted to verify the effectiveness of the proposed scheme. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. Mobihoc ’21, June 03–05, 2021, Shanghai, China © 2020 Association for Computing Machinery. ACM ISBN 978-1-4503-XXXX-X/18/06. . . $15.00 https://doi.org/10.1145/nnnnnnn.nnnnnnn CCS CONCEPTS • Computing methodologies→ Distributed artificial intelligence; Neural networks; • Theory of computation→Mixed discrete-continuous optimization.

<i>WorkerFirst</i>: Worker-Centric Model Selection for Federated Learning in Mobile Edge Computing

Energy or Accuracy? Near-Optimal User Selection and Aggregator Placement for Federated Learning in MEC

HierFedML: Aggregator Placement and UE Assignment for Hierarchical Federated Learning in Mobile Edge Computing

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

HELCFL: High-Efficiency and Low-Cost Federated Learning in Heterogeneous Mobile-Edge Computing

Decentralized Federated Learning with Intermediate Results in Mobile Edge Computing

Federated Learning with Unsourced Random Access.

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks

Client Selection for Federated Learning with Heterogeneous Resources in Mobile Edge

BEFL: Balancing Energy Consumption in Federated Learning for Mobile Edge IoT

Multicore Federated Learning for Mobile-Edge Computing Platforms

Computation Offloading and Resource Allocation Based on DT-MEC-Assisted Federated Learning Framework

A survey of energy-efficient strategies for federated learning inmobile edge computing

Towards Energy-efficient Resource Allocation for Federated Learning in Mobile Edge Computing

DRL-Based Joint Resource Allocation and Device Orchestration for Hierarchical Federated Learning in NOMA-Enabled Industrial IoT

Client Selection for Federated Learning in Vehicular Edge Computing: A Deep Reinforcement Learning Approach

Resource Allocation in Mobility-Aware Federated Learning Networks: A Deep Reinforcement Learning Approach

To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices

To Talk or to Work: Energy Efficient Federated Learning over Mobile Devices Via the Weight Quantization and 5G Transmission Co-Design