Abstract:Federated learning (FL) is a new paradigm for large-scale learning tasks across mobile devices. However, practical FL deployment over resource constrained mobile devices confronts multiple challenges. For example, it is not clear how to establish an effective wireless network architecture to support FL over mobile devices. Besides, as modern machine learning models are more and more complex, the local on-device training/intermediate model update in FL is becoming too power hungry/radio resource intensive for mobile devices to afford. To address those challenges, in this paper, we try to bridge another recent surging technology, 5G, with FL, and develop a wireless transmission and weight quantization co-design for energy efficient FL over heterogeneous 5G mobile devices. Briefly, the 5G featured high data rate helps to relieve the severe communication concern, and the multi-access edge computing (MEC) in 5G provides a perfect network architecture to support FL. Under MEC architecture, we develop flexible weight quantization schemes to facilitate the on-device local training over heterogeneous 5G mobile devices. Observed the fact that the energy consumption of local computing is comparable to that of the model updates via 5G transmissions, we formulate the energy efficient FL problem into a mixed-integer programming problem to elaborately determine the quantization strategies and allocate the wireless bandwidth for heterogeneous 5G mobile devices. The goal is to minimize the overall FL energy consumption (computing + 5G transmissions) over 5G mobile devices while guaranteeing learning performance and training latency. Generalized Benders’ Decomposition is applied to develop feasible solutions and extensive simulations are conducted to verify the effectiveness of the proposed scheme. Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from permissions@acm.org. Mobihoc ’21, June 03–05, 2021, Shanghai, China © 2020 Association for Computing Machinery. ACM ISBN 978-1-4503-XXXX-X/18/06. . . $15.00 https://doi.org/10.1145/nnnnnnn.nnnnnnn CCS CONCEPTS • Computing methodologies→ Distributed artificial intelligence; Neural networks; • Theory of computation→Mixed discrete-continuous optimization.

To Talk or to Work: Energy Efficient Federated Learning over Mobile Devices Via the Weight Quantization and 5G Transmission Co-Design

Energy Efficient Federated Learning over Heterogeneous Mobile Devices via Joint Design of Weight Quantization and Wireless Transmission

Towards Energy Efficient Federated Learning over 5G+ Mobile Devices

Toward Energy-Efficient Federated Learning Over 5G+ Mobile Devices

To Talk or to Work: Flexible Communication Compression for Energy Efficient Federated Learning over Heterogeneous Mobile Edge Devices

Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation

To Talk or to Work: Delay Efficient Federated Learning over Mobile Edge Devices

A Joint Communication and Federated Learning Framework for Internet of Things Networks

Federated Learning with Unsourced Random Access.

Adaptive Decentralized Federated Learning in Energy and Latency Constrained Wireless Networks

A Practical Cross-Device Federated Learning Framework over 5G Networks

To Talk or to Work: Dynamic Batch Sizes Assisted Time Efficient Federated Learning Over Future Mobile Edge Devices

Quantized Federated Learning under Transmission Delay and Outage Constraints

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

Heterogeneous Computation and Resource Allocation for Wireless Powered Federated Edge Learning Systems

Energy Efficient Federated Learning Over Wireless Communication Networks

Non-Orthogonal Multiple Access Assisted Federated Learning via Wireless Power Transfer: A Cost-Efficient Approach

Online Optimization for Over-the-Air Federated Learning with Energy Harvesting

Analysis and Optimization of Wireless Federated Learning with Data Heterogeneity

Multicore Federated Learning for Mobile-Edge Computing Platforms