Abstract:Federated learning (FL) is a distributed machine learning technique that enables model development on user equipments (UEs) locally, without violating their data privacy requirements. Conventional FL adopts a single parameter server to aggregate local models from UEs, and can suffer from efficiency and reliability issues – especially when multiple users issue concurrent FL requests. Hierarchical FL consisting of a master aggregator and multiple worker aggregators to collectively combine trained local models from UEs is emerging as a solution to efficient and reliable FL. The placement of worker aggregators and assignment of UEs to worker aggregators plays a vital role in minimizing the cost of implementing FL requests in a Mobile Edge Computing (MEC) network. Cost minimization associated with joint worker aggregator placement and UE assignment problem in an MEC network is investigated in this work. An optimization framework for FL and an approximation algorithm with an approximation ratio for a single FL request is proposed. Online worker aggregator placements and UE assignments for dynamic FL request admissions with uncertain neural network models, where FL requests arrive one by one without the knowledge of future arrivals, is also investigated by proposing an online learning algorithm with a bounded regret. The performance of the proposed algorithms is evaluated using both simulations and experiments in a real testbed with its hardware consisting of server edge servers and devices and software built upon an open source hierarchical FedML (HierFedML) environment. Simulation results show that the performance of the proposed algorithms outperform their benchmark counterparts, by reducing the implementation cost by at least 15% per FL request. Experimental results in the testbed demonstrate the performance gain using the proposed algorithms using real datasets for image identification and text recognition applic- tions.

Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing.

Accelerating Federated Learning with Cluster Construction and Hierarchical Aggregation.

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Accelerating Hierarchical Federated Learning with Adaptive Aggregation Frequency in Edge Computing

Federated Learning Meets Edge Computing: A Hierarchical Aggregation Mechanism for Mobile Devices

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Optimizing Aggregation Frequency for Hierarchical Model Training in Heterogeneous Edge Computing

Adaptive Hierarchical Federated Learning Over Wireless Networks

SHARE: Shaping Data Distribution at Edge for Communication-Efficient Hierarchical Federated Learning

Importance-aware Data Selection and Resource Allocation for Hierarchical Federated Edge Learning

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning

Accelerating Hierarchical Federated Learning with Model Splitting in Edge Computing

Optimizing Training Efficiency and Cost of Hierarchical Federated Learning in Heterogeneous Mobile-Edge Cloud Computing

Towards addressing aggregation deviation for model training in resource-scarce edge environment

FedEdge: Accelerating Edge-Assisted Federated Learning

HierFedML: Aggregator Placement and UE Assignment for Hierarchical Federated Learning in Mobile Edge Computing

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

FedUC: A Unified Clustering Approach for Hierarchical Federated Learning

High-efficient Hierarchical Federated Learning on Non-Iid Data with Progressive Collaboration