Abstract:Federated learning (FL) is a distributed machine learning technique that enables model development on user equipments (UEs) locally, without violating their data privacy requirements. Conventional FL adopts a single parameter server to aggregate local models from UEs, and can suffer from efficiency and reliability issues – especially when multiple users issue concurrent FL requests. Hierarchical FL consisting of a master aggregator and multiple worker aggregators to collectively combine trained local models from UEs is emerging as a solution to efficient and reliable FL. The placement of worker aggregators and assignment of UEs to worker aggregators plays a vital role in minimizing the cost of implementing FL requests in a Mobile Edge Computing (MEC) network. Cost minimization associated with joint worker aggregator placement and UE assignment problem in an MEC network is investigated in this work. An optimization framework for FL and an approximation algorithm with an approximation ratio for a single FL request is proposed. Online worker aggregator placements and UE assignments for dynamic FL request admissions with uncertain neural network models, where FL requests arrive one by one without the knowledge of future arrivals, is also investigated by proposing an online learning algorithm with a bounded regret. The performance of the proposed algorithms is evaluated using both simulations and experiments in a real testbed with its hardware consisting of server edge servers and devices and software built upon an open source hierarchical FedML (HierFedML) environment. Simulation results show that the performance of the proposed algorithms outperform their benchmark counterparts, by reducing the implementation cost by at least 15% per FL request. Experimental results in the testbed demonstrate the performance gain using the proposed algorithms using real datasets for image identification and text recognition applic- tions.

FedUC: A Unified Clustering Approach for Hierarchical Federated Learning

Accelerating Federated Learning with Cluster Construction and Hierarchical Aggregation.

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Resource-Efficient Federated Learning with Hierarchical Aggregation in Edge Computing.

A hierarchical federated learning model with adaptive model parameter aggregation

High-efficient Hierarchical Federated Learning on Non-Iid Data with Progressive Collaboration

FedSC: A federated learning algorithm based on client-side clustering

HierFedML: Aggregator Placement and UE Assignment for Hierarchical Federated Learning in Mobile Edge Computing

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

FedHF: A High Fairness Federated Learning Algorithm Based on Deconfliction in Heterogeneous Networks.

FedCE: Personalized Federated Learning Method based on Clustering Ensembles

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

FedSeq: A Hybrid Federated Learning Framework Based on Sequential In-Cluster Training.

HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learning

Adaptive Hierarchical Aggregation for Federated Object Detection

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

FedClust: Tackling Data Heterogeneity in Federated Learning through Weight-Driven Client Clustering

Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration

Accelerating Hierarchical Federated Learning with Adaptive Aggregation Frequency in Edge Computing

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions