Abstract:The concept of hierarchical federated edge learning (H-FEEL) has been recently proposed as an enhancement of federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients, in which each helper collects the trained gradients from clients nearby, aggregates them, and sends the result to the server for global model update. Due to limited communication resources, only a portion of helpers can be scheduled to upload their aggregated gradients in each round of the model training. And that necessitates a well-designed scheme for the joint helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for the H-FEEL system which involves local gradient computing, weighted gradient uploading, and machine learning model updating phases. By characterizing these phases mathematically and analyzing one-round convergence bound of the training algorithm, we formulate an optimization problem to achieve the scheduling and resource allocation scheme. The problem simultaneously captures the uncertainty of the wireless channel and the importance of the weighted gradient. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation and helper scheduling, which are mixed integer nonlinear programming and continuous nonlinear problems, respectively. For the first subproblem, we obtain an optimal solution of exponential complexity and a suboptimal solution that has polynomial complexity. For the second subproblem, we obtain a closed-form optimal solution in a special case and a suboptimal solution in the general case. The efficacy of our scheme is amply demonstrated via simulations and the analytical framework is shown to provide valuable design insights for the practical implementation of the H-FEEL system.

A novel load balancing method for hierarchical federation simulation system

A Novel Load Control and Mobility Management Scheme for Hierarchical Mobile IPv6 Networks

Novel Models and Algorithms of Load Balancing for Variable-Structured Collaborative Simulation under HLA/RTI

AN EFFECTIVE WAY TO CONTROL CONGESTION FOR RTI WITH HYBRID ARCHITECTURE

Bridging Technology for Composing Large-scale HLA Federation

Efficient communication approach in HLA-based distributed simulation for VR application

HF^2T: Host-Based Flowlet Fine-Tuning for RDMA Load Balancing

A Hop to Hop Controlled Hierarchical Multicast Congestion Control Mechanism

Modeling and analysis of RTI attribute data exchange mechanism

Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning

RDMA Load Balancing via Data Partition

Hierarchical federated learning based on wireless D2D networks

Hierarchical Message Queue Model Supporting Dynamic Load Balancing

Novel Load Balancing DHT Scheme for the Heterogeneous System

Research on distributed data collection system for HLA-based simulation

Load Balancing in Federated Learning

An extended HLA multilayer federation integration architecture for multidisciplinary collaborative simulation

SeqBalance: Congestion-Aware Load Balancing with no Reordering for RoCE

A Fully Distributed Collection Technology for Mass Simulation Data

Hierarchical Multiresource Fair Queueing for Packet Processing

Research on Resource Allocation for Efficient Federated Learning