Abstract:The concept of hierarchical federated edge learning (H-FEEL) has been recently proposed as an enhancement of federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients, in which each helper collects the trained gradients from clients nearby, aggregates them, and sends the result to the server for global model update. Due to limited communication resources, only a portion of helpers can be scheduled to upload their aggregated gradients in each round of the model training. And that necessitates a well-designed scheme for the joint helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for the H-FEEL system which involves local gradient computing, weighted gradient uploading, and machine learning model updating phases. By characterizing these phases mathematically and analyzing one-round convergence bound of the training algorithm, we formulate an optimization problem to achieve the scheduling and resource allocation scheme. The problem simultaneously captures the uncertainty of the wireless channel and the importance of the weighted gradient. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation and helper scheduling, which are mixed integer nonlinear programming and continuous nonlinear problems, respectively. For the first subproblem, we obtain an optimal solution of exponential complexity and a suboptimal solution that has polynomial complexity. For the second subproblem, we obtain a closed-form optimal solution in a special case and a suboptimal solution in the general case. The efficacy of our scheme is amply demonstrated via simulations and the analytical framework is shown to provide valuable design insights for the practical implementation of the H-FEEL system.

Joint Optimization of Bandwidth Allocation and Gradient Quantization for Federated Edge Learning

Training Time Minimization for Federated Edge Learning with Optimized Gradient Quantization and Bandwidth Allocation

Training Time Minimization in Quantized Federated Edge Learning under Bandwidth Constraint

Joint User Selection and Resource Allocation for Fast Federated Edge Learning

Joint Compression and Deadline Optimization for Communication-Efficient Federated Edge Learning.

Joint Compression and Deadline Optimization for Wireless Federated Learning

Joint Optimization of Resource Allocation and Data Selection for Fast and Cost-Efficient Federated Edge Learning

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Resource Allocation for Wireless Federated Edge Learning based on Data Importance

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

One Bit Aggregation for Federated Edge Learning with Reconfigurable Intelligent Surface: Analysis and Optimization

One-Bit Over-the-Air Aggregation for Communication-Efficient Federated Edge Learning: Design and Convergence Analysis

Federated Edge Learning Via Reconfigurable Intelligent Surface with One-Bit Quantization

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning.

FedAQ: Communication-Efficient Federated Edge Learning via Joint Uplink and Downlink Adaptive Quantization

Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning

Accelerating Federated Edge Learning via Optimized Probabilistic Device Scheduling

Relay-Assisted Federated Edge Learning: Performance Analysis and System Optimization

Distributed Deep Reinforcement Learning Based Gradient Quantization for Federated Learning Enabled Vehicle Edge Computing

Energy-Efficient Radio Resource Allocation for Federated Edge Learning

Quantization Bits Allocation for Wireless Federated Learning