Abstract:The concept of hierarchical federated edge learning (H-FEEL) has been recently proposed as an enhancement of federated learning model. Such a system generally consists of three entities, i.e., the server, helpers, and clients, in which each helper collects the trained gradients from clients nearby, aggregates them, and sends the result to the server for global model update. Due to limited communication resources, only a portion of helpers can be scheduled to upload their aggregated gradients in each round of the model training. And that necessitates a well-designed scheme for the joint helper scheduling and communication resources allocation. In this paper, we develop a training algorithm for the H-FEEL system which involves local gradient computing, weighted gradient uploading, and machine learning model updating phases. By characterizing these phases mathematically and analyzing one-round convergence bound of the training algorithm, we formulate an optimization problem to achieve the scheduling and resource allocation scheme. The problem simultaneously captures the uncertainty of the wireless channel and the importance of the weighted gradient. To solve the problem, we first transform it into an equivalent problem and then decompose the transformed problem into two subproblems: bit and sub-channel allocation and helper scheduling, which are mixed integer nonlinear programming and continuous nonlinear problems, respectively. For the first subproblem, we obtain an optimal solution of exponential complexity and a suboptimal solution that has polynomial complexity. For the second subproblem, we obtain a closed-form optimal solution in a special case and a suboptimal solution in the general case. The efficacy of our scheme is amply demonstrated via simulations and the analytical framework is shown to provide valuable design insights for the practical implementation of the H-FEEL system.

Joint Compression and Deadline Optimization for Communication-Efficient Federated Edge Learning.

Joint Compression and Deadline Optimization for Wireless Federated Learning

Joint Optimization of Bandwidth Allocation and Gradient Quantization for Federated Edge Learning

Accelerating Federated Edge Learning via Optimized Probabilistic Device Scheduling

Joint Optimization of Resource Allocation and Data Selection for Fast and Cost-Efficient Federated Edge Learning

Joint User Selection and Resource Allocation for Fast Federated Edge Learning

Communication-efficient Federated Edge Learning via Optimal Probabilistic Device Scheduling

Training Time Minimization for Federated Edge Learning with Optimized Gradient Quantization and Bandwidth Allocation

Gradient and Channel Aware Dynamic Scheduling for Over-the-Air Computation in Federated Edge Learning Systems

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Importance-Aware Data Selection and Resource Allocation in Federated Edge Learning System.

Secure Federated Learning with Model Compression.

Training Time Minimization in Quantized Federated Edge Learning under Bandwidth Constraint

Communication and Computation Efficient Federated Learning for Internet of Vehicles with a Constrained Latency

Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication Compression

Efficient asynchronous federated learning with sparsification and quantization

Edge-Based Communication Optimization for Distributed Federated Learning

Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems

Over-the-Air Federated Learning and Optimization

Joint Scheduling and Resource Allocation for Hierarchical Federated Edge Learning

One Bit Aggregation for Federated Edge Learning with Reconfigurable Intelligent Surface: Analysis and Optimization