Abstract:Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this issue, Hierarchical Federated Edge Learning (HFEL) has been proposed, leveraging edge servers as intermediaries for model aggregation. Despite its effectiveness, HFEL encounters challenges such as a slow convergence rate and high resource consumption, particularly in the presence of system and data heterogeneity. However, existing works are mainly focused on improving training efficiency for traditional FL, leaving the efficiency of HFEL largely unexplored. In this paper, we consider a two-tier HFEL system, where edge devices are connected to edge servers and edge servers are interconnected through peer-to-peer (P2P) edge backhauls. Our goal is to enhance the training efficiency of the HFEL system through strategic resource allocation and topology design. Specifically, we formulate an optimization problem to minimize the total training latency by allocating the computation and communication resources, as well as adjusting the P2P connections. To ensure convergence under dynamic topologies, we analyze the convergence error bound and introduce a model consensus constraint into the optimization problem. The proposed problem is then decomposed into several subproblems, enabling us to alternatively solve it online. Our method facilitates the efficient implementation of large-scale FL at edge networks under data and system heterogeneity. Comprehensive experiment evaluation on benchmark datasets validates the effectiveness of the proposed method, demonstrating significant reductions in training latency while maintaining the model accuracy compared to various baselines.

Joint Participant and Learning Topology Selection for Federated Learning in Edge Clouds

Edge-cloud Collaborative Learning with Federated and Centralized Features

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Joint Edge Aggregation and Association for Cost-Efficient Multi-Cell Federated Learning.

An Online Learning Approach for Client Selection in Federated Edge Learning under Budget Constraint

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

Two-Layer Optimization with Utility Game and Resource Control for Federated Learning in Edge Networks

A Comprehensive Survey on Joint Resource Allocation Strategies in Federated Edge Learning

Joint Topology and Computation Resource Optimization for Federated Edge Learning.

Importance-aware Data Selection and Resource Allocation for Hierarchical Federated Edge Learning

Accelerating Federated Learning with Model Segmentation for Edge Networks

Selective Federated Learning for Mobile Edge Intelligence

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Joint Client Selection and CPU Frequency Control in Wireless Federated Learning Networks with Power Constraints

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Joint Optimization of Resource Allocation and Data Selection for Fast and Cost-Efficient Federated Edge Learning

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Towards Efficient Federated Learning Framework Via Selective Aggregation of Models

Adaptive Training and Aggregation for Federated Learning in Multi-tier Computing Networks