Abstract:Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this issue, Hierarchical Federated Edge Learning (HFEL) has been proposed, leveraging edge servers as intermediaries for model aggregation. Despite its effectiveness, HFEL encounters challenges such as a slow convergence rate and high resource consumption, particularly in the presence of system and data heterogeneity. However, existing works are mainly focused on improving training efficiency for traditional FL, leaving the efficiency of HFEL largely unexplored. In this paper, we consider a two-tier HFEL system, where edge devices are connected to edge servers and edge servers are interconnected through peer-to-peer (P2P) edge backhauls. Our goal is to enhance the training efficiency of the HFEL system through strategic resource allocation and topology design. Specifically, we formulate an optimization problem to minimize the total training latency by allocating the computation and communication resources, as well as adjusting the P2P connections. To ensure convergence under dynamic topologies, we analyze the convergence error bound and introduce a model consensus constraint into the optimization problem. The proposed problem is then decomposed into several subproblems, enabling us to alternatively solve it online. Our method facilitates the efficient implementation of large-scale FL at edge networks under data and system heterogeneity. Comprehensive experiment evaluation on benchmark datasets validates the effectiveness of the proposed method, demonstrating significant reductions in training latency while maintaining the model accuracy compared to various baselines.

AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

HELCFL: High-Efficiency and Low-Cost Federated Learning in Heterogeneous Mobile-Edge Computing

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

AEDFL: Efficient Asynchronous Decentralized Federated Learning with Heterogeneous Devices

Asynchronous Decentralized Federated Learning for Heterogeneous Devices

Optimizing Training Efficiency and Cost of Hierarchical Federated Learning in Heterogeneous Mobile-Edge Cloud Computing

EdgeFed: Optimized Federated Learning Based on Edge Computing

Multi-granularity Weighted Federated Learning in Heterogeneous Mobile Edge Computing Systems

FedLC: Accelerating Asynchronous Federated Learning in Edge Computing

FedHe: Heterogeneous Models and Communication-Efficient Federated Learning

Energy-Efficient and Reliable Federated Learning in Heterogeneous Mobile-Edge Computing.

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

FlocOff: Data Heterogeneity Resilient Federated Learning with Communication-Efficient Edge Offloading

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Over-the-Air Federated Learning and Optimization

Accelerating Federated Learning with Data and Model Parallelism in Edge Computing

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning

FedEdge: Accelerating Edge-Assisted Federated Learning

Efficient Federated Learning with Adaptive Channel Pruning for Edge Devices

Heterogeneity-Aware Cooperative Federated Edge Learning with Adaptive Computation and Communication Compression