Abstract:Federated Learning (FL) provides a privacy-preserving framework for training machine learning models on mobile edge devices. Traditional FL algorithms, e.g., FedAvg, impose a heavy communication workload on these devices. To mitigate this issue, Hierarchical Federated Edge Learning (HFEL) has been proposed, leveraging edge servers as intermediaries for model aggregation. Despite its effectiveness, HFEL encounters challenges such as a slow convergence rate and high resource consumption, particularly in the presence of system and data heterogeneity. However, existing works are mainly focused on improving training efficiency for traditional FL, leaving the efficiency of HFEL largely unexplored. In this paper, we consider a two-tier HFEL system, where edge devices are connected to edge servers and edge servers are interconnected through peer-to-peer (P2P) edge backhauls. Our goal is to enhance the training efficiency of the HFEL system through strategic resource allocation and topology design. Specifically, we formulate an optimization problem to minimize the total training latency by allocating the computation and communication resources, as well as adjusting the P2P connections. To ensure convergence under dynamic topologies, we analyze the convergence error bound and introduce a model consensus constraint into the optimization problem. The proposed problem is then decomposed into several subproblems, enabling us to alternatively solve it online. Our method facilitates the efficient implementation of large-scale FL at edge networks under data and system heterogeneity. Comprehensive experiment evaluation on benchmark datasets validates the effectiveness of the proposed method, demonstrating significant reductions in training latency while maintaining the model accuracy compared to various baselines.

Optimizing Communication Topology for Collaborative Learning Across Datacenters

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

Enhancing Decentralized and Personalized Federated Learning with Topology Construction

Joint Topology and Computation Resource Optimization for Federated Edge Learning.

Accelerating Federated Edge Learning Via Topology Optimization

AdaCoOpt: Leverage the Interplay of Batch Size and Aggregation Frequency for Federated Learning.

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning

Accelerating Distributed Training with Collaborative In-Network Aggregation

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Maximizing Aggregation Throughput for Distributed Training with Constrained In-Network Computing.

A hierarchical federated learning model with adaptive model parameter aggregation

Over-the-Air Federated Learning and Optimization

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Hierarchical Federated Learning through LAN-WAN Orchestration

FedGTA: Topology-aware Averaging for Federated Graph Learning

Communication-Efficient Zeroth-Order Adaptive Optimization for Federated Learning

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

Efficient and Less Centralized Federated Learning

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.