Abstract:In this work, a <italic>Hybrid Hierarchical Federated Edge Learning</italic> (HHFEL) architecture that consists of a device layer, an edge layer, and a cloud layer over heterogeneous networks, is investigated for large-scale model training. In such systems, learning efficiency is severely degraded by limited communication resources and device heterogeneity in terms of local data distribution and computation capability, especially for synchronous FL mechanisms where the training of each round should wait for the slowest device. To tackle this issue, asynchronous FL is proposed, which allows the devices with powerful computation and communication capabilities exchanging information with the server more frequently. However, this asynchronous FL framework faces a new challenge of low accuracy caused by the imbalanced local model updating. To overcome the shortage of both synchronous and asynchronous FLs, we propose an enhanced online semi-asynchronous FL mechanism between the edge-device layers, where each device trains its local model with the newly generated data and each edge server aggregates a number of local models based on their arrival order in each round. Particularly, devices with faster training speeds would fully utilize the idle time by training their local models repetitively. Meanwhile, synchronous FL with an edge elastic update strategy is adopted to the cloud-edge layers for personalized information exchange. Considering the continuous data generation feature, we formulate the objective problem as an online <italic>Markov Decision Process</italic> (MDP) to realize efficient communication-and-computing HHFEL via joint device selection and resource allocation. Due to the non-convex and combinatorial problem structure, we develop a hybrid <italic>Deep Q-Network</italic> (DQN) and <italic>Deep Deterministic Policy Gradient</italic> (DDPG) approach with low computational complexity to adapt the device selection and resource allocation strategies. Numerical results show the effectiveness of the proposed mechanism compared with existing benchmarks.

Virtual Experience-Based Mobile Device Selection Algorithm for Federated Learning

Client Selection for Federated Learning in Vehicular Edge Computing: A Deep Reinforcement Learning Approach

Decentralized Federated Learning under Communication Delays.

Enhanced Hybrid Hierarchical Federated Edge Learning Over Heterogeneous Networks

Energy or Accuracy? Near-Optimal User Selection and Aggregator Placement for Federated Learning in MEC

Enhancing Efficiency in Multidevice Federated Learning through Data Selection

Efficient Federated Learning for Metaverse Via Dynamic User Selection, Gradient Quantization and Resource Allocation

Federated Prompt-based Decision Transformer for Customized VR Services in Mobile Edge Computing System

Mobility-Aware Federated Learning: Multi-Armed Bandit Based Selection in Vehicular Network

Dap-FL: Federated Learning Flourishes by Adaptive Tuning and Secure Aggregation

HierFedML: Aggregator Placement and UE Assignment for Hierarchical Federated Learning in Mobile Edge Computing

Adaptive Dataset Management Scheme for Lightweight Federated Learning in Mobile Edge Computing

Zone-based Federated Learning for Mobile Sensing Data

Joint Client Selection and Resource Allocation for Federated Learning in Mobile Edge Networks

FEL: High Capacity Learning for Recommendation and Ranking via Federated Ensemble Learning

Federated Learning Over Wireless Channels: Dynamic Resource Allocation and Task Scheduling

Adaptive and Efficient Participant Selection in Vertical Federated Learning

Computation Offloading and Resource Allocation Based on DT-MEC-Assisted Federated Learning Framework

Automated Federated Learning in Mobile Edge Networks -- Fast Adaptation and Convergence

Federated Learning with Efficient Aggregation via Markov Decision Process in Edge Networks

FLAME: Federated Learning Across Multi-device Environments