Abstract:As a promising edge intelligence technology, federated learning (FL) enables Internet of Things (IoT) devices to train the models collaboratively while ensuring the data privacy and security. Recently, hierarchical FL (HFL) has been designed to promote distributed training in the intricate hierarchical structure of IoT. However, the coarse-grained hierarchical schemes usually fail to thoroughly adapt to the hierarchical environment, leading to high training latency. Meanwhile, highly heterogeneous communication and computation delays due to the device diversity (the system heterogeneity) and decentralized data distribution due to the decentralized device distribution (the data heterogeneity) exacerbate the above challenges. This article proposes NebulaFL, a dual heterogeneity-aware multilayer FL framework, to support efficient distributed training in IoT scenarios. NebulaFL proposes an innovative multilayer architecture organization scheme to adapt the complex hierarchical heterogeneous scenarios. Specifically, through a finer-grained division of the HFL hierarchy, hybrid synchronous-asynchronous training is implemented at both the global system and local device-layer levels. More importantly, to adaptively build a heterogeneity-aware hierarchical training architecture, NebulaFL considers the effect of dual heterogeneity in the architectural organization scheme to determine the optimal location of devices in a multilayer environment. To further improve the training efficiency during the training process, NebulaFL employs an augmented multiarmed bandit technique based on the reinforcement learning to adjust the device-layer training load by evaluating the dynamic training utility and convergence uncertainty feedback. Experiments demonstrate that NebulaFL achieves up to a speed-up ratio and a 23.94% increase in the training accuracy compared to the latest or classic approaches.

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

Hierarchical Federated Learning: the Interplay of User Mobility and Data Heterogeneity

Asynchronous Federated Learning over Wireless Communication Networks.

FedHe: Heterogeneous Models and Communication-Efficient Federated Learning

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

Adaptive Configuration for Heterogeneous Participants in Decentralized Federated Learning

FlocOff: Data Heterogeneity Resilient Federated Learning with Communication-Efficient Edge Offloading

Energy-Efficient and Reliable Federated Learning in Heterogeneous Mobile-Edge Computing.

Heterogeneity-Aware Resource Allocation and Topology Design for Hierarchical Federated Edge Learning

Coordination-free Decentralised Federated Learning on Complex Networks: Overcoming Heterogeneity

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Multi-granularity Weighted Federated Learning in Heterogeneous Mobile Edge Computing Systems

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

HADFL: Heterogeneity-aware Decentralized Federated Learning Framework

Heterogeneity-Aware Federated Learning with Adaptive Local Epoch Size in Edge Computing

Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis

Accelerating Federated Learning with Model Segmentation for Edge Networks

Accelerating Federated Learning with Data and Model Parallelism in Edge Computing

Reconfigurable Intelligent Surface Enabled Federated Learning: A Unified Communication-Learning Design Approach

NebulaFL: Self-Organizing Efficient Multilayer Federated Learning Framework With Adaptive Load Tuning in Heterogeneous Edge Systems

Straggler-resilient Federated Learning: Tackling Computation Heterogeneity with Layer-wise Partial Model Training in Mobile Edge Network