Abstract:As a promising edge intelligence technology, federated learning (FL) enables Internet of Things (IoT) devices to train the models collaboratively while ensuring the data privacy and security. Recently, hierarchical FL (HFL) has been designed to promote distributed training in the intricate hierarchical structure of IoT. However, the coarse-grained hierarchical schemes usually fail to thoroughly adapt to the hierarchical environment, leading to high training latency. Meanwhile, highly heterogeneous communication and computation delays due to the device diversity (the system heterogeneity) and decentralized data distribution due to the decentralized device distribution (the data heterogeneity) exacerbate the above challenges. This article proposes NebulaFL, a dual heterogeneity-aware multilayer FL framework, to support efficient distributed training in IoT scenarios. NebulaFL proposes an innovative multilayer architecture organization scheme to adapt the complex hierarchical heterogeneous scenarios. Specifically, through a finer-grained division of the HFL hierarchy, hybrid synchronous-asynchronous training is implemented at both the global system and local device-layer levels. More importantly, to adaptively build a heterogeneity-aware hierarchical training architecture, NebulaFL considers the effect of dual heterogeneity in the architectural organization scheme to determine the optimal location of devices in a multilayer environment. To further improve the training efficiency during the training process, NebulaFL employs an augmented multiarmed bandit technique based on the reinforcement learning to adjust the device-layer training load by evaluating the dynamic training utility and convergence uncertainty feedback. Experiments demonstrate that NebulaFL achieves up to a speed-up ratio and a 23.94% increase in the training accuracy compared to the latest or classic approaches.

Hierarchical Federated Learning for Heterogeneous Features and Distributed Data in IoT Networks.

Hierarchical Federated Learning: the Interplay of User Mobility and Data Heterogeneity

Federated Feature Selection for Horizontal Federated Learning in IoT Networks

H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

HierarchyFL: Heterogeneous Federated Learning via Hierarchical Self-Distillation

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Hierarchical and Decentralised Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Information-Exchangeable Hierarchical Clustering for Federated Learning with Non-IID Data

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

Towards a Federated Learning Framework for Heterogeneous Devices of Internet of Things

T-FedHA: A Trusted Hierarchical Asynchronous Federated Learning Framework for Internet of Things

Hierarchical federated learning based on wireless D2D networks

FedHGL: Cross-Institutional Federated Heterogeneous Graph Learning for IoT

NebulaFL: Self-Organizing Efficient Multilayer Federated Learning Framework With Adaptive Load Tuning in Heterogeneous Edge Systems

HiFlash: Communication-Efficient Hierarchical Federated Learning with Adaptive Staleness Control and Heterogeneity-aware Client-Edge Association

FedSR: A Semi-Decentralized Federated Learning Algorithm for Non-IIDness in IoT System

HSFL: an Efficient Split Federated Learning Framework Via Hierarchical Organization.

Device Scheduling and Assignment in Hierarchical Federated Learning for Internet of Things