Abstract:As a promising edge intelligence technology, federated learning (FL) enables Internet of Things (IoT) devices to train the models collaboratively while ensuring the data privacy and security. Recently, hierarchical FL (HFL) has been designed to promote distributed training in the intricate hierarchical structure of IoT. However, the coarse-grained hierarchical schemes usually fail to thoroughly adapt to the hierarchical environment, leading to high training latency. Meanwhile, highly heterogeneous communication and computation delays due to the device diversity (the system heterogeneity) and decentralized data distribution due to the decentralized device distribution (the data heterogeneity) exacerbate the above challenges. This article proposes NebulaFL, a dual heterogeneity-aware multilayer FL framework, to support efficient distributed training in IoT scenarios. NebulaFL proposes an innovative multilayer architecture organization scheme to adapt the complex hierarchical heterogeneous scenarios. Specifically, through a finer-grained division of the HFL hierarchy, hybrid synchronous-asynchronous training is implemented at both the global system and local device-layer levels. More importantly, to adaptively build a heterogeneity-aware hierarchical training architecture, NebulaFL considers the effect of dual heterogeneity in the architectural organization scheme to determine the optimal location of devices in a multilayer environment. To further improve the training efficiency during the training process, NebulaFL employs an augmented multiarmed bandit technique based on the reinforcement learning to adjust the device-layer training load by evaluating the dynamic training utility and convergence uncertainty feedback. Experiments demonstrate that NebulaFL achieves up to a speed-up ratio and a 23.94% increase in the training accuracy compared to the latest or classic approaches.

Towards Cooperative Federated Learning over Heterogeneous Edge/Fog Networks

Edge-cloud Collaborative Learning with Federated and Centralized Features

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Multi-granularity Weighted Federated Learning in Heterogeneous Mobile Edge Computing Systems

Wireless Communications for Collaborative Federated Learning

CoopFL: Accelerating federated learning with DNN partitioning and offloading in heterogeneous edge computing

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

Cooperative Multi-Model Training for Personalized Federated Learning over Heterogeneous Devices

Unsupervised Federated Optimization at the Edge: D2D-Enabled Learning without Labels

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Confederated Learning: Federated Learning with Decentralized Edge Servers

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

MGFL: Multi-granularity Federated Learning in Edge Computing Systems

NebulaFL: Self-Organizing Efficient Multilayer Federated Learning Framework With Adaptive Load Tuning in Heterogeneous Edge Systems

Accelerating Federated Learning with Model Segmentation for Edge Networks

Optimizing Federated Learning with Heterogeneous Edge Devices

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

Robust Hierarchical Federated Learning with Anomaly Detection in Cloud-Edge-End Cooperation Networks

An Efficient Asynchronous Federated Learning Protocol for Edge Devices