Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Federated Learning Based on CTC for Heterogeneous Internet of Things

Edge-cloud Collaborative Learning with Federated and Centralized Features

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

Model-Heterogeneous Federated Learning for Internet of Things: Enabling Technologies and Future Directions

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

T-FedHA: A Trusted Hierarchical Asynchronous Federated Learning Framework for Internet of Things

Hierarchical Federated Learning for Heterogeneous Features and Distributed Data in IoT Networks.

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Federated Learning Framework Coping with Hierarchical Heterogeneity in Cooperative ITS

Wireless Communications for Collaborative Federated Learning

H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Federated Learning for Internet of Things: Applications, Challenges, and Opportunities

FedCST: Federated Learning on Heterogeneous Resource-constrained Devices Using Clustering and Split Training

FedHGL: Cross-Institutional Federated Heterogeneous Graph Learning for IoT

Federated Learning for the Internet of Things: Applications, Challenges, and Opportunities

Towards a Federated Learning Framework for Heterogeneous Devices of Internet of Things

Semi-Federated Learning for Collaborative Intelligence in Massive IoT Networks

Completely Heterogeneous Federated Learning

AdaptiveFL: Adaptive Heterogeneous Federated Learning for Resource-Constrained AIoT Systems

FedDCT: A Dynamic Cross-Tier Federated Learning Framework in Wireless Networks