Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge

Edge-cloud Collaborative Learning with Federated and Centralized Features

Personalized Federated Learning for Intelligent IoT Applications: A Cloud-Edge based Framework

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

Hierarchical Personalized Federated Learning Over Massive Mobile Edge Computing Networks

Hierarchical Federated Edge Learning with Adaptive Clustering in Internet of Things

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

H-FedSN: Personalized Sparse Networks for Efficient and Accurate Hierarchical Federated Learning for IoT Applications

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Federated Learning over Wireless IoT Networks with Optimized Communication and Resources

Communication-Efficient and Model-Heterogeneous Personalized Federated Learning via Clustered Knowledge Transfer

AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices

Adaptive Personalized Federated Learning With One-Shot Screening

APFed: Attention-based Personalized Federated Learning in Model Heterogeneity Scenario.

HyperFedNet: Communication-Efficient Personalized Federated Learning Via Hypernetwork

Cost-Efficient Federated Learning for Edge Intelligence in Multi-Cell Networks

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Personalized federated learning for heterogeneous data: A distributed edge clustering approach

Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things