Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Edge-cloud Collaborative Learning with Federated and Centralized Features

Leveraging Federated Learning and Edge Computing for Recommendation Systems within Cloud Computing Networks

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Federated learning in cloud-edge collaborative architecture: key technologies, applications and challenges

High-Precision Cluster Federated Learning for Smart Home: An Edge-Cloud Collaboration Approach

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Multi-Edge Server-Assisted Dynamic Federated Learning With an Optimized Floating Aggregation Point

CCSFLF: Cloud‐edge‐terminal collaborative self‐adaptive federated learning framework

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

A Framework for testing Federated Learning algorithms using an edge-like environment

Agglomerative Federated Learning: Empowering Larger Model Training via End-Edge-Cloud Collaboration

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Efficient and Less Centralized Federated Learning

Efficient knowledge management for heterogenous federated continual learning on resource-constrained edge devices

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Cross-FCL: Toward a Cross-edge Federated Continual Learning Framework in Mobile Edge Computing Systems