Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Hierarchical Federated Learning for Edge Intelligence through Average Consensus

Edge-cloud Collaborative Learning with Federated and Centralized Features

Hierarchical Federated Learning: the Interplay of User Mobility and Data Heterogeneity

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Coordination-free Decentralised Federated Learning on Complex Networks: Overcoming Heterogeneity

Importance-aware Data Selection and Resource Allocation for Hierarchical Federated Edge Learning

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

Confederated Learning: Federated Learning with Decentralized Edge Servers

Hierarchical Federated Edge Learning over Space-Air-Ground Integrated Networks.

High-efficient Hierarchical Federated Learning on Non-Iid Data with Progressive Collaboration

Accelerating Federated Learning with Data and Model Parallelism in Edge Computing

Accelerating Decentralized Federated Learning in Heterogeneous Edge Computing

Accelerating Hierarchical Federated Learning with Model Splitting in Edge Computing

Federated Learning Using Sparse-Adaptive Model Selection for Embedded Edge Computing

Heterogeneity-Aware Federated Learning with Adaptive Local Epoch Size in Edge Computing

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Federated Ensemble Model-Based Reinforcement Learning in Edge Computing

Delay-Aware Hierarchical Federated Learning

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge