Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Optimizing Federated Learning with Heterogeneous Edge Devices

Federated Learning for Computationally Constrained Heterogeneous Devices: A Survey

Federated Learning on Edge Sensing Devices: A Review

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Experimental Evaluation and Analysis of Federated Learning in Edge Computing Environments

FlocOff: Data Heterogeneity Resilient Federated Learning with Communication-Efficient Edge Offloading

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

Edge-assisted U-Shaped Split Federated Learning with Privacy-preserving for Internet of Things

Towards a Federated Learning Framework for Heterogeneous Devices of Internet of Things

An Empirical Study of Federated Learning on IoT-Edge Devices: Resource Allocation and Heterogeneity

IoT Device Friendly and Communication Efficient Federated Learning via Joint Model Pruning and Quantization

Semi-Federated Learning for Connected Intelligence With Computing-Heterogeneous Devices

FedHe: Heterogeneous Models and Communication-Efficient Federated Learning

Resilient and Communication Efficient Learning for Heterogeneous Federated Systems

AnycostFL: Efficient On-Demand Federated Learning over Heterogeneous Edge Devices

Adaptive Model Pruning and Personalization for Federated Learning Over Wireless Networks

Decentralized Federated Learning on the Edge over Wireless Mesh Networks

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

SHFL: Secure Hierarchical Federated Learning Framework for Edge Networks

DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection