Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Beyond Aggregation: Efficient Federated Model Consolidation with Heterogeneity-Adaptive Weights Diffusion

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

AsyncFedED: Asynchronous Federated Learning with Euclidean Distance Based Adaptive Weight Aggregation

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

Faster Convergence on Heterogeneous Federated Edge Learning: An Adaptive Clustered Data Sharing Approach

Towards Efficient Federated Learning Framework Via Selective Aggregation of Models

SHARE: Shaping Data Distribution at Edge for Communication-Efficient Hierarchical Federated Learning

Towards addressing aggregation deviation for model training in resource-scarce edge environment

A Communication-Efficient Hierarchical Federated Learning Framework via Shaping Data Distribution at Edge

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

FedDW: Distilling Weights through Consistency Optimization in Heterogeneous Federated Learning

Federated Learning Model Aggregation in Heterogenous Aerial and Space Networks

An Element-Wise Weights Aggregation Method for Federated Learning

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments

Federated Learning With Client Selection and Gradient Compression in Heterogeneous Edge Systems

DRAG: Divergence-based Adaptive Aggregation in Federated Learning on Non-IID Data

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

FedShift: Tackling Dual Heterogeneity Problem of Federated Learning via Weight Shift Aggregation

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning