Abstract:Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service (FLaaS) offers a privacy-preserving approach for training machine learning models on devices with various computational resources. Most proposed FL-based methods train the same model in all client devices regardless of their computational resources. However, in practical Internet of Things (IoT) scenarios, IoT devices with limited computational resources may not be capable of training models that client devices with greater hardware performance hosted. Most of the existing FL frameworks that aim to solve the problem of aggregating heterogeneous models are designed for Independent and Identical Distributed (IID) data, which may make it hard to reach the target algorithm performance when encountering non-IID scenarios. To address these problems in hierarchical networks, in this paper, we propose a heterogeneous aggregation framework for hierarchical edge systems called HAF-Edge. In our proposed framework, we introduce a communication-efficient model aggregation method designed for FL systems with two-level model aggregations running at the edge and cloud levels. This approach enhances the convergence rate of the global model by leveraging selective knowledge transfer during the aggregation of heterogeneous models. To the best of our knowledge, this work is pioneering in addressing the problem of aggregating heterogeneous models within hierarchical FL systems spanning IoT, edge, and cloud environments. We conducted extensive experiments to validate the performance of our proposed method. The evaluation results demonstrate that HAF-Edge significantly outperforms state-of-the-art methods.

Multi-source Data Fusion Base on Block-Term Decomposition in Federated Learning

Research on data fusion method based on Federated learning

Edge-cloud Collaborative Learning with Federated and Centralized Features

Multimodal Fusion with Block Term Decomposition for Asynchronous Federated Learning

Analysis of Heterogeneous Data Model Based on Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Multi-granularity Weighted Federated Learning in Heterogeneous Mobile Edge Computing Systems

Heterogeneous Device Collaboration Based Federated Learning for Big Data Applications

Blockchain-Based Decentralized Federated Learning Method in Edge Computing Environment

Data Augmentation Based Federated Learning

Distributed and Deep Vertical Federated Learning with Big Data

A Communication Efficient Vertical Federated Learning Framework.

Federated Learning Algorithm Based on Adaptive Gradient Fusion

Tensor Dynamic Fusion Based Modality-Imbalanced Multimodal Federated Learning in Mobile Edge Computing for Consumer Applications

Adaptive Block-Wise Regularization and Knowledge Distillation for Enhancing Federated Learning

Research on Multi-source Data Security Fusion Analysis Technology Based on Federated Learning

A Multi-Source Credit Data Fusion Approach Based on Federated Distillation Learning

Fed4UL: A Cloud–Edge–End Collaborative Federated Learning Framework for Addressing the Non-IID Data Issue in UAV Logistics

Federated Learning as a Service for Hierarchical Edge Networks with Heterogeneous Models

FedIBD: a federated learning framework in asynchronous mode for imbalanced data

FedDA: Resource-adaptive Federated Learning with Dual-Alignment Aggregation Optimization for Heterogeneous Edge Devices