Abstract:Federated learning (FL) has emerged as a popular paradigm for distributed machine learning among vast clients. Unfortunately, resource-constrained clients often fail to participate in FL because they cannot pay for the memory resources required for model training due to their limited memory or bandwidth. Split federated learning (SFL) is a novel FL framework in which clients commit intermediate results of model training to a cloud server for client-server collaborative training of models, making resource-constrained clients also eligible for FL. However, existing SFL frameworks mostly require frequent communication with the cloud server to exchange intermediate results and model parameters, which results in significant communication overhead and elongated training time. In particular, this can be exacerbated by the imbalanced data distributions of clients. To tackle this issue, we propose HSFL, a hierarchical split federated learning framework that efficiently trains SFL model through hierarchical organization participants. Under the HSFL framework, we formulate a Cloud Aggregation Time Minimization (CATM) problem to minimize the global training time and design a light-weight client assignment algorithm based on dynamic programming to solve it. Moreover, we develop a self-adaption approach to cope with the dynamic computational resources of clients. Finally, we implement and evaluate HSFL on various real-world training tasks, elaborating on its effectiveness and superiority in terms of efficiency and accuracy compared to baselines.

A Composition–decomposition Based Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Efficient Model Compression for Hierarchical Federated Learning

Communication-Efficient Model Aggregation with Layer Divergence Feedback in Federated Learning

Federated mutual learning

Communication Efficient Federated Learning With Heterogeneous Structured Client Models

Towards Client Driven Federated Learning

Compositional federated learning: Applications in distributionally robust averaging and meta learning

FedCross: Towards Accurate Federated Learning via Multi-Model Cross-Aggregation

A Personalized Federated Cloud-Edge Collaboration Framework Via Cross-Client Knowledge Distillation

Data Collaborative Federated Learning for Non-i.i.d Data in Wireless Networks

FedCE: Personalized Federated Learning Method based on Clustering Ensembles

HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous Clients

FedConv: A Learning-on-Model Paradigm for Heterogeneous Federated Clients

FedSL: A Communication Efficient Federated Learning with Split Layer Aggregation

HSFL: an Efficient Split Federated Learning Framework Via Hierarchical Organization.

FedGroup: Efficient Clustered Federated Learning via Decomposed Data-Driven Measure

Federated Learning with Additional Mechanisms on Clients to Reduce Communication Costs