Abstract:In the vanilla federated learning (FL) framework, the central server distributes a globally unified model to each client and uses labeled samples for training. However, in most cases, clients are equipped with different devices and are exposed to a variety of situations. There are great differences between clients in storage, computing, communication, and other resources, which makes unified deep models used in traditional FL cannot fit clients’ personalized resource conditions. Furthermore, a great deal of labeled data is needed in traditional FL, whereas data labeling requires a great investment of time and resources, which is hard to do for individual clients. As a result, clients only have a vast amount of unlabeled data, which goes against the federated learning needs. To address the aforementioned two issues, we propose Semi-HFL, a semi-supervised federated learning approach for heterogeneous devices, which divides a deep model into a series of small submodels by inserting early exit branches to meet the resource requirements of different devices. Furthermore, considering the availability of labeled data, Semi-HFL introduces semi-supervised techniques for training in the above heterogeneous learning process. Specifically, two training phases are included in the semi-supervised learning process, unsupervised learning on clients and supervised learning on the server, which makes full use of clients’ unlabeled data. Through image classification, text classification, next-word prediction, and multi-task FL experiments based on five kinds of datasets, it is verified that compared with the traditional homogeneous learning method, Semi-HFL not only achieves higher accuracies but also significantly reduces the global resource overhead.

A Unified Framework for Federated Semi-Supervised Learning in Heterogeneous IoT Healthcare Systems

Federated Semi-supervised Learning with Dual Regulator

Federated Semi-Supervised Learning Through a Combination of Self and Cross Model Ensembling

A Federated Learning Framework for Healthcare IoT devices

Federated Semi-Supervised Learning with Annotation Heterogeneity

Model-Heterogeneous Semi-Supervised Federated Learning for Medical Image Segmentation

Secure and Efficient Smart Healthcare System Based on Federated Learning

Semi-HFL: semi-supervised federated learning for heterogeneous devices

SelfFed: Self-supervised Federated Learning for Data Heterogeneity and Label Scarcity in IoMT

Unified Fair Federated Learning for Digital Healthcare

Addressing Class Variable Imbalance in Federated Semi-supervised Learning

RSCFed: Random Sampling Consensus Federated Semi-supervised Learning

Balanced Federated Semisupervised Learning with Fairness-Aware Pseudo-Labeling.

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Class Balanced Adaptive Pseudo Labeling for Federated Semi-Supervised Learning

FedUSC: Collaborative Unsupervised Representation Learning from Decentralized Data for Internet of Things

A Survey towards Federated Semi-supervised Learning

Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning

Homomorphic Encryption-based Privacy-preserving Federated Learning in IoT-enabled Healthcare System

Federated Semi-Supervised Learning with Local and Global Updating Frequency Optimization

Semi-Supervised Federated Heterogeneous Transfer Learning