Abstract:Federated learning (FL) is important for privacy-preserving services by training models without collecting raw user data. Most FL algorithms assume all data is annotated, which is impractical due to the high cost of labeling data in real applications. To alleviate the reliance on labeled data, semi-supervised federated learning (SSFL) has been proposed to utilize unlabeled data on clients to improve model performance. However, most existing methods either have privacy issues which share models trained on other clients, or generate pseudo-labels for unlabeled local datasets with the global model, which is usually biased towards the global data distribution. The latter may lead to sub-optimal accuracy of pseudo-labels, due to the gap between the local data distribution and the global model, especially in non-IID settings. In this paper, we propose a semi-supervised heterogeneous federated learning method with local knowledge enhancement, called FedLoKe, which aims to train an accurate global model from both labeled and unlabeled local data with non-IID distributions. Specifically, in FedLoKe, the server maintains a global model to capture global data distribution, and each client learns a local model to capture local data distribution. Since the distribution captured by the local model is aligned with the local data distribution, we utilize it to generate high-accuracy pseudo-labels of the unlabeled dataset for global model training. To prevent the local model from severely overfitting local labeled data, we further use the exponential moving average and apply the global model to generate pseudo-labels for local modeling training. Experiments on four datasets show the effectiveness of FedLoKe. Our code is available at: https://github.com/zcfinal/FedLoKe.

Federated semi-supervised learning with tolerant guidance and powerful classifier in edge scenarios

Edge-cloud Collaborative Learning with Federated and Centralized Features

SemiFed: Semi-supervised Federated Learning with Consistency and Pseudo-Labeling

Towards Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee

SemiPFL: Personalized Semi-Supervised Federated Learning Framework for Edge Intelligence

Adaptive Weighting via Federated Evaluation Mechanism for Domain Adaptation with Edge Devices

A Survey towards Federated Semi-supervised Learning

Federated Sensing : Edge-Cloud Elastic Collaborative Learning for Intelligent Sensing

TabFedSL: A Self-Supervised Approach to Labeling Tabular Data in Federated Learning Environments

Robust Training of Federated Models with Extremely Label Deficiency

Navigating Data Heterogeneity in Federated Learning A Semi-Supervised Federated Object Detection

Towards Unsupervised Domain Adaptation for Deep Face Recognition under Privacy Constraints via Federated Learning

Non-IID always Bad? Semi-Supervised Heterogeneous Federated Learning with Local Knowledge Enhancement

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Federated Semi-supervised Learning for Medical Image Segmentation with intra-client and inter-client Consistency

FedCD: Federated Semi-Supervised Learning with Class Awareness Balance via Dual Teachers

Self-supervised On-device Federated Learning from Unlabeled Streams

Towards Unbiased Training in Federated Open-world Semi-supervised Learning

FedGKD: Towards Heterogeneous Federated Learning via Global Knowledge Distillation

MpFedcon : Model-Contrastive Personalized Federated Learning with the Class Center