Abstract:Federated learning aims to tackle the ``isolated data island" problem, where it trains a collective model from physically isolated clients while safeguarding the privacy of users' data. However, supervised federated learning necessitates that each client labels their data for training, which can be both time-consuming and resource-intensive, and may even be impractical for edge devices. Moreover, the training and transmission of deep models present challenges to the computation and communication capabilities of the clients. To address these two inherent challenges in supervised federated learning, we propose a novel lightweight unsupervised federated learning approach that leverages unlabeled data on each client to perform lightweight model training and communication by harnessing pretrained vision-language models, such as CLIP. By capitalizing on the zero-shot prediction capability and the well-trained image encoder of the pre-trained CLIP model, we have carefully crafted an efficient and resilient self-training approach. This method refines the initial zero-shot predicted pseudo-labels of unlabeled instances through the sole training of a linear classifier on top of the fixed image encoder. Additionally, to address data heterogeneity within each client, we propose a class-balanced text feature sampling strategy for generating synthetic instances in the feature space to support local training. Experiments are conducted on multiple benchmark datasets. The experimental results demonstrate that our proposed method greatly enhances model performance in comparison to CLIP's zero-shot predictions and even outperforms supervised federated learning benchmark methods given limited computational and communication overhead.

FedCL: An Efficient Federated Unsupervised Learning for Model Sharing in IoT.

FedUSC: Collaborative Unsupervised Representation Learning from Decentralized Data for Internet of Things

FedACL: Federated Multi-Distillation with Auxiliary Classification Layers in IoT.

FedGAN: A Federated Semi-supervised Learning from Non-IID Data

Knowledge-Enhanced Semi-Supervised Federated Learning for Aggregating Heterogeneous Lightweight Clients in IoT

Federated Learning from Only Unlabeled Data with Class-Conditional-Sharing Clients

Federated Learning Model Training Method Based on Data Features Perception Aggregation

Federated Learning from Pre-Trained Models: A Contrastive Learning Approach

Distributed Unsupervised Visual Representation Learning with Fused Features

Lightweight Unsupervised Federated Learning with Pretrained Vision Language Model

FedAnchor: Enhancing Federated Semi-Supervised Learning with Label Contrastive Loss for Unlabeled Clients

Doubly Contrastive Representation Learning for Federated Image Recognition

FedProc: Prototypical contrastive federated learning on Non-IID data

Federated Learning for IoT Devices with Domain Generalization

Enhancing Federated Learning with Pattern-Based Client Clustering

FedCML: Federated Clustering Mutual Learning with non-IID Data.

Clients Help Clients: Alternating Collaboration for Semi-Supervised Federated Learning

Unsupervised Federated Optimization at the Edge: D2D-Enabled Learning without Labels

Federated Split Learning with Only Positive Labels for resource-constrained IoT environment

FedCLCC: A Personalized Federated Learning Algorithm for Edge Cloud Collaboration Based on Contrastive Learning and Conditional Computing