Abstract:Federated Learning (FL) is a pivotal approach in decentralized machine learning, especially when data privacy is crucial and direct data sharing is impractical. While FL is typically associated with supervised learning, its potential in unsupervised scenarios is underexplored. This paper introduces a novel unsupervised federated learning methodology designed to identify the complete set of categories (global K) across multiple clients within label-free, non-uniform data distributions, a process known as Federated Clustering. Our approach, Federated Cluster-Wise Refinement (FedCRef), involves clients that collaboratively train models on clusters with similar data distributions. Initially, clients with diverse local data distributions (local K) train models on their clusters to generate compressed data representations. These local models are then shared across the network, enabling clients to compare them through reconstruction error analysis, leading to the formation of federated <a class="link-external link-http" href="http://groups.In" rel="external noopener nofollow">this http URL</a> these groups, clients collaboratively train a shared model representing each data distribution, while continuously refining their local clusters to enhance data association accuracy. This iterative process allows our system to identify all potential data distributions across the network and develop robust representation models for each. To validate our approach, we compare it with traditional centralized methods, establishing a performance baseline and showcasing the advantages of our distributed solution. We also conduct experiments on the EMNIST and KMNIST datasets, demonstrating FedCRef's ability to refine and align cluster models with actual data distributions, significantly improving data representation precision in unsupervised federated settings.

Federated Learning for Short Text Clustering

FedSC: A federated learning algorithm based on client-side clustering

Federated Cinn Clustering for Accurate Clustered Federated Learning

An Efficient Client Clustering Algorithm for Clustered Federated Learning

A Clustering Federated Learning Algorithm Based on Three-Layer Structure

Stochastic Clustered Federated Learning

Federated Learning with Soft Clustering

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Robust Representation Learning with Reliable Pseudo-labels Generation Via Self-Adaptive Optimal Transport for Short Text Clustering.

Towards Federated Clustering: A Federated Fuzzy $c$-Means Algorithm (FFCM)

Fuzzy Clustered Federated Learning under Mixed Data Distributions.

Jigsaw Game: Federated Clustering

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions

One-Shot Federated Clustering Based on Stable Distance Relationships

Federated FCM: Clustering under Privacy Requirements

A federated fuzzy c-means clustering algorithm

Fair Federated Data Clustering through Personalization: Bridging the Gap between Diverse Data Distributions

Enhancing Federated Learning with Pattern-Based Client Clustering

Federated Momentum Contrastive Clustering

Federated Continual Learning for Text Classification via Selective Inter-client Transfer

Federated K-means Clustering