Abstract:Federated Learning (FL) is a pivotal approach in decentralized machine learning, especially when data privacy is crucial and direct data sharing is impractical. While FL is typically associated with supervised learning, its potential in unsupervised scenarios is underexplored. This paper introduces a novel unsupervised federated learning methodology designed to identify the complete set of categories (global K) across multiple clients within label-free, non-uniform data distributions, a process known as Federated Clustering. Our approach, Federated Cluster-Wise Refinement (FedCRef), involves clients that collaboratively train models on clusters with similar data distributions. Initially, clients with diverse local data distributions (local K) train models on their clusters to generate compressed data representations. These local models are then shared across the network, enabling clients to compare them through reconstruction error analysis, leading to the formation of federated <a class="link-external link-http" href="http://groups.In" rel="external noopener nofollow">this http URL</a> these groups, clients collaboratively train a shared model representing each data distribution, while continuously refining their local clusters to enhance data association accuracy. This iterative process allows our system to identify all potential data distributions across the network and develop robust representation models for each. To validate our approach, we compare it with traditional centralized methods, establishing a performance baseline and showcasing the advantages of our distributed solution. We also conduct experiments on the EMNIST and KMNIST datasets, demonstrating FedCRef's ability to refine and align cluster models with actual data distributions, significantly improving data representation precision in unsupervised federated settings.

A federated fuzzy c-means clustering algorithm

Towards Federated Clustering: A Federated Fuzzy $c$-Means Algorithm (FFCM)

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions

An Efficient Federated Multi-view Fuzzy C-Means Clustering Method

Federated K-means Clustering

FedSC: A federated learning algorithm based on client-side clustering

Fair Federated Data Clustering through Personalization: Bridging the Gap between Diverse Data Distributions

Dynamically Weighted Federated k-Means

Adaptive Clustered Federated Learning with Representation Similarity

A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data

FedUC: A Unified Clustering Approach for Hierarchical Federated Learning

Federated Matrix Factorization: Algorithm Design and Application to Data Clustering

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Novel clustered federated learning based on local loss

FedMCC: Federated multi-center clustering algorithm to improve privacy healthcare

FedClust: Tackling Data Heterogeneity in Federated Learning through Weight-Driven Client Clustering

A Bayesian Framework for Clustered Federated Learning

Privacy-preserving Continual Federated Clustering via Adaptive Resonance Theory

Federated learning with incremental clustering for heterogeneous data

Differentially Private Vertical Federated Clustering

Dynamic User Clustering for Efficient and Privacy-Preserving Federated Learning