Abstract:Federated Learning (FL) is a pivotal approach in decentralized machine learning, especially when data privacy is crucial and direct data sharing is impractical. While FL is typically associated with supervised learning, its potential in unsupervised scenarios is underexplored. This paper introduces a novel unsupervised federated learning methodology designed to identify the complete set of categories (global K) across multiple clients within label-free, non-uniform data distributions, a process known as Federated Clustering. Our approach, Federated Cluster-Wise Refinement (FedCRef), involves clients that collaboratively train models on clusters with similar data distributions. Initially, clients with diverse local data distributions (local K) train models on their clusters to generate compressed data representations. These local models are then shared across the network, enabling clients to compare them through reconstruction error analysis, leading to the formation of federated <a class="link-external link-http" href="http://groups.In" rel="external noopener nofollow">this http URL</a> these groups, clients collaboratively train a shared model representing each data distribution, while continuously refining their local clusters to enhance data association accuracy. This iterative process allows our system to identify all potential data distributions across the network and develop robust representation models for each. To validate our approach, we compare it with traditional centralized methods, establishing a performance baseline and showcasing the advantages of our distributed solution. We also conduct experiments on the EMNIST and KMNIST datasets, demonstrating FedCRef's ability to refine and align cluster models with actual data distributions, significantly improving data representation precision in unsupervised federated settings.

FedCluster: a Global User Profile Generation Method Based on Vertical Federated Clustering

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data

Differentially Private Vertical Federated Clustering

FedSC: A federated learning algorithm based on client-side clustering

Dynamic User Clustering for Efficient and Privacy-Preserving Federated Learning

A Personalized Federated Learning Method Based on Clustering and Knowledge Distillation

Fair Federated Data Clustering through Personalization: Bridging the Gap between Diverse Data Distributions

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Privacy-preserving clustering federated learning for non-IID data

FedMCC: Federated multi-center clustering algorithm to improve privacy healthcare

A federated fuzzy c-means clustering algorithm

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions

Cluster knowledge-driven vertical federated learning

Differentially Private Federated Clustering over Non-IID Data

Enhancing Federated Learning with Pattern-Based Client Clustering

Efficient One-off Clustering for Personalized Federated Learning

Fuzzy Clustered Federated Learning under Mixed Data Distributions.

Federated Matrix Factorization: Algorithm Design and Application to Data Clustering

FedUC: A Unified Clustering Approach for Hierarchical Federated Learning