Abstract:Federated Learning (FL) is a pivotal approach in decentralized machine learning, especially when data privacy is crucial and direct data sharing is impractical. While FL is typically associated with supervised learning, its potential in unsupervised scenarios is underexplored. This paper introduces a novel unsupervised federated learning methodology designed to identify the complete set of categories (global K) across multiple clients within label-free, non-uniform data distributions, a process known as Federated Clustering. Our approach, Federated Cluster-Wise Refinement (FedCRef), involves clients that collaboratively train models on clusters with similar data distributions. Initially, clients with diverse local data distributions (local K) train models on their clusters to generate compressed data representations. These local models are then shared across the network, enabling clients to compare them through reconstruction error analysis, leading to the formation of federated <a class="link-external link-http" href="http://groups.In" rel="external noopener nofollow">this http URL</a> these groups, clients collaboratively train a shared model representing each data distribution, while continuously refining their local clusters to enhance data association accuracy. This iterative process allows our system to identify all potential data distributions across the network and develop robust representation models for each. To validate our approach, we compare it with traditional centralized methods, establishing a performance baseline and showcasing the advantages of our distributed solution. We also conduct experiments on the EMNIST and KMNIST datasets, demonstrating FedCRef's ability to refine and align cluster models with actual data distributions, significantly improving data representation precision in unsupervised federated settings.

One-Shot Federated Clustering Based on Stable Distance Relationships

Differentially Private Federated Clustering over Non-IID Data

Fuzzy Clustered Federated Learning under Mixed Data Distributions.

Privacy-preserving clustering federated learning for non-IID data

A federated fuzzy c-means clustering algorithm

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Fair Federated Data Clustering through Personalization: Bridging the Gap between Diverse Data Distributions

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Clustered Data Sharing for Non-IID Federated Learning over Wireless Networks

FedPNN: One-shot Federated Classification via Evolving Clustering Method and Probabilistic Neural Network hybrid

Heterogeneity for the Win: One-Shot Federated Clustering

A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions

Federated Cinn Clustering for Accurate Clustered Federated Learning

FedSC: A federated learning algorithm based on client-side clustering

Efficient One-off Clustering for Personalized Federated Learning

Clustered Federated Learning in Heterogeneous Environment.

FedRC: Tackling Diverse Distribution Shifts Challenge in Federated Learning by Robust Clustering

Novel clustered federated learning based on local loss

Privacy-Preserving Federated Deep Clustering based on GAN