Abstract:Federated Learning (FL) is a pivotal approach in decentralized machine learning, especially when data privacy is crucial and direct data sharing is impractical. While FL is typically associated with supervised learning, its potential in unsupervised scenarios is underexplored. This paper introduces a novel unsupervised federated learning methodology designed to identify the complete set of categories (global K) across multiple clients within label-free, non-uniform data distributions, a process known as Federated Clustering. Our approach, Federated Cluster-Wise Refinement (FedCRef), involves clients that collaboratively train models on clusters with similar data distributions. Initially, clients with diverse local data distributions (local K) train models on their clusters to generate compressed data representations. These local models are then shared across the network, enabling clients to compare them through reconstruction error analysis, leading to the formation of federated <a class="link-external link-http" href="http://groups.In" rel="external noopener nofollow">this http URL</a> these groups, clients collaboratively train a shared model representing each data distribution, while continuously refining their local clusters to enhance data association accuracy. This iterative process allows our system to identify all potential data distributions across the network and develop robust representation models for each. To validate our approach, we compare it with traditional centralized methods, establishing a performance baseline and showcasing the advantages of our distributed solution. We also conduct experiments on the EMNIST and KMNIST datasets, demonstrating FedCRef's ability to refine and align cluster models with actual data distributions, significantly improving data representation precision in unsupervised federated settings.

Adaptive Clustered Federated Learning with Representation Similarity

FedSC: A federated learning algorithm based on client-side clustering

Federated Dynamic Client Selection for Fairness Guarantee in Heterogeneous Edge Computing

Federated unsupervised representation learning

A Clustered Federated Learning Method of User Behavior Analysis Based on Non-IID Data

FedAC: An Adaptive Clustered Federated Learning Framework for Heterogeneous Data

Federated learning based on stratified sampling and regularization

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

Towards Communication-Efficient and Privacy-Preserving Federated Representation Learning

CCFC: Bridging Federated Clustering and Contrastive Learning

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

A federated fuzzy c-means clustering algorithm

An EMD-Based Adaptive Client Selection Algorithm for Federated Learning in Heterogeneous Data Scenarios

Equitable Federated Learning with Activation Clustering

FedClust: Tackling Data Heterogeneity in Federated Learning through Weight-Driven Client Clustering

Resource Aware Clustering for Tackling the Heterogeneity of Participants in Federated Learning

Federated Clustering: An Unsupervised Cluster-Wise Training for Decentralized Data Distributions

Enhancing Edge-Assisted Federated Learning with Asynchronous Aggregation and Cluster Pairing

FedUC: A Unified Clustering Approach for Hierarchical Federated Learning

Towards Federated Clustering: A Federated Fuzzy $c$-Means Algorithm (FFCM)