Abstract:Federated learning-assisted edge intelligence enables privacy protection in modern intelligent services. However, not Independent and Identically Distributed (non-IID) distribution among edge clients can impair the local model performance. The existing single prototype-based strategy represents a sample by using the mean of the feature space. However, feature spaces are usually not clustered, and a single prototype may not represent a sample well. Motivated by this, this paper proposes a multi-prototype federated contrastive learning approach (MP-FedCL) which demonstrates the effectiveness of using a multi-prototype strategy over a single-prototype under non-IID settings, including both label and feature skewness. Specifically, a multi-prototype computation strategy based on \textit{k-means} is first proposed to capture different embedding representations for each class space, using multiple prototypes ($k$ centroids) to represent a class in the embedding space. In each global round, the computed multiple prototypes and their respective model parameters are sent to the edge server for aggregation into a global prototype pool, which is then sent back to all clients to guide their local training. Finally, local training for each client minimizes their own supervised learning tasks and learns from shared prototypes in the global prototype pool through supervised contrastive learning, which encourages them to learn knowledge related to their own class from others and reduces the absorption of unrelated knowledge in each global iteration. Experimental results on MNIST, Digit-5, Office-10, and DomainNet show that our method outperforms multiple baselines, with an average test accuracy improvement of about 4.6\% and 10.4\% under feature and label non-IID distributions, respectively.

FedProc: Prototypical contrastive federated learning on Non-IID data

FedProc: Prototypical Contrastive Federated Learning on Non-IID data

FedDGP: Disentangling Global and Personal Models for Federated Learning

Federated Learning from Pre-Trained Models: A Contrastive Learning Approach

FedDC: Federated Learning with Non-IID Data via Local Drift Decoupling and Correction

An Enhanced Federated Prototype Learning Method under Domain Shift

HyperFed: Hyperbolic Prototypes Exploration with Consistent Aggregation for Non-IID Data in Federated Learning

DSFedCon: Dynamic Sparse Federated Contrastive Learning for Data-Driven Intelligent Systems

MP-FedCL: Multi-Prototype Federated Contrastive Learning for Edge Intelligence

FedCos: A Scene-adaptive Federated Optimization Enhancement for Performance Improvement

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

FedRFQ: Prototype-Based Federated Learning with Reduced Redundancy, Minimal Failure, and Enhanced Quality

MP-FedCL: Multiprototype Federated Contrastive Learning for Edge Intelligence

FedCCE: A class-level contribution explainable federated learning based on comparable prototypes collaboration for multi-site medical image classification.

FedCRL: Personalized Federated Learning with Contrastive Shared Representations for Label Heterogeneity in Non-IID Data

Tackling Data Heterogeneity in Federated Learning with Class Prototypes

MpFedcon : Model-Contrastive Personalized Federated Learning with the Class Center

Non-IID always Bad? Semi-Supervised Heterogeneous Federated Learning with Local Knowledge Enhancement

FedGroup: Efficient Clustered Federated Learning via Decomposed Data-Driven Measure