Abstract:Centralized training of deep learning models poses privacy risks that hinder their deployment. Federated learning (FL) has emerged as a solution to address these risks, allowing multiple clients to train deep learning models collaboratively without sharing raw data. However, FL is vulnerable to the impact of heterogeneous distributed data, which weakens convergence stability and suboptimal performance of the trained model on local data. This is due to the discarding of the old local model at each round of training, which results in the loss of personalized information in the model critical for maintaining model accuracy and ensuring robustness. In this paper, we propose FedTC, a personalized federated learning method with two classifiers that can retain personalized information in the local model and improve the model's performance on local data. FedTC divides the model into two parts, namely, the extractor and the classifier, where the classifier is the last layer of the model, and the extractor consists of other layers. The classifier in the local model is always retained to ensure that the personalized information is not lost. After receiving the global model, the local extractor is overwritten by the global model's extractor, and the classifier of the global model serves as an additional classifier of the local model to guide local training. The FedTC introduces a two-classifier training strategy to coordinate the two classifiers for local model updates. Experimental results on Cifar10 and Cifar100 datasets demonstrate that FedTC performs better on heterogeneous data than current studies, such as FedAvg, FedPer, and local training, achieving a maximum improvement of 27.95% in model classification test accuracy compared to FedAvg.

UPFL: Unsupervised Personalized Federated Learning Towards New Clients

Adaptive Test-Time Personalization for Federated Learning

FedFTHA: A Fine-Tuning and Head Aggregation Method in Federated Learning

PGFed: Personalize Each Client's Global Objective for Federated Learning

FedPer++: Toward Improved Personalized Federated Learning on Heterogeneous and Imbalanced Data

FedAPEN: Personalized Cross-silo Federated Learning with Adaptability to Statistical Heterogeneity

Personalized Federated Learning on Long-Tailed Data Via Adversarial Feature Augmentation.

Client-supervised Federated Learning: Towards One-model-for-all Personalization

Improving Generalization and Personalization in Model-Heterogeneous Federated Learning

Learn What You Need in Personalized Federated Learning

Personalized federated learning based on feature fusion

Efficient Personalized Federated Learning via Sparse Model-Adaptation

Personalized Federated Learning via Feature Distribution Adaptation

Personalized Federated Learning with Local Optimization Models

Personalized Federated Learning with Layer-Wise Feature Transformation Via Meta-Learning

FedSelect: Customized Selection of Parameters for Fine-Tuning during Personalized Federated Learning

FedSelect: Personalized Federated Learning with Customized Selection of Parameters for Fine-Tuning

FedTC: A Personalized Federated Learning Method with Two Classifiers

Personalized Federated Learning with Mixture of Models for Adaptive Prediction and Model Fine-Tuning

FedUP: Bridging Fairness and Efficiency in Cross-Silo Federated Learning

Pfedgf: Enabling Personalized Federated Learning Via Gradient Fusion