Abstract:Recently, federated learning (FL) as a new learning paradigm allows multi-party to collaboratively train a shared global model with privacy protection. However, vanilla FL running on heterogeneous mobile edge devices still faces three crucial challenges: communication efficiency, statistical heterogeneity, and system heterogeneity. To tackle them simultaneously, we devise FedPE, , a communication-efficient and personalized federated learning framework, which allows each client to search for personalized optimal local subnets adaptive to system capacity in each round of FL. It consists of three core components: a) adaptive pruning-expanding controls model pruning or expanding according to the accuracy variations of local models, b) error compensation strategy promotes the pruned or expanded subnets to be Lottery Ticket Networks (LTNs), c) the fair aggregation rule aggregates local models with their real-time contributions as coefficients to boost the performance of the aggregated global model. The integration of the three components facilitates that only personalized optimal subnets with different footprints interact between the server and clients, which effectively reduces communication costs and enhances the robustness of FL to statistical and system heterogeneity. We also prove the convergence of FedPE and design an optimal hyperparameter searching (OHS) algorithm based on Pareto optimization to search for optimal hyperparameters for FedPE. . Extensive experiments evaluated on five real-world datasets with IID or Non-IID distributions demonstrate that FedPE configured with found optimal hyperparameters achieves 1.86 . 86 x - 121 x communication efficiency improvement with almost no accuracy degradation, presenting the best trade-off between model accuracy and communication cost.

pFedES: Model Heterogeneous Personalized Federated Learning with Feature Extractor Sharing

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

pFedMoE: Data-Level Personalization with Mixture of Experts for Model-Heterogeneous Personalized Federated Learning

Personalized Federated Learning with Adaptive Feature Aggregation and Knowledge Transfer

pFedAFM: Adaptive Feature Mixture for Batch-Level Personalization in Heterogeneous Federated Learning

Pfedsim: Similarity-Aware Model Aggregation Towards Personalized Federated Learning.

FedAPEN: Personalized Cross-silo Federated Learning with Adaptability to Statistical Heterogeneity

Feed: Towards Personalization-Effective Federated Learning

FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning

FedFed: Feature Distillation Against Data Heterogeneity in Federated Learning

Efficient Hierarchical Personalized Federated Learning on Heterogeneous Data

Pfedlhns: Personalized Federated Learning Via Local Hypernetworks

FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices

Sparse Federated Learning with Hierarchical Personalization Models.

Sparse Federated Learning with Hierarchical Personalized Models

pFedKT: Personalized federated learning with dual knowledge transfer

Pfedgf: Enabling Personalized Federated Learning Via Gradient Fusion

Efficient Personalized Federated Learning via Sparse Model-Adaptation

GPFL: Simultaneously Learning Global and Personalized Feature Information for Personalized Federated Learning

FedPAE: Peer-Adaptive Ensemble Learning for Asynchronous and Model-Heterogeneous Federated Learning