Abstract:Recently, federated learning (FL) as a new learning paradigm allows multi-party to collaboratively train a shared global model with privacy protection. However, vanilla FL running on heterogeneous mobile edge devices still faces three crucial challenges: communication efficiency, statistical heterogeneity, and system heterogeneity. To tackle them simultaneously, we devise FedPE, , a communication-efficient and personalized federated learning framework, which allows each client to search for personalized optimal local subnets adaptive to system capacity in each round of FL. It consists of three core components: a) adaptive pruning-expanding controls model pruning or expanding according to the accuracy variations of local models, b) error compensation strategy promotes the pruned or expanded subnets to be Lottery Ticket Networks (LTNs), c) the fair aggregation rule aggregates local models with their real-time contributions as coefficients to boost the performance of the aggregated global model. The integration of the three components facilitates that only personalized optimal subnets with different footprints interact between the server and clients, which effectively reduces communication costs and enhances the robustness of FL to statistical and system heterogeneity. We also prove the convergence of FedPE and design an optimal hyperparameter searching (OHS) algorithm based on Pareto optimization to search for optimal hyperparameters for FedPE. . Extensive experiments evaluated on five real-world datasets with IID or Non-IID distributions demonstrate that FedPE configured with found optimal hyperparameters achieves 1.86 . 86 x - 121 x communication efficiency improvement with almost no accuracy degradation, presenting the best trade-off between model accuracy and communication cost.

DualPFL: A Dual Sparse Pruning Method with Efficient Federated Learning for Edge-Based Object Detection

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Communication-Efficient and Private Federated Learning with Adaptive Sparsity-Based Pruning on Edge Computing

Efficient Federated Learning with Adaptive Channel Pruning for Edge Devices

Personalized Federated Learning Incorporating Adaptive Model Pruning at the Edge

FedPrune: Personalized and Communication-Efficient Federated Learning on Non-IID Data

Efficient federated learning on resource-constrained edge devices based on model pruning

Computation and Communication Efficient Federated Learning With Adaptive Model Pruning

Communication-efficient Federated Learning Via Personalized Filter Pruning

Like Attracts Like: Personalized Federated Learning in Decentralized Edge Computing

Accelerating Federated Learning for IoT in Big Data Analytics With Pruning, Quantization and Selective Updating

Enhancing Decentralized Federated Learning with Model Pruning and Adaptive Communication

A Masked Pruning Approach for Dimensionality Reduction in Communication-Efficient Federated Learning Systems

Adaptive Model Pruning and Personalization for Federated Learning Over Wireless Networks

FedDUAP: Federated Learning with Dynamic Update and Adaptive Pruning Using Shared Data on the Server

Communication Efficient Federated Learning via Channel-wise Dynamic Pruning

DapperFL: Domain Adaptive Federated Learning with Model Fusion Pruning for Edge Devices

Model Pruning-enabled Federated Split Learning for Resource-constrained Devices in Artificial Intelligence Empowered Edge Computing Environment

Accelerating Federated Learning with Model Segmentation for Edge Networks

Efficient Federated Learning with Enhanced Privacy via Lottery Ticket Pruning in Edge Computing

FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices