Abstract:Recent years have witnessed a huge demand for artificial intelligence and machine learning applications in wireless edge networks to assist individuals with real-time services. Owing to the practical setting and privacy preservation of federated learning (FL), it is a suitable and appealing distributed learning paradigm to deploy these applications at the network edge. Despite the many successful efforts made to apply FL to wireless edge networks, the adopted algorithms mostly follow the same spirit as FedAvg, thereby heavily suffering from the practical challenges of label deficiency and device heterogeneity. These challenges not only decelerate the model training in FL but also downgrade the application performance. In this paper, we focus on the algorithm design and address these challenges by investigating the personalized semi-supervised FL problem and proposing an effective algorithm, namely FedCPSL. In particular, the techniques of pseudo-labeling, and interpolation-based model personalization are judiciously combined to provide a new problem formulation for personalized semi-supervised FL. The proposed FedCPSL algorithm adopts novel strategies, including adaptive client variance reduction, local momentum, and normalized global aggregation, to combat the challenge of device heterogeneity and boost algorithm convergence. Moreover, the convergence property of FedCPSL is thoroughly analyzed and shows that FedCPSL is resilient to both statistical and system heterogeneity, obtaining a sublinear convergence rate. Experimental results on image classification tasks are also presented to demonstrate that the proposed approach outperforms its counterparts in terms of both convergence speed and application performance.

Towards Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee

Towards Fast Personalized Semi-Supervised Federated Learning in Edge Networks: Algorithm Design and Theoretical Guarantee

Deep Learning Based Coded Over-the-Air Computation for Personalized Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Towards Fairer and More Efficient Federated Learning via Multidimensional Personalized Edge Models

SemiPFL: Personalized Semi-Supervised Federated Learning Framework for Edge Intelligence

Personalized Edge Intelligence via Federated Self-Knowledge Distillation

An Efficient Asynchronous Federated Learning Protocol for Edge Devices

Optimizing Efficient Personalized Federated Learning with Hypernetworks at Edge

Personalized Federated Learning with Local Attention

Learnable Sparse Customization in Heterogeneous Edge Computing

Asynchronous Online Federated Learning for Edge Devices with Non-IID Data

APFed: Attention-based Personalized Federated Learning in Model Heterogeneity Scenario.

APCSMA: Adaptive Personalized Client-Selection and Model-Aggregation Algorithm for Federated Learning in Edge Computing Scenarios

Personalized federated learning based on feature fusion

Federated semi-supervised learning with tolerant guidance and powerful classifier in edge scenarios

Client-supervised Federated Learning: Towards One-model-for-all Personalization

Energy-Aware Edge Association for Cluster-based Personalized Federated Learning

Personalized Federated Learning with Auction-Based Client Selection and Edge-Enhanced Model Accuracy

Personalized Federated Learning via Feature Distribution Adaptation

Towards Efficient Asynchronous Federated Learning in Heterogeneous Edge Environments