Abstract:Federated learning techniques provide a promising framework for collaboratively training a machine learning model without sharing users' data, and delivering a security solution to guarantee privacy during the model training of IoT devices. Nonetheless, challenges posed by data heterogeneity and communication resource constraints make it difficult to develop an efficient federated learning algorithm in terms of the low order of convergence rate. It could significantly deteriorate the quality of service for critical machine learning tasks, e.g., facial recognition, which requires an edge-ready, low-power, low-latency training algorithm. To address these challenges, a communication-efficient federated learning approach is proposed in this paper where the momentum technique is leveraged to accelerate the convergence rate while largely reducing the communication requirements. First, a federated multi-task learning framework by which the learning tasks are reformulated by the multi-objective optimization problem is introduced to address the data heterogeneity. The multiple gradient descent algorithm is harnessed to find the common gradient descending direction for all participants so that the common features can be learned and no sacrifice on each clients' performance. Second, to reduce communication costs, a local momentum technique with global information is developed to speed up the convergence rate, where the convergence analysis of the proposed method under non-convex case is studied. It is proved that the proposed local momentum can actually achieve the same acceleration as the global momentum, whereas it is more robust than algorithms that solely rely on the acceleration by the global momentum. Third, the generalization of the proposed acceleration approach is investigated which is demonstrated by the accelerated variation of FedAvg. Finally, the performance of the proposed method on the learning model accuracy, convergence rate, and robustness to data heterogeneity, is investigated by empirical experiments on four public datasets, while a real-world IoT platform is constructed to demonstrate the communication efficiency of the proposed method.

PedFed: A performance evaluation-driven federated learning framework for efficient communication

FedDGP: Disentangling Global and Personal Models for Federated Learning

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

A Federated Learning Framework Via Decentralized Data Valuation for Chronic Disease Healthcare

Medical Federated Model with Mixture of Personalized and Sharing Components

Medical Federated Model with Mixture of Personalized and Shared Components

Communication-Efficient Personalized Federated Learning for Green Communications in IoMT

FedPcf : an Integrated Federated Learning Framework with Multi-Level Prospective Correction Factor.

pFLFE: Cross-silo Personalized Federated Learning via Feature Enhancement on Medical Image Segmentation

Pfedeff: an Efficient and Personalized Federated Cognitive Learning Framework in Multi-agent Systems

FedFC: an Efficient Personalized Federated Learning Method on Non-iid Data

PPFed: A Privacy-Preserving and Personalized Federated Learning Framework

FedPE: Adaptive Model Pruning-Expanding for Federated Learning on Mobile Devices

FedFMS: Exploring Federated Foundation Models for Medical Image Segmentation

Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning

FKD-Med: Privacy-Aware, Communication-Optimized Medical Image Segmentation via Federated Learning and Model Lightweighting Through Knowledge Distillation

Channel Adaptive and Sparsity Personalized Federated Learning for Privacy Protection in Smart Healthcare Systems

Efficient Multi-Layer Stochastic Gradient Descent Algorithm for Federated Learning in E-health

Accelerating Communication-efficient Federated Multi-Task Learning with Personalization and Fairness

Federated learning using model projection for multi-center disease diagnosis with non-IID data

FedMetaMed: Federated Meta-Learning for Personalized Medication in Distributed Healthcare Systems