Abstract:Federated learning (FL) is an emerging paradigm using a parameter server (PS) to coordinate multiple decentralized clients for training a common model without exposing their raw data. Despite its amazing capability in preserving data privacy, FL confronts two significant challenges that have not been sufficiently addressed by existing works, which are: 1) heterogeneous data distributed on clients given that the PS cannot alter data locations. 2) limited computation resources of FL clients who may conduct model training with mobile devices. To tackle these challenges, we propose a novel federated one-shot transferring of intermediate features (FedOTF) algorithm. More specifically, FedOTF consists of two stages: feature extraction and model reconstruction. To overcome challenge 1, clients in stage 1 only collaboratively train a small model in a federated manner, with the objective to extract features. In stage 2, intermediate features (generated by the small model trained by stage 1) are transferred from clients to the PS so that a large model can be trained to overcome challenge 2. In addition, the design of FedOTF is robust, which can flexibly diminish the number of communication rounds of stage 1 when network capacity is limited, and reduce the amount of exposed features when privacy is concerned. To verify the superiority of FedOTF, we conduct comprehensive experiments with real datasets. The experiment results demonstrate that FedOTF can significantly improve the model utility of FL because a better model can be finally obtained by the PS without incurring heavy computational load on clients. Besides, we conduct robustness evaluation of FedOTF which can achieve stable performance when varying network capacity and privacy requirement.

FedCA: Efficient Federated Learning with Client Autonomy

FedAR: Addressing Client Unavailability in Federated Learning with Local Update Approximation and Rectification

An Efficiency-Boosting Client Selection Scheme for Federated Learning With Fairness Guarantee

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning

Towards Client Driven Federated Learning

Adaptive Control of Client Selection and Gradient Compression for Efficient Federated Learning

Improving Communication Efficiency: A Dual Adaptive Federated Learning Framework

Federated Learning under Heterogeneous and Correlated Client Availability

CAAFL: A Client-Level Adaptive Acceletative Federated Learning Optimization Algorithm for Heterogeneous Data Scenarios

Enhancing Federated Learning by One-Shot Transferring of Intermediate Features from Clients

Fairness-Aware Client Selection for Federated Learning

Heterogeneity-Aware Federated Learning with Adaptive Client Selection and Gradient Compression.

Clients Help Clients: Alternating Collaboration for Semi-Supervised Federated Learning

Towards Fair, Robust and Efficient Client Contribution Evaluation in Federated Learning

FedECS: Client Selection for Optimizing Computing Energy in Federated Learning

FedBalancer: Data and Pace Control for Efficient Federated Learning on Heterogeneous Clients

FedACT: an Adaptive Chained Training Approach for Federated Learning in Computing Power Networks

Communication-Efficient Federated Learning with Adaptive Aggregation for Heterogeneous Client-Edge-Cloud Network

FedPD: A Federated Learning Framework with Optimal Rates and Adaptivity to Non-IID Data.

FLAS: Computation and Communication Efficient Federated Learning via Adaptive Sampling