Abstract:Federated learning (FL), an attractive and promising distributed machine learning paradigm, has sparked extensive interest in exploiting tremendous data stored on ubiquitous mobile devices. However, conventional FL suffers severely from resource heterogeneity, as clients with weak computational and communication capabilities may be unable to complete local training using the same local training hyper-parameters. In this article, we propose Dap-FL, a deep deterministic policy gradient (DDPG)-assisted adaptive FL system, in which local learning rates and local training epochs are adaptively adjusted by all resource-heterogeneous clients through locally deployed DDPG-assisted adaptive hyper-parameter selection schemes. Particularly, the rationality of the proposed hyper-parameter selection scheme is confirmed through rigorous mathematical proof. Besides, due to the thoughtlessness of security consideration of adaptive FL systems in previous studies, we introduce the Paillier cryptosystem to aggregate local models in a secure and privacy-preserving manner. Rigorous analyses show that the proposed Dap-FL system could protect clients' private local models against chosen-plaintext attacks and chosen-message attacks in a widely used honest-but-curious participants and active adversaries security model. More importantly, through ingenious and extensive experiments, the proposed Dap-FL achieves higher model prediction accuracy than two state-of-the-art RL-assisted FL methods, i.e., 6.03% higher than DDPG-based FL and 7.85% higher than DQN-based FL. In addition, experimental results also show that the proposed Dap-FL achieves higher global model prediction accuracy and faster convergence rates than conventional FL, and the comprehensiveness of the adjusted local training hyper-parameters is validated.

DRL-empowered joint batch size and weighted aggregation adjustment mechanism for federated learning on non-IID data

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

Improving Federated Relational Data Modeling via Basis Alignment and Weight Penalty

Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach

DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset

Enhancing Federated Learning Convergence with Dynamic Data Queue and Data Entropy-driven Participant Selection

An Element-Wise Weights Aggregation Method for Federated Learning

Adaptive Batchsize Selection and Gradient Compression for Wireless Federated Learning

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Optimizing Hierarchical Federated Learning: A Reinforcement Learning Approach

FedDWA: Personalized Federated Learning with Dynamic Weight Adjustment

An Optimization Method for Non-IID Federated Learning Based on Deep Reinforcement Learning

Dap-FL: Federated Learning Flourishes by Adaptive Tuning and Secure Aggregation

FedDA: Resource-adaptive Federated Learning with Dual-Alignment Aggregation Optimization for Heterogeneous Edge Devices

Learning to aggregate: A parameterized aggregator to debias aggregation for cross-device federated learning

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Federated Bayesian Deep Learning: The Application of Statistical Aggregation Methods to Bayesian Models

FedDdrl: Federated Double Deep Reinforcement Learning for Heterogeneous IoT with Adaptive Early Client Termination and Local Epoch Adjustment

DWFed: A statistical- heterogeneity-based dynamic weighted model aggregation algorithm for federated learning

Accelerating Federated Learning with Adaptive Extra Local Updates Upon Edge Networks

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning