Abstract:Federated Learning (FL) has emerged as a promising approach for privacy-preserving model training across decentralized devices. However, it faces challenges such as statistical heterogeneity and susceptibility to adversarial attacks, which can impact model robustness and fairness. Personalized FL attempts to provide some relief by customizing models for individual clients. However, it falls short in addressing server-side aggregation vulnerabilities. We introduce a novel method called \textbf{FedAA}, which optimizes client contributions via \textbf{A}daptive \textbf{A}ggregation to enhance model robustness against malicious clients and ensure fairness across participants in non-identically distributed settings. To achieve this goal, we propose an approach involving a Deep Deterministic Policy Gradient-based algorithm for continuous control of aggregation weights, an innovative client selection method based on model parameter distances, and a reward mechanism guided by validation set performance. Empirically, extensive experiments demonstrate that, in terms of robustness, \textbf{FedAA} outperforms the state-of-the-art methods, while maintaining comparable levels of fairness, offering a promising solution to build resilient and fair federated systems. Our code is available at <a class="link-external link-https" href="https://github.com/Gp1g/FedAA" rel="external noopener nofollow">this https URL</a>.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to improve the robustness and fairness of the model in Federated Learning (FL). Specifically, when Federated Learning conducts privacy - protected model training on distributed devices, it faces the challenges of statistical heterogeneity and adversarial attacks, which will affect the robustness and fairness of the model. Although Personalized FL (PFL) attempts to alleviate these problems by customizing the model for each client, this method still has vulnerabilities in the server - side aggregation stage and cannot fully cope with the influence of malicious clients. To overcome these challenges, the paper proposes a new method - FedAA (Federated Adaptive Aggregation), which optimizes client contributions through adaptive aggregation, enhances the model's robustness against malicious clients, and ensures fairness in non - identically distributed settings. In terms of specific implementation, FedAA uses the Deep Deterministic Policy Gradient (DDPG) algorithm to continuously control the aggregation weights, proposes an innovative client selection method based on the distance of model parameters, and designs a reward mechanism guided by the performance of the validation set. The main contributions of the paper include: 1. Proposing a new Federated Learning framework, FedAA, which uses deep reinforcement learning to dynamically optimize the contributions of clients in Federated Learning to simultaneously improve robustness and fairness. 2. Verifying the effectiveness of the FedAA model through extensive experiments. The results show that FedAA is superior to the existing state - of - the - art methods in terms of robustness while maintaining a comparable level of fairness. 3. Conducting an ablation study, analyzing the contributions of key components to the model performance, and providing insights into the fairness mechanism of FedAA in dealing with diverse client data distributions. Through these contributions, FedAA provides a promising solution for constructing a resilient and fair Federated system.

FedAA: A Reinforcement Learning Perspective on Adaptive Aggregation for Fair and Robust Federated Learning

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedAVE: Adaptive data value evaluation framework for collaborative fairness in federated learning

A Fair Federated Learning Framework with Reinforcement Learning.

FedALA: Adaptive Local Aggregation for Personalized Federated Learning

FedREAS: A Robust Efficient Aggregation and Selection Framework for Federated Learning

FedPA: An adaptively partial model aggregation strategy in Federated Learning

FedLaw: Value-Aware Federated Learning with Individual Fairness and Coalition Stability

An Aggregation-Free Federated Learning for Tackling Data Heterogeneity

FedAgg: Adaptive Federated Learning with Aggregated Gradients

Fairness and Accuracy in Federated Learning

Lazy Aggregation for Heterogeneous Federated Learning

AdaFed: Fair Federated Learning via Adaptive Common Descent Direction

Fairness-Aware Client Selection for Federated Learning

FedCAP: Robust Federated Learning via Customized Aggregation and Personalization

FedMABA: Towards Fair Federated Learning through Multi-Armed Bandits Allocation

FedDA: Resource-adaptive Federated Learning with Dual-Alignment Aggregation Optimization for Heterogeneous Edge Devices

Adaptive Aggregation Weight Assignment for Federated Learning: A Deep Reinforcement Learning Approach

FedAH: Aggregated Head for Personalized Federated Learning

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning