Abstract:In federated learning, non-iid data not only diminishes the performance of the global model but also gives rise to the fairness problem which manifests as an increase in the variance of the global model’s accuracy across clients. Fairness issues can result in the global model performing poorly or even failing on certain clients. Existing methods addressing the fairness problem in federated learning tend to neglect the comprehensive improvement of both the average performance and fairness of the global model. In addressing it, the multi-objective optimization method for fine-tuning global gradients, FedMC algorithm is introduced in this paper. The primary objective is the average loss function of all clients, and the sub-objective involves fine-tuning the global gradient by reducing the gradient conflict between the global gradient and the local gradients. Specifically, we refine the global gradient by incorporating a sub-optimization objective aimed at alleviating conflicts between the global gradient and the local gradient with the largest deviation, denoted as FedMC. FedMC can enhance the performance and convergence rate of clients with initially poor performance, albeit at the cost of the earlier convergence rate of clients with initially good performance. Nevertheless, it enables the latter to reach the accuracy level achieved before fine-tuning. In addition, we also propose FedMC+ algorithm, owning three additional optimization mechanisms built upon the FedMC optimization objective which includes the decay of hyperparameter, the sliding window mechanism, and data-balanced client selection. Besides, we present a theoretical analysis of the convergence rate of FedMC, demonstrating its convergence to a Pareto stationary solution. Our combined experimental results confirm that FedMC+ achieves an average 4.5% improvement in accuracy and a 22% reduction in the degree of dispersion compared to state-of-the-art federated learning (FL) methods.

Minimax Demographic Group Fairness in Federated Learning

Federating for Learning Group Fair Models

Federated Fairness without Access to Sensitive Groups

Fairness-aware Federated Minimax Optimization with Convergence Guarantee

Multi-Objective Federated Learning: Balancing Global Performance and Individual Fairness

Multi-Dimensional Fair Federated Learning

Mitigating Group Bias in Federated Learning: Beyond Local Fairness

Fairness-Aware Client Selection for Federated Learning

Fairness and Accuracy in Federated Learning

Unified Group Fairness on Federated Learning

Submodular Maximization Approaches for Equitable Client Selection in Federated Learning

Solving a Class of Non-Convex Minimax Optimization in Federated Learning

Ada‐FFL: Adaptive Computing Fairness Federated Learning

A Survey on Group Fairness in Federated Learning: Challenges, Taxonomy of Solutions and Directions for Future Research

Accelerating Fair Federated Learning: Adaptive Federated Adam

Post-Fair Federated Learning: Achieving Group and Community Fairness in Federated Learning via Post-processing

Fairness and Accuracy in Horizontal Federated Learning

A Communication-efficient Algorithm with Linear Convergence for Federated Minimax Learning

Fair Federated Learning with Multi-Objective Hyperparameter Optimization

FedFair^3: Unlocking Threefold Fairness in Federated Learning

Fair-select: a federated learning approach to ensure fairness in selection of participants