Abstract:Federated learning, as a distributed machine learning framework, aims to protect data privacy while addressing the issue of data silos by collaboratively training models across multiple clients. However, a significant challenge to federated learning arises from the non-independent and identically distributed (non-iid) nature of data across different clients. non-iid data can lead to inconsistencies between the minimal loss experienced by individual clients and the global loss observed after the central server aggregates the local models, affecting the model's convergence speed and generalization capability. To address this challenge, we propose a novel federated learning algorithm based on update bias (FedUB). Unlike traditional federated learning approaches such as FedAvg and FedProx, which independently update model parameters on each client before direct aggregation to form a global model, the FedUB algorithm incorporates an update bias in the loss function of local models—specifically, the difference between each round's local model updates and the global model updates. This design aims to reduce discrepancies between local and global updates, thus aligning the parameters of locally updated models more closely with those of the globally aggregated model, thereby mitigating the fundamental conflict between local and global optima. Additionally, during the aggregation phase at the server side, we introduce a metric called the bias metric, which assesses the similarity between each client's local model and the global model. This metric adaptively sets the weight of each client during aggregation after each training round to achieve a better global model. Extensive experiments conducted on multiple datasets have confirmed the effectiveness of the FedUB algorithm. The results indicate that FedUB generally outperforms methods such as FedDC, FedDyn, and Scaffold, especially in scenarios involving partial client participation and non-iid data distributions. It demonstrates superior performance and faster convergence in tasks such as image classification.

Heterogeneity-aware Fair Federated Learning

Fairness and Accuracy in Federated Learning

Fairness-aware Agnostic Federated Learning

Fairness-Aware Client Selection for Federated Learning

GLOCALFAIR: Jointly Improving Global and Local Group Fairness in Federated Learning

Mitigating Group Bias in Federated Learning: Beyond Local Fairness

Privacy preserving federated learning for full heterogeneity

Ensuring Fairness and Gradient Privacy in Personalized Heterogeneous Federated Learning

Federated Dynamic Client Selection for Fairness Guarantee in Heterogeneous Edge Computing

WassFFed: Wasserstein Fair Federated Learning

Unified Group Fairness on Federated Learning

Improving Federated Learning with Quality-Aware User Incentive and Auto-Weighted Model Aggregation.

A Fair Federated Learning Framework with Reinforcement Learning.

Advances in Robust Federated Learning: Heterogeneity Considerations

Federated learning with workload-aware client scheduling in heterogeneous systems

Dynamic Fair Federated Learning Based on Reinforcement Learning

Hierarchically Fair Federated Learning

FedUB: Federated Learning Algorithm Based on Update Bias

Accelerating Fair Federated Learning: Adaptive Federated Adam

Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning

Towards Addressing Heterogeneity Of Data In Federated Learning