Abstract:Federated learning (FL) has garnered considerable attention due to its privacy-preserving feature. Nonetheless, the lack of freedom in managing user data can lead to group fairness issues, where models are biased towards sensitive factors such as race or gender. To tackle this issue, this paper proposes a novel algorithm, fair federated averaging with augmented Lagrangian method (FFALM), designed explicitly to address group fairness issues in FL. Specifically, we impose a fairness constraint on the training objective and solve the minimax reformulation of the constrained optimization problem. Then, we derive the theoretical upper bound for the convergence rate of FFALM. The effectiveness of FFALM in improving fairness is shown empirically on CelebA and UTKFace datasets in the presence of severe statistical heterogeneity.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the group fairness problem in Federated Learning (FL). Specifically, although Federated Learning has received extensive attention due to its privacy - protection characteristics, the lack of flexibility in handling user data may lead to group fairness problems, that is, the model has biases towards certain sensitive factors such as race or gender. To solve this problem, the paper proposes a new algorithm - Fair Federated Averaging with Augmented Lagrangian Method (FFALM), which is specifically designed to address the group fairness problem in Federated Learning. ### Main Problem Description 1. **Group Fairness Problem**: - Federated Learning may cause the model to be biased against certain sensitive groups (such as race, gender, etc.) during the training process. - These biases may stem from measurement biases or historical biases in the data set, as well as the undesired features learned by the training algorithm from these data sets. 2. **Statistical Heterogeneity**: - In the case of severe statistical heterogeneity, the trained model may perform poorly and be biased. - It is necessary to find a Federated Learning algorithm that can ensure fairness and be resistant to non - i.i.d. (non - independent and identically distributed) data. ### Proposed Solution - **FFALM Algorithm**: - By introducing fairness constraints into the global loss function and transforming it into a constrained minimization problem. - Using the Augmented Lagrangian Method to solve this problem, and using local training as a sub - solver to find the optimal model parameters. - Theoretically, the upper bound of the convergence rate of FFALM is derived as \(O\left(\frac{1}{T^{2/3}}\right)\), where \(T\) is the number of communication rounds. ### Experimental Verification - **Data Sets**: The CelebA and UTKFace data sets are used to predict attractiveness and whether the age is below 20 years old respectively, while considering gender and skin color as sensitive attributes. - **Experimental Results**: - On the CelebA data set, FFALM improves the DPD by about 11% and the EOD by about 14%. - On the UTKFace data set, FFALM improves the DPD by about 6% and reduces the EO gap by 6%. In conclusion, the main objective of this paper is to solve the severe statistical heterogeneity and group fairness problems in Federated Learning by proposing the FFALM algorithm, thereby improving the fairness of the model while maintaining the task performance.

Fairness-aware Federated Minimax Optimization with Convergence Guarantee

Minimax Demographic Group Fairness in Federated Learning

Multi-Dimensional Fair Federated Learning

Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning

Federating for Learning Group Fair Models

On ADMM in Heterogeneous Federated Learning: Personalization, Robustness, and Fairness

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

Solving a Class of Non-Convex Minimax Optimization in Federated Learning

A Stochastic Optimization Framework for Private and Fair Learning From Decentralized Data

FedMABA: Towards Fair Federated Learning through Multi-Armed Bandits Allocation

Fair Concurrent Training of Multiple Models in Federated Learning

Fairness-Aware Client Selection for Federated Learning

Proportional Fairness in Federated Learning

Federated Fairness Analytics: Quantifying Fairness in Federated Learning

Achieving Model Fairness in Vertical Federated Learning

Unified Group Fairness on Federated Learning

Fairness and Accuracy in Federated Learning

Anti-Matthew FL: Bridging the Performance Gap in Federated Learning to Counteract the Matthew Effect

Fair Federated Learning under Domain Skew with Local Consistency and Domain Diversity

Accelerating Fair Federated Learning: Adaptive Federated Adam

A Communication-efficient Algorithm with Linear Convergence for Federated Minimax Learning