Abstract:Federated Learning (FL) enables data owners to train a shared global model without sharing their private data. Unfortunately, FL is susceptible to an intrinsic fairness issue: due to heterogeneity in clients' data distributions, the final trained model can give disproportionate advantages across the participating clients. In this work, we present Equal and Equitable Federated Learning (E2FL) to produce fair federated learning models by preserving two main fairness properties, equity and equality, concurrently. We validate the efficiency and fairness of E2FL in different real-world FL applications, and show that E2FL outperforms existing baselines in terms of the resulting efficiency, fairness of different groups, and fairness among all individual clients.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the fairness issue in Federated Learning (FL), specifically the unfairness caused by the heterogeneity of client data distributions. In traditional federated learning, although the overall performance of the global model may be high, some tail - end users (whose data distributions are different from those of most other clients) may obtain performance far below the average level. This leads to representation disparity, resulting in an unfair performance gap among participating clients. ### Core of the Problem 1. **Two Dimensions of Fairness**: - **Equality**: Provide similar performance for all individual clients. - **Equity**: Provide similar performance for all groups (i.e., the majority group and the minority group), where a group refers to a set of clients with similar data distributions. 2. **Limitations of Existing Methods**: - When training a single global model, although all clients can share each other's knowledge, the model will be biased towards the group with the largest population. - Training multiple global models (such as IFCA, HypCluster, MOCHA, etc.) can improve fairness, but each global model will lose the knowledge from the excluded clients. ### Goals of E2FL E2FL (Equal and Equitable Federated Learning) aims to overcome these limitations by achieving both equality and fairness simultaneously. Specifically, E2FL attempts to answer the following key questions: - **Can an efficient federated learning algorithm be designed to achieve both equality and fairness simultaneously?** ### Solutions E2FL solves the above problems in the following ways: 1. **Multi - model Training and Aggregation**: - E2FL trains multiple global models, but in each round, all models are combined into one global model to utilize the knowledge of all client groups. 2. **Rank - based Optimization**: - Transform the model weight optimization problem into a model edge - ranking problem. Clients and servers exchange the edge rankings of neural networks (called hyper - networks) instead of parameter gradients. - Each client calculates the edge importance on its local data and represents it as a ranking vector. - The server uses a majority - voting mechanism to aggregate the collected local rankings into multiple global rankings, and then aggregates all group rankings into one global ranking. 3. **Ensuring Fairness**: - In E2FL, each client uses the global ranking of its group instead of the global ranking when using the model for downstream tasks, thus better representing the data of the client and its group members. - In this way, E2FL not only improves the overall performance but also significantly reduces the performance variance between clients and groups, achieving higher equality and fairness. ### Experimental Results Experiments show that E2FL outperforms existing fair FL algorithms (such as q - FFL) in various real - world heterogeneous FL settings. For example, on the FairMNISTRotate dataset, E2FL reduces the performance variance between clients and groups by 93% and 95% respectively, while q - FFL only reduces the client variance by 4% but increases the inter - group variance by 81%. In conclusion, by introducing a rank - based federated learning mechanism, E2FL successfully solves the fairness problem in federated learning and achieves better equality and fairness.

E2FL: Equal and Equitable Federated Learning

Achieving Fairness Across Local and Global Models in Federated Learning

FedEBA+: Towards Fair and Effective Federated Learning via Entropy-Based Model

FedFair^3: Unlocking Threefold Fairness in Federated Learning

Multi-Dimensional Fair Federated Learning

Federated Fairness Analytics: Quantifying Fairness in Federated Learning

Fairness-Aware Client Selection for Federated Learning

Eiffel: Efficient and Fair Scheduling in Adaptive Federated Learning

Fair Differentially Private Federated Learning Framework

WassFFed: Wasserstein Fair Federated Learning

A Fair Federated Learning Framework with Reinforcement Learning.

Fair Concurrent Training of Multiple Models in Federated Learning

GLOCALFAIR: Jointly Improving Global and Local Group Fairness in Federated Learning

AdaFed: Fair Federated Learning via Adaptive Common Descent Direction

Proportional Fairness in Federated Learning

Fairness Without Demographics in Human-Centered Federated Learning

Fair-select: a federated learning approach to ensure fairness in selection of participants

Toward the Tradeoffs between Privacy, Fairness and Utility in Federated Learning

Achieving Model Fairness in Vertical Federated Learning

Fairness and Accuracy in Federated Learning

Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learning