Abstract:Federated learning (FL) is a novel collaborative machine learning framework designed to preserve privacy while enabling the creation of robust models. This paradigm addresses a growing need for data security by allowing multiple participants to contribute to a model without exposing their individual datasets. A pivotal issue within this framework, however, concerns the fair and accurate attribution of contributions from various participants to the creation of the joint global model. Incorrect contribution distribution can erode trust among participants, result in inequitable compensation, and ultimately diminish the willingness of parties to engage or actively contribute to the federation. While several methods for remunerating participants have been proposed, little attention was given to the analysis of the stability of these methods when evaluating contributions, which is critical to ensure the long-term viability and fairness of FL systems. In this paper, we analyse this stability through the calculation of contributions by gradient-based model reconstruction techniques with Shapley values. Our investigation reveals that Shapley values fail to reflect baseline contributions, especially when employing different aggregation techniques. To address this issue, we extend on established aggregation techniques by introducing FedRandom, which is designed to sample contributions in a more equitable and distributed manner. We demonstrate that this approach not only serves as a viable aggregation technique but also significantly improves the accuracy of contribution assessment compared to traditional methods. Our results suggest that FedRandom enhances the overall fairness and stability of the federated learning system, making it a superior choice for federations with limited number of participants.

FairFed: Improving Fairness and Efficiency of Contribution Evaluation in Federated Learning via Cooperative Shapley Value

Evaluate the Contribution of Multiple Participants in Federated Learning

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Redefining Contributions: Shapley-Driven Federated Learning

A Fair Contribution Measurement Method for Federated Learning

PoShapley-BCFL: A Fair and Robust Decentralized Federated Learning Based on Blockchain and the Proof of Shapley-Value

Fair and efficient contribution valuation for vertical federated learning

Efficient Participant Contribution Evaluation for Horizontal and Vertical Federated Learning

Improving Fairness for Data Valuation in Horizontal Federated Learning

GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning

DPVS-Shapley:Faster and Universal Contribution Evaluation Component in Federated Learning

Contributions Estimation in Federated Learning: A Comprehensive Experimental Evaluation

A Principled Approach to Data Valuation for Federated Learning

Fast, Robust and Interpretable Participant Contribution Estimation for Federated Learning

FedFAIM: A Model Performance-based Fair Incentive Mechanism for Federated Learning

ShapleyFL: Robust Federated Learning Based on Shapley Value

Mitigating federated learning contribution allocation instability through randomized aggregation

Shapley-value-based Contribution Evaluation in Federated Learning: A Survey

FedFair^3: Unlocking Threefold Fairness in Federated Learning

Don't Forget What I did?: Assessing Client Contributions in Federated Learning