Abstract:Federated learning (FL) is a novel collaborative machine learning framework designed to preserve privacy while enabling the creation of robust models. This paradigm addresses a growing need for data security by allowing multiple participants to contribute to a model without exposing their individual datasets. A pivotal issue within this framework, however, concerns the fair and accurate attribution of contributions from various participants to the creation of the joint global model. Incorrect contribution distribution can erode trust among participants, result in inequitable compensation, and ultimately diminish the willingness of parties to engage or actively contribute to the federation. While several methods for remunerating participants have been proposed, little attention was given to the analysis of the stability of these methods when evaluating contributions, which is critical to ensure the long-term viability and fairness of FL systems. In this paper, we analyse this stability through the calculation of contributions by gradient-based model reconstruction techniques with Shapley values. Our investigation reveals that Shapley values fail to reflect baseline contributions, especially when employing different aggregation techniques. To address this issue, we extend on established aggregation techniques by introducing FedRandom, which is designed to sample contributions in a more equitable and distributed manner. We demonstrate that this approach not only serves as a viable aggregation technique but also significantly improves the accuracy of contribution assessment compared to traditional methods. Our results suggest that FedRandom enhances the overall fairness and stability of the federated learning system, making it a superior choice for federations with limited number of participants.

GTG-Shapley: Efficient and Accurate Participant Contribution Evaluation in Federated Learning

Evaluate the Contribution of Multiple Participants in Federated Learning

Efficient Participant Contribution Evaluation for Horizontal and Vertical Federated Learning

Optimizing Federated Learning on Non-IID Data Using Local Shapley Value.

FairFed: Improving Fairness and Efficiency of Contribution Evaluation in Federated Learning via Cooperative Shapley Value

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

DPVS-Shapley:Faster and Universal Contribution Evaluation Component in Federated Learning

Redefining Contributions: Shapley-Driven Federated Learning

A Principled Approach to Data Valuation for Federated Learning

A Fair Contribution Measurement Method for Federated Learning

Mitigating federated learning contribution allocation instability through randomized aggregation

ShapleyFL: Robust Federated Learning Based on Shapley Value

Fast, Robust and Interpretable Participant Contribution Estimation for Federated Learning

Shapley-value-based Contribution Evaluation in Federated Learning: A Survey

A Shapley value-enhanced evaluation technique for effective aggregation in Federated Learning

Don't Forget What I did?: Assessing Client Contributions in Federated Learning

Contributions Estimation in Federated Learning: A Comprehensive Experimental Evaluation

Improving Fairness for Data Valuation in Horizontal Federated Learning

Contribution Evaluation of Heterogeneous Participants in Federated Learning via Prototypical Representations

Fair and efficient contribution valuation for vertical federated learning

Contribution Evaluation in Federated Learning: Examining Current Approaches