Abstract:The paradigm of Federated learning (FL) deals with multiple clients participating in collaborative training of a machine learning model under the orchestration of a central server. In this setup, each client's data is private to itself and is not transferable to other clients or the server. Though FL paradigm has received significant interest recently from the research community, the problem of selecting the relevant clients w.r.t. the central server's learning objective is under-explored. We refer to these problems as Federated Relevant Client Selection (FRCS). Because the server doesn't have explicit control over the nature of data possessed by each client, the problem of selecting relevant clients is significantly complex in FL settings. In this paper, we resolve important and related FRCS problems viz., selecting clients with relevant data, detecting clients that possess data relevant to a particular target label, and rectifying corrupted data samples of individual clients. We follow a principled approach to address the above FRCS problems and develop a new federated learning method using the Shapley value concept from cooperative game theory. Towards this end, we propose a cooperative game involving the gradients shared by the clients. Using this game, we compute Shapley values of clients and then present Shapley value based Federated Averaging (S-FedAvg) algorithm that empowers the server to select relevant clients with high probability. S-FedAvg turns out to be critical in designing specific algorithms to address the FRCS problems. We finally conduct a thorough empirical analysis on image classification and speech recognition tasks to show the superior performance of S-FedAvg than the baselines in the context of supervised federated learning settings.

Federated Learning as a Mean-Field Game

Reputation-Aware Incentive Mechanism of Federated Learning: A Mean Field Game Approach

pFedGame -- Decentralized Federated Learning using Game Theory in Dynamic Topology

A Generalized Look at Federated Learning: Survey and Perspectives

Optimality and Stability in Federated Learning: A Game-theoretic Approach

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

A Potential Game Perspective in Federated Learning

Federated Machine Learning: Concept and Applications

Federated Learning: Challenges, Methods, and Future Directions

Federated Learning in Practice: Reflections and Projections

Federated Learning Meets Fairness and Differential Privacy

Federating for Learning Group Fair Models

Federated Learning -- Methods, Applications and beyond

"Federated Learning: Advancements, Applications, and Future Directions for Collaborative Machine Learning in Distributed Environments"

Fairness-aware Agnostic Federated Learning

Graph Federated Learning Based on the Decentralized Framework

A Multi-Player Game for Studying Federated Learning Incentive Schemes

A Robust Game-theoretical Federated Learning Framework with Joint Differential Privacy

Game of Gradients: Mitigating Irrelevant Clients in Federated Learning

From distributed machine learning to federated learning: In the view of data privacy and security

A Game-theoretic Framework for Privacy-preserving Federated Learning