Abstract:Conventional federated learning frameworks suffer from several challenges including performance bottlenecks at the central aggregation server, data bias, poor model convergence, and exposure to model poisoning attacks, and limited trust in the centralized infrastructure. In the current paper, a novel game theory-based approach called pFedGame is proposed for decentralized federated learning, best suitable for temporally dynamic networks. The proposed algorithm works without any centralized server for aggregation and incorporates the problem of vanishing gradients and poor convergence over temporally dynamic topology among federated learning participants. The solution comprises two sequential steps in every federated learning round, for every participant. First, it selects suitable peers for collaboration in federated learning. Secondly, it executes a two-player constant sum cooperative game to reach convergence by applying an optimal federated learning aggregation strategy. Experiments performed to assess the performance of pFedGame in comparison to existing methods in decentralized federated learning have shown promising results with accuracy higher than 70% for heterogeneous data.

What problem does this paper attempt to address?

The problems that this paper attempts to solve are several common challenges in Federated Learning (FL), including: 1. **Performance Bottleneck of the Central Aggregation Server**: In the traditional federated learning framework, all participants' models need to be uploaded to the central server for aggregation, which may lead to performance bottlenecks, especially when the number of participants is large or the network conditions are poor. 2. **Data Bias**: Since the data distributions of different participants may be very heterogeneous, the central aggregation model may be affected by data bias, resulting in a decline in model performance. 3. **Poor Model Convergence**: Under highly heterogeneous data distributions, the convergence speed of the federated learning model may be very slow or even unable to converge. 4. **Model Poisoning Attacks**: The existence of the central aggregation server makes the federated learning system vulnerable to model poisoning attacks, that is, malicious participants can submit tampered model updates, affecting the accuracy of the global model. 5. **Low Trust in Central Infrastructure**: Federated learning systems that rely on central servers may face trust issues, especially when participants come from different organizations or institutions. To solve these problems, the paper proposes a decentralized federated learning method based on game theory - **pFedGame**. The main features of this method include: - **Decentralization**: pFedGame does not require a central aggregation server, and each participant can directly communicate and collaborate with other participants locally. - **Dynamic Topology Adaptation**: pFedGame can adapt to the dynamic changes of network topology and is suitable for network environments that change dynamically over time. - **Two - step Method**: In each round of federated learning, participants first select appropriate collaboration partners, and then achieve the convergence of model aggregation through a two - person cooperative game. Specifically, the working process of pFedGame is as follows: 1. **Select Appropriate Collaboration Partners**: Each participant selects appropriate collaboration partners according to certain conditions (such as the performance of the model on local data). 2. **Execute Game Aggregation**: Participants execute a two - person cooperative game with their selected partners, and adjust the weights of their respective models to achieve the optimal aggregation results. Through this method, pFedGame can achieve efficient model aggregation without a central server, and shows good performance under highly heterogeneous data distributions. Experimental results show that pFedGame performs better than existing decentralized federated learning methods on multiple datasets.

pFedGame -- Decentralized Federated Learning using Game Theory in Dynamic Topology

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Decentralized Federated Learning under Communication Delays.

BlockDFL: A Blockchain-based Fully Decentralized Peer-to-Peer Federated Learning Framework

FedECADO: A Dynamical System Model of Federated Learning

A Potential Game Perspective in Federated Learning

Game of Gradients: Mitigating Irrelevant Clients in Federated Learning

Federated Learning as a Mean-Field Game

A Multi-Player Game for Studying Federated Learning Incentive Schemes

Decentralized Directed Collaboration for Personalized Federated Learning

On the Convergence of Decentralized Federated Learning Under Imperfect Information Sharing

Decentralized Sporadic Federated Learning: A Unified Algorithmic Framework with Convergence Guarantees

WPFed: Web-based Personalized Federation for Decentralized Systems

Decentralized Federated Learning: A Segmented Gossip Approach

Parallel Successive Learning for Dynamic Distributed Model Training over Heterogeneous Wireless Networks

Optimality and Stability in Federated Learning: A Game-theoretic Approach

FedEP: Tailoring Attention to Heterogeneous Data Distribution with Entropy Pooling for Decentralized Federated Learning

Adaptive Configuration for Heterogeneous Participants in Decentralized Federated Learning

Graph Federated Learning Based on the Decentralized Framework

When Decentralized Optimization Meets Federated Learning