Abstract:Federated learning (FL) is becoming a major driving force behind machine learning as a service, where customers (clients) collaboratively benefit from shared local updates under the orchestration of the service provider (server). Representing clients' current demands and the server's future demand, local model personalization and global model generalization are separately investigated, as the ill-effects of data heterogeneity enforce the community to focus on one over the other. However, these two seemingly competing goals are of equal importance rather than black and white issues, and should be achieved simultaneously. In this paper, we propose the first algorithm to balance personalization and generalization on top of game theory, dubbed PAGE, which reshapes FL as a co-opetition game between clients and the server. To explore the equilibrium, PAGE further formulates the game as Markov decision processes, and leverages the reinforcement learning algorithm, which simplifies the solving complexity. Extensive experiments on four widespread datasets show that PAGE outperforms state-of-the-art FL baselines in terms of global and local prediction accuracy simultaneously, and the accuracy can be improved by up to 35.20% and 39.91%, respectively. In addition, biased variants of PAGE imply promising adaptiveness to demand shifts in practice.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve a core challenge in Federated Learning (FL), that is, how to **strike a balance between Personalization and Generalization**. Specifically: 1. **The conflict between personalization and generalization**: - In typical Federated Learning (TFL), in order to achieve the generalization ability of the global model, the personalization requirements of local models are usually sacrificed. - In personalized Federated Learning (PFL), although customized local models can be provided for each client, the generalization ability of these models is poor and cannot well meet the initialization requirements of service providers for future new participants. 2. **The problem of data heterogeneity**: - Data heterogeneity (Non - i.i.d. data) is a fundamental challenge in Federated Learning. The data distributions of different clients vary greatly, resulting in a single global model being difficult to perform well on all clients. - In this case, the trade - off between personalization and generalization becomes more complex. 3. **The limitations of existing methods**: - Existing Federated Learning methods either focus on the generalization of the global model or on the personalization of the local model, but few methods can optimize both simultaneously. - Some methods attempt to balance the two through regularization terms, but with limited effectiveness. ### Proposed solution To solve the above problems, the author proposes a new algorithm - **PAGE (Personalization and Generalization Equilibrium)**. The main contributions of PAGE include: 1. **Establishing relationships based on game theory**: - Model the Federated Learning process as a multi - stage co - opetition game, in which the client and the server play the roles of leader and follower respectively. - Establish an implicit relationship between the global model and the local model through the feedback multi - stage multi - leader single - follower (MLSF) Stackelberg game. 2. **Simplifying the solution complexity**: - Reformulate the game problem as Markov Decision Processes (MDPs) and use the Deep Deterministic Policy Gradient (DDPG) algorithm to simplify the solution complexity. - Explore the equilibrium point through Reinforcement Learning (RL) to achieve the balance between personalization and generalization. 3. **Experimental verification**: - Conduct a large number of experiments on four widely - used datasets. The results show that PAGE outperforms the existing state - of - the - art methods (SOTA) in terms of global and local prediction accuracy, and in some cases, the accuracy is improved by 35.20% and 39.91% respectively. ### Summary In general, this paper proposes a new method to solve the balance problem between personalization and generalization in Federated Learning. Through the combination of game theory and reinforcement learning, this goal is successfully achieved, and its effectiveness is verified on multiple datasets.

PAGE: Equilibrate Personalization and Generalization in Federated Learning

Understanding the Training Dynamics in Federated Deep Learning via Aggregation Weight Optimization

FedPSE: Personalized Sparsification with Element-wise Aggregation for Federated Learning

FedDGP: Disentangling Global and Personal Models for Federated Learning

A Fair Federated Learning Framework with Reinforcement Learning.

Federated Deep Equilibrium Learning: Harnessing Compact Global Representations to Enhance Personalization

FedL2P: Federated Learning to Personalize

FedReMa: Improving Personalized Federated Learning via Leveraging the Most Relevant Clients

A Potential Game Perspective in Federated Learning

Personalized Federated Learning with Adaptive Feature Aggregation and Knowledge Transfer

Efficient Personalized Federated Learning via Sparse Model-Adaptation

PGFed: Personalize Each Client's Global Objective for Federated Learning

Personalized Federated Learning with First Order Model Optimization

Optimizing Personalized Federated Learning through Adaptive Layer-Wise Learning

Improving Global Generalization and Local Personalization for Federated Learning

Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning

Dap-FL: Federated Learning Flourishes by Adaptive Tuning and Secure Aggregation

Generalized Federated Learning via Gradient Norm-Aware Minimization and Control Variables

Group Personalized Federated Learning

Can Fair Federated Learning reduce the need for Personalisation?

Enhancing Group Fairness in Federated Learning through Personalization