Backward Linear-Quadratic Mean Field Stochastic Differential Games: A Direct Method

Yu Si,Jingtao Shi
2024-11-28
Abstract:This paper studies a linear-quadratic mean-field game of stochastic large-population system, where the large-population system satisfies a class of $N$ weakly coupled linear backward stochastic differential equation. Different from the fixed-point approach commonly used to address large population problems, we first directly apply the maximum principle and decoupling techniques to solve a multi-agent problem, obtaining a centralized optimal strategy. Then, by letting $N$ tend to infinity, we establish a decentralized optimal strategy. Subsequently, we prove that the decentralized optimal strategy constitutes an $\epsilon$-Nash equilibrium for this game. Finally, we provide a numerical example to simulate our results.
Optimization and Control
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the dynamic optimization problem of linear - quadratic mean - field games (MFG) in large - scale population systems, especially when the system satisfies a class of N weakly - coupled linear backward stochastic differential equations (BSDE). Specifically: 1. **Problem Background**: - A large - scale population system consists of a large number of interacting individuals. Each individual has a small influence, but the overall behavior is significant. - Such systems have wide applications in engineering, finance, and social sciences, etc. - Traditional centralized strategies are difficult to implement because they rely on the information of all individuals. 2. **Research Objectives**: - A new class of linear - quadratic backward mean - field games (LQ backward MFG) is introduced, in which the state equation is a weakly - coupled backward stochastic differential equation. - Compared with the commonly used fixed - point method, this paper adopts the direct method to solve the problem. - By applying the maximum principle and decoupling techniques, the multi - agent problem is solved to obtain a centralized optimal strategy. - As the number of individuals \( N \) tends to infinity, a decentralized optimal strategy is established and it is proved to form an \( \epsilon \)-Nash equilibrium. 3. **Main Contributions**: - The linear - quadratic mean - field game of the backward stochastic system is introduced, which extends the research scope of the existing literature. - The direct method is proposed to solve large - scale population problems, avoiding the complexity of the traditional fixed - point method. - The effectiveness of the theoretical results is verified by numerical simulation. 4. **Specific Problem Description**: - **Problem 2.1**: Find a Nash equilibrium strategy \( u^*(\cdot)=(u_1^*(\cdot),\ldots,u_N^*(\cdot)) \) such that the cost function of each individual is minimized. - **Problem 2.2**: For a given \( \epsilon > 0 \), find an \( \epsilon \)-Nash equilibrium strategy \( u^*(\cdot)=(u_1^*(\cdot),\ldots,u_N^*(\cdot)) \) such that the cost function of each individual is close to the optimal. 5. **Key Formulas**: - The state equation is: \[ dx_i(t)=[A(t)x_i(t)+B(t)u_i(t)]dt+\sum_{j = 1}^N z_{ij}(t)dW_j(t),\quad x_i(T)=\xi_i \] - The cost function is: \[ J_i(u_i(\cdot);u_{-i}(\cdot))=\frac{1}{2}\mathbb{E}\left[\int_0^T\left(\|x_i(t)-\Gamma_1(t)x^{(N)}(t)-\eta_1(t)\|_Q^2+\|u_i(t)\|_R^2+\sum_{j = 1}^N\|z_{ij}(t)\|_{S_j}^2\right)dt+\|x_i(0)-\Gamma_0x^{(N)}(0)-\eta_0\|_G^2\right] \] 6. **Conclusion**: - Through the direct method, the centralized and decentralized optimal strategies are obtained. - It is proved that the decentralized strategy forms an \( \epsilon \)-Nash equilibrium, and the error term \( \epsilon = O\left(\frac{1}{\sqrt{N}}\right) \). - Numerical simulation verifies the effectiveness of the theoretical results. In summary, this paper aims to solve the linear - quadratic backward mean - field game problem of large - scale population systems by introducing the direct method and provides an effective decentralized strategy and its...