A Control Theoretical Approach to Mean Field Games and Associated Master Equations

Alain Bensoussan,Ho Man Tai,Tak Kwong Wong,Sheung Chi Phillip Yam

2024-02-03

Abstract:We prove the global-in-time well-posedness for a broad class of mean field game problems, which is beyond the special linear-quadratic setting, as long as the mean field sensitivity is not too large. Through the stochastic maximum principle, we adopt the FBSDE approach to investigate the unique existence of the corresponding equilibrium strategies. The corresponding FBSDEs are first solved locally in time, then by controlling the sensitivity of the backward solutions with respect to the initial condition via some suitable apriori estimates for the corresponding Jacobian flows, the global-in-time solution is warranted. Further analysis on these Jacobian flows will be discussed to establish the regularities, such as linear functional differentiability, of the respective value functions that leads to the ultimate classical well-posedness of the master equation on $\mathbb{R}^d$. To the best of our knowledge, it is the first article to deal with the mean field game problem, as well as its associated master equation, with general cost functionals having quadratic growth under the small mean field effect. In this current approach, we directly impose the structural conditions on the cost functionals, rather than conditions on the Hamiltonian. The advantages of this are threefold: (i) compared with imposing conditions on Hamiltonian, the structural conditions imposed in this work are easily verified, and less demanding on the regularity requirements of the cost functionals while solving the master equation; (ii) the displacement monotonicity is basically just a direct consequence of small mean field effect in the structural conditions; and (iii) when the mean field effect is not that small, we can still provide an accurate lifespan for the local existence. The method in this work can be readily extended to the case with nonlinear drift and non-separable cost functionals.

Optimization and Control

What problem does this paper attempt to address?

The paper is primarily dedicated to addressing the global well-posedness of a broad class of mean field game problems and their associated master equations. Specifically, the authors focus on the existence and uniqueness of solutions to these problems when the mean field effect is not particularly strong.

The main contributions of the paper can be summarized as follows:

1. **Proposed a new theoretical framework**: The authors studied the existence and uniqueness of the corresponding equilibrium strategy using the stochastic maximum principle and the method of forward-backward stochastic differential equations (FBSDE). This approach first locally solves the associated FBSDE system and then ensures the existence of a global solution by controlling the sensitivity of the backward solution to the initial conditions.

2. **Addressed the global well-posedness of the FBSDE system**: To obtain a global solution, it is necessary to control the sensitivity of the backward part of the FBSDE solution to the initial conditions. This is achieved by estimating the bounds of the Jacobian flow of the FBSDE solution, based on the convexity of the cost function, the smallness assumption of the mean field effect, and the Schur complement of the running cost Hessian matrix.

3. **Well-posedness of the master equation**: The authors further investigated the regularity of the value function with respect to the initial conditions and used Itô's lemma to prove that the value function satisfies the HJB equation. By analyzing the properties of the value function \(U(x,m,t)\) and its linear functional derivative \(dU/d\nu(x,m,t)(x')\) in equilibrium, they established the global well-posedness of the master equation.

4. **Comparison of new assumptions with existing methods**: The authors' assumptions differ from the commonly used Lasry-Lions monotonicity or displacement monotonicity in previous studies. These assumptions are easier to verify and impose weaker requirements on the cost function. Additionally, this method requires lower regularity of the coefficient functions, allowing for a wider range of nonlinear drift terms.

5. **Scalability and flexibility**: The method is not only applicable to linear-quadratic models but can also handle nonlinear drift terms and non-separable cost functions by adjusting the assumptions, thereby enhancing the flexibility and applicability of the model.

In summary, this paper provides a new approach to solving general mean field game problems, particularly when the mean field effect is small, and offers robust mathematical tools for the well-posedness of the associated master equations.