Abstract:We study an optimal control problem of generalized mean-field dynamics with open-loop controls, where the coefficients depend not only on the state processes and controls, but also on the joint law of them. The value function $V$ defined in a conventional way, but it does not satisfy the Dynamic Programming Principle (DPP for short). For this reason we introduce subtly a novel value function $\vartheta$, which is closely related to the original value function $V$, such that, a description of $\vartheta$, as a solution of a partial differential equation (PDE), also characterizes $V$. We establish the DPP for $\vartheta$. By using an intrinsic notion of viscosity solutions, initially introduced in Burzoni, Ignazio, Reppen and Soner [8] and specifically tailored to our framework, we show that the value function $\vartheta$ is a viscosity solution to a Master Bellman equation on a subset of Wasserstein space of probability measures. The uniqueness of viscosity solution is proved for coefficients which depend on the time and the joint law of the control process and the controlled process. Our approach is inspired by Buckdahn, Li, Peng and Rainer [7], and leads to a generalization of the mean-field PDE in [7] to a Master Bellman equation in the case of controls.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the optimal control problem within the framework of generalized mean - field dynamics. Specifically, the researchers focus on a class of stochastic optimal control problems under open - loop control, where the coefficients depend not only on the state process and control, but also on their joint distribution law.
### Main Problems
1. **Dynamic Programming Principle (DPP) is not applicable**:
- The paper points out that the traditional value function \( V \) does not satisfy the Dynamic Programming Principle (DPP). Therefore, it is not possible to directly derive the partial differential equation (PDE) description related to \( V \) through DPP.
2. **Introduction of a new value function \( \vartheta \)**:
- To solve the above problem, the researchers introduce a new value function \( \vartheta \), which is closely related to the original value function \( V \) and can satisfy the Dynamic Programming Principle. This makes it possible to indirectly characterize \( V \) by studying \( \vartheta \).
3. **Existence and uniqueness of viscosity solutions**:
- The researchers use the concept of intrinsic viscosity solutions to prove that \( \vartheta \) is the unique viscosity solution of the Master Bellman equation in the Wasserstein space. This result is of great significance for understanding and solving such complex optimal control problems.
### Mathematical Formula Representation
- **State Equation**:
\[
X^{t, \zeta, u^2}_s=\zeta+\int_t^s b_1(r, (X^{t, \zeta, u^2}_r, u^2_r), P(X^{t, \zeta, u^2}_r, u^2_r)) dr+\int_t^s \sigma_1(r, (X^{t, \zeta, u^2}_r, u^2_r), P(X^{t, \zeta, u^2}_r, u^2_r)) dB_r,
\]
\[
X^{t, x, \zeta, u}_s = x+\int_t^s b_2(r, (X^{t, x, \zeta, u}_r, u^1_r), P(X^{t, \zeta, u^2}_r, u^2_r)) dr+\int_t^s \sigma_2(r, (X^{t, x, \zeta, u}_r, u^1_r), P(X^{t, \zeta, u^2}_r, u^2_r)) dB_r.
\]
- **Cost Functional**:
\[
J(t, x, \zeta, u):=\mathbb{E}\left[\Phi\left(X^{t, x, \zeta, u}_T, P_{X^{t, \zeta, u^2}_T}\right)\mid\mathcal{F}_t\right].
\]
- **Value Function \( V \)**:
\[
V(t, x, \zeta):=\text{essinf}_{u = (u^1, u^2)\in U_{t,T}} J(t, x, \zeta, u).
\]
- **New Value Function \( \vartheta \)**:
\[
\vartheta(t, \theta, P_\zeta):=\inf_{u^2\in U^0_{t,T}}\mathbb{E}\left[\text{essinf}_{u^1\in U^0_{t,T}}\mathbb{E}\left[\Phi\left(X^{t, \theta, \zeta, (u^1, u^2)}_T, P_{X^{t, \zeta, u^2}_T}\right)\mid\mathcal{F}_t\right]\right].