Abstract:This paper studies the extended mean-field control problems with state-control joint law dependence and Poissonian common noise. We develop the stochastic maximum principle (SMP) and establish the connection to the Hamiltonian-Jacobi-Bellman (HJB) equation on the Wasserstein space. The presence of the conditional joint law in the McKean-Vlasov dynamics and its discontinuity caused by the Poissonian common noise bring us new technical challenges. To develop the SMP when the control domain is not necessarily convex, we first consider a strong relaxed control formulation that allows us to perform the first-order variation. We also propose the technique of extension transformation to overcome the compatibility issues arising from the joint law in the relaxed control formulation. By further establishing the equivalence between the relaxed control formulation and the strict control formulation, we obtain the SMP for the original problem in the strict control formulation. In the part to investigate the HJB equation, we formulate an auxiliary control problem subjecting to a controlled measure-valued dynamics with Poisson jumps, which allows us to derive the HJB equation of the original problem through an equivalence argument. We also show the connection between the SMP and HJB equation and give an illustrative example of linear quadratic extended mean-field control with Poissonian common noise.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about Extended Mean - Field Control Problems, especially in the presence of state - control joint law dependence and Poissonian common noise. Specifically, the paper mainly focuses on the following two aspects:
1. **Stochastic Maximum Principle (SMP)**:
- The authors develop the Stochastic Maximum Principle to provide necessary and sufficient conditions for optimal control. This includes performing first - order variations using a strong relaxed control formulation in non - convex control domains and proposing an extended transformation technique to overcome the compatibility problems brought by the joint law.
- Eventually, the SMP is established under a strict control formulation.
2. **Hamiltonian - Jacobi - Bellman Equation (HJB equation)**:
- The authors study the HJB equation in the Extended Mean - Field Control Problem with Poissonian common noise. By introducing an auxiliary control problem, they derive the HJB equation of the original problem and establish the connection between the SMP and the HJB equation.
- In particular, they show how to handle the discontinuities of the conditional joint law caused by Poissonian common noise and the impact of these discontinuities on the value function.
### Formula Representation
- **Stochastic Differential Equation (SDE)**:
\[
dX_t = b(X_t, L((X_t, \alpha_t)|\mathcal{G}_t), \alpha_t)dt+\sigma(X_t, L((X_t, \alpha_t)|\mathcal{G}_t), \alpha_t)dW_t+\int_Z\gamma(X_{t^-}, L((X_{t^-}, \alpha_{t^-})|\mathcal{G}_{t^-}), \alpha_{t^-}, z)\tilde{N}(dt, dz)
\]
where $\tilde{N}(dz, dt):=N(dz, dt)-\lambda(dz)dt$ is the compensated Poisson random measure.
- **Objective Functional**:
\[
J(\alpha):=\mathbb{E}\left[\int_0^T f(X_t, L((X_t, \alpha_t)|\mathcal{G}_t), \alpha_t)dt + g(X_T, L(X_T|\mathcal{G}_T))\right]
\]
- **Initial Condition**:
\[
L(X_0)=\mu\in\mathcal{P}_2(\mathbb{R}^n)
\]
### Main Contributions of the Paper
1. **Establishing the SMP for Extended MFC Problems**: Under general control domains (not necessarily convex), it provides necessary and sufficient conditions for optimal control.
2. **Deriving the HJB Equation and Establishing the Relationship with SMP**: Especially in the presence of Poissonian common noise, it solves the problem of discontinuities in the conditional joint law.
Through these methods, the paper makes important contributions to the theoretical basis of Extended Mean - Field Control Problems under Poissonian common noise.