Abstract:In this note, we study a class of indefinite stochastic McKean-Vlasov linear-quadratic (LQ in short) control problem under the control taking nonnegative values. In contrast to the conventional issue, both the classical dynamic programming principle (DPP in short) and the usual Riccati equation approach fail. We tackle these difficulties by extending the state space from $\mathbb{R}$ to probability measure space, afterward derive the the corresponding the infinite dimensional Hamilton--Jacobi--Bellman (HJB in short) equation. The optimal control and value function can be obtained basing on two functions constructed via two groups of novelty ordinary differential equations satisfying the HJB equation mentioned before. As an application, we revisit the mean-variance portfolio selection problems in continuous time under the constraint that short-selling of stocks is prohibited. The investment risk and the capital market line can be captured simultaneously.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to solve a class of uncertain stochastic McKean - Vlasov linear - quadratic (LQ) control problems when the control variables take non - negative values. Specifically, the paper focuses on the uncertain stochastic McKean - Vlasov LQ control problem under input constraints. The characteristic of this kind of problem is that the control variables must be non - negative, which is very common in practical applications, such as in the continuous - time mean - variance portfolio selection problem where short - selling of stocks is not allowed.
### Background and Challenges of the Paper
The traditional dynamic programming principle (DPP) and the usual Riccati equation method fail in this case because the distribution laws of the processes appear in the coefficients of the problem and there is a non - linear dependence on these distribution laws. Therefore, this kind of problem actually belongs to the time - inconsistent framework.
### Solutions
To overcome these difficulties, the author extends the state space from the real number space \( \mathbb{R} \) to the probability measure space, thereby deriving the corresponding infinite - dimensional Hamilton - Jacobi - Bellman (HJB) equation. By constructing two new ordinary differential equation systems, the optimal control and the value function can be obtained.
### Specific Steps
1. **Extend the State Space**: Extend the state space from \( \mathbb{R} \) to the probability measure space.
2. **Derive the HJB Equation**: Derive the infinite - dimensional HJB equation in the probability measure space.
3. **Construct Functions**: Solve the HJB equation by constructing two new ordinary differential equation systems, thereby obtaining the optimal control and the value function.
### Application Examples
As an application, the paper re - studies the continuous - time mean - variance portfolio selection problem under the condition of prohibiting short - selling of stocks. Through the above method, the investment risk and the capital market line can be captured simultaneously.
### Mathematical Model
Consider the following dynamic equations of the stochastic control system:
\[
\begin{cases}
dX(s)=\left[AX_s+\bar{A}\mathbb{E}[X(s)] + Bu(s)+b_0\right]ds+\sum_{j = 1}^mD_ju(s)dW_j(s),\\
X(t)=\xi\in L^2(G\vee\mathcal{F}_t;\mathbb{R}^n),
\end{cases}
\]
where \( \xi \) is the initial condition, and \( A,\bar{A},B,D_j \) are system parameters, and \( W_j(s) \) is a standard Brownian motion.
The cost functional is defined as:
\[
J(u(\cdot))=\mathbb{E}\left[G_1X_T^2+G_2(\mathbb{E}[X(T)])^2+G_3X_T+\int_t^T\left(Q_1X_s^2+Q_2(\mathbb{E}[X(s)])^2+Q_3X_s\right)ds\right].
\]
### Value Function
The goal is to minimize the cost functional, and the value function is defined as:
\[
V(t,\xi)=\inf_{u\in U_{2,+}^{ad}[0,T]}J(t,\xi,u).
\]
### HJB Equation
The derived HJB equation is:
\[
\begin{cases}
\partial_tV(t,\mu)+\inf_{u\in\mathbb{R}^m_+}\mathbb{E}\left[H(\xi,u,\mu,\partial_\mu V(t,\mu,\xi),\partial_x\partial_\mu V(t,\mu,\xi)\sigma(\xi,u,\mu))\right]=0,\\
V(T,\mu)=\langle\Phi(\cdot,\mu),\mu\rangle
\end{cases}