Abstract:This paper is concerned with stochastic linear quadratic (LQ, for short) optimal control problems in an infinite horizon with conditional mean-field term in a switching regime environment. The orthogonal decomposition introduced in [21] has been adopted. Desired algebraic Riccati equations (AREs, for short) and a system of backward stochastic differential equations (BSDEs, for short) in infinite time horizon with the coefficients depending on the Markov chain have been derived. The determination of closed-loop optimal strategy follows from the solvability of ARE and BSDE. Moreover, the solvability of BSDEs leads to a characterization of open-loop solvability of the optimal control problem.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is about the stochastic linear - quadratic (LQ) optimal control problem in an infinite - time horizon, with conditional mean - field terms and in a Markov - switching environment. Specifically, the authors focus on how to find the optimal control strategy in such a complex dynamic environment so as to minimize the performance index of the system.
### Problem Background
The state equation considered in the paper is a controlled mean - field stochastic differential equation (SDE), and its coefficients depend on a Markov chain. This Markov chain introduces randomness in the state equation and the cost function. The specific state equation and cost function are as follows:
#### State Equation
\[
\begin{cases}
dX(t)=\left[A(\alpha(t))X(t)+\bar{A}(\alpha(t))E_t^\alpha[X(t)]+B(\alpha(t))u(t)+\bar{B}(\alpha(t))E_t^\alpha[u(t)]+b(t)\right]dt\\
\quad\quad+\left[C(\alpha(t))X(t)+\bar{C}(\alpha(t))E_t^\alpha[X(t)]+D(\alpha(t))u(t)+\bar{D}(\alpha(t))E_t^\alpha[u(t)]+\sigma(t)\right]dW(t),&t\geq s,\\
X(s)=\xi,\quad\alpha(s)=\iota\in M,
\end{cases}
\]
#### Cost Function
\[
J_\infty(s,\iota,\xi;u(\cdot)) = E\int_s^\infty f(t,\alpha(t),X(t),E_t^\alpha[X(t)],u(t),E_t^\alpha[u(t)])dt,
\]
where
\[
f(t,\iota,x,\bar{x},u,\bar{u})=\frac{1}{2}\left[\langle Q(\iota)x,x\rangle+2\langle S(\iota)x,u\rangle+\langle R(\iota)u,u\rangle+\langle\bar{Q}(\iota)\bar{x},\bar{x}\rangle+2\langle\bar{S}(\iota)\bar{x},\bar{u}\rangle+\langle\bar{R}(\iota)\bar{u},\bar{u}\rangle+2\langle q(t),x\rangle+2\langle\bar{q}(t),\bar{x}\rangle+2\langle r(t),u\rangle+2\langle\bar{r}(t),\bar{u}\rangle\right].
\]
### Main Contributions
1. **Well - posedness and Stability**: In order to make the cost function well - defined, it is necessary to ensure the appropriate stability and integrability of the state equation. New stability and integrability conditions are introduced in the paper, and it is proved that these conditions can ensure the well - definition of the problem under certain assumptions.
2. **Algebraic Riccati Equations (AREs) and Backward Stochastic Differential Equations (BSDEs)**: Through the method of completing the square, the algebraic Riccati equations related to the Markov chain and the backward stochastic differential equations in the infinite - time horizon are derived. The solutions of these equations determine the existence of the closed - loop optimal strategy.
3. **Relationship between Open - loop and Closed - loop Solutions**: The paper not only discusses the existence of the closed - loop solution, but also gives the characteristics of the open - loop solution, that is, it is described by the stationarity conditions of the forward - backward system coupling.