Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations

Juan Li,Qingmeng Wei
DOI: https://doi.org/10.48550/arXiv.1302.0935
2013-02-05
Abstract:In this paper we study stochastic optimal control problems of fully coupled forward-backward stochastic differential equations (FBSDEs). The recursive cost functionals are defined by controlled fully coupled FBSDEs. We study two cases of diffusion coefficients $\sigma$ of FSDEs. We use a new method to prove that the value functions are deterministic, satisfy the dynamic programming principle (DPP), and are viscosity solutions to the associated generalized Hamilton-Jacobi-Bellman (HJB) equations. The associated generalized HJB equations are related with algebraic equations when $\sigma$ depends on the second component of the solution $(Y, Z)$ of the BSDE and doesn't depend on the control. For this we adopt Peng's BSDE method, and so in particular, the notion of stochastic backward semigroup in [16]. We emphasize that the fact that $\sigma$ also depends on $Z$ makes the stochastic control much more complicate and has as consequence that the associated HJB equation is combined with an algebraic equation, which is inspired by Wu and Yu [19]. We use the continuation method combined with the fixed point theorem to prove that the algebraic equation has a unique solution, and moreover, we also give the representation for this solution. On the other hand, we prove some new basic estimates for fully coupled FBSDEs under the monotonic assumptions. In particular, we prove under the Lipschitz and linear growth conditions that fully coupled FBSDEs have a unique solution on the small time interval, if the Lipschitz constant of $\sigma$\ with respect to $z$ is sufficiently small. We also establish a generalized comparison theorem for such fully coupled FBSDEs.
Optimization and Control,Probability
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the optimal control problem in the framework of fully - coupled forward - backward stochastic differential equations (FBSDEs). Specifically, the paper studies the optimization problem of the state process described by fully - coupled forward - backward stochastic differential equations and its associated cost functional. The author considers two cases of the diffusion coefficient \(\sigma\) and uses a new method to prove that the value function is deterministic, satisfies the dynamic programming principle (DPP), and is a viscosity solution of the associated generalized Hamilton - Jacobi - Bellman (HJB) equation. ### Main contributions of the paper: 1. **Properties of the value function**: The paper proves that the value function is deterministic, satisfies the dynamic programming principle (DPP), and is continuous under certain conditions. 2. **Viscosity solution of the HJB equation**: The paper proves that the value function is a viscosity solution of the associated generalized HJB equation. For two different cases of the diffusion coefficient \(\sigma\), the specific forms of the HJB equations are given respectively. 3. **Technical details**: In order to prove the above results, the paper introduces the concept of stochastic backward semigroup and uses technical means such as monotonicity conditions and Lipschitz conditions. Especially in the case where \(\sigma\) depends on \(z\), the HJB equation is combined with an algebraic equation, which increases the complexity of the problem. The paper proves the existence of a unique solution to the algebraic equation by the continuity method and the fixed - point theorem. ### Specific problem description: - **First case**: \(\sigma\) does not depend on \(z\) but depends on the control variable \(u\). At this time, the associated HJB equation is: \[ \begin{cases} \frac{\partial W}{\partial t}(t,x)+H(t,x,W(t,x),DW(t,x),D^{2}W(t,x)) = 0, & (t,x)\in[0,T)\times\mathbb{R}^{n},\\ W(T,x)=\Phi(x), & x\in\mathbb{R}^{n}, \end{cases} \] where \[ H(t,x,y,p,X)=\sup_{u\in U}\left\{p\cdot b(t,x,y,p\cdot\sigma,u)+\frac{1}{2}\text{tr}(\sigma\sigma^{T}(t,x,y,u)X)+f(t,x,y,p\cdot\sigma,u)\right\}. \] - **Second case**: \(\sigma\) does not depend on \(u\) but depends on \(z\). At this time, the associated HJB equation is combined with an algebraic equation: \[ \begin{cases} \frac{\partial W}{\partial t}(t,x)+H(t,x,W(t,x),V(t,x)) = 0, & (t,x)\in[0,T)\times\mathbb{R}^{n},\\ V(t,x)=DW(t,x)\cdot\sigma(t,x,W(t,x),V(t,x)), & (t,x)\in[0,T)\times\mathbb{R}^{n},\\ W(T,x)=\Phi(x), & x\in\mathbb{R}^{n}, \end{cases} \] where \[ H(t,x,W(t,x),V(t,x))=\sup_{u\in U}\left\{DW(t,x)\cdot b(t,x,W(t,x),V(t,x),u)+\frac{1}{2}\text{tr}(\sigma\sigma^{T}(t,x,W(t,x),V(t,x))D^{2}W(t,x))+f(t,x,W(t,