Abstract:In this paper we study stochastic optimal control problems of fully coupled forward-backward stochastic differential equations (FBSDEs). The recursive cost functionals are defined by controlled fully coupled FBSDEs. We study two cases of diffusion coefficients $\sigma$ of FSDEs. We use a new method to prove that the value functions are deterministic, satisfy the dynamic programming principle (DPP), and are viscosity solutions to the associated generalized Hamilton-Jacobi-Bellman (HJB) equations. The associated generalized HJB equations are related with algebraic equations when $\sigma$ depends on the second component of the solution $(Y, Z)$ of the BSDE and doesn't depend on the control. For this we adopt Peng's BSDE method, and so in particular, the notion of stochastic backward semigroup in [16]. We emphasize that the fact that $\sigma$ also depends on $Z$ makes the stochastic control much more complicate and has as consequence that the associated HJB equation is combined with an algebraic equation, which is inspired by Wu and Yu [19]. We use the continuation method combined with the fixed point theorem to prove that the algebraic equation has a unique solution, and moreover, we also give the representation for this solution. On the other hand, we prove some new basic estimates for fully coupled FBSDEs under the monotonic assumptions. In particular, we prove under the Lipschitz and linear growth conditions that fully coupled FBSDEs have a unique solution on the small time interval, if the Lipschitz constant of $\sigma$\ with respect to $z$ is sufficiently small. We also establish a generalized comparison theorem for such fully coupled FBSDEs.

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic control

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

Convergence of the Deep BSDE Method for Coupled FBSDEs

A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEs

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

State Constrained Stochastic Optimal Control for Continuous and Hybrid Dynamical Systems Using DFBSDE

Convergence of the Deep BSDE Method for FBSDEs with Non-Lipschitz Coefficients

A novel control method for solving high-dimensional Hamiltonian systems through deep neural networks

Deep BSDE-ML Learning and Its Application to Model-Free Optimal Control

Dynamic programming principle for a controlled FBSDE system and associated extended HJB equation

Stochastic maximum principle, dynamic programming principle, and their relationship for fully coupled forward-backward stochastic controlled systems

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

A Global Stochastic Maximum Principle for Mean-Field Forward-Backward Stochastic Control Systems with Quadratic Generators

Safe Optimal Control Using Stochastic Barrier Functions and Deep Forward-Backward SDEs

Stochastic maximum principle, dynamic programming principle, and their relationship for fully coupled forward-backward stochastic control systems

Time-reversal solution of BSDEs in stochastic optimal control: a linear quadratic study

A backward SDE method for uncertainty quantification in deep learning

A deep learning algorithm for computing mean field control problems via forward-backward score dynamics

Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations

Convergence of deep fictitious play for stochastic differential games