Abstract:Abstract A novel discretization is presented for decoupled forward–backward stochastic differential equations (FBSDE) with differentiable coefficients, simultaneously solving the BSDE and its Malliavin sensitivity problem. The control process is estimated by the corresponding linear BSDE driving the trajectories of the Malliavin derivatives of the solution pair, which implies the need to provide accurate $\varGamma $ estimates. The approximation is based on a merged formulation given by the Feynman–Kac formulae and the Malliavin chain rule. The continuous time dynamics is discretized with a theta-scheme. In order to allow for an efficient numerical solution of the arising semidiscrete conditional expectations in possibly high dimensions, it is fundamental that the chosen approach admits to differentiable estimates. Two fully-implementable schemes are considered: the BCOS method as a reference in the one-dimensional framework and neural network Monte Carlo regressions in case of high-dimensional problems, similarly to the recently emerging class of Deep BSDE methods (Han et al. (2018 Solving high-dimensional partial differential equations using deep learning. Proc. Natl. Acad. Sci., 115, 8505–8510); Huré et al. (2020 Deep backward schemes for high-dimensional nonlinear PDEs. Math. Comp., 89, 1547–1579)). An error analysis is carried out to show $\mathbb{L}^2$ convergence of order $1/2$, under standard Lipschitz assumptions and additive noise in the forward diffusion. Numerical experiments are provided for a range of different semilinear equations up to $50$ dimensions, demonstrating that the proposed scheme yields a significant improvement in the control estimations.

Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic control

Convergence of the Deep BSDE Method for Coupled FBSDEs

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

Convergence of the Deep BSDE Method for FBSDEs with Non-Lipschitz Coefficients

Optimal control problems of fully coupled FBSDEs and viscosity solutions of Hamilton-Jacobi-Bellman equations

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEs

A Deep Learning Method for Solving Multi-Dimensional Coupled Forward–backward Doubly SDEs

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

The One Step Malliavin scheme: new discretization of BSDEs implemented with deep learning regressions

A Deep BSDE approximation of nonlinear integro-PDEs with unbounded nonlocal operators

Note on stochastic control problems related with general fully coupled forward-backward stochastic differential equations

Numerical Approximations of Coupled Forward-Backward SPDEs

A novel control method for solving high-dimensional Hamiltonian systems through deep neural networks

Dynamic programming principle for a controlled FBSDE system and associated extended HJB equation

State Constrained Stochastic Optimal Control for Continuous and Hybrid Dynamical Systems Using DFBSDE

Degenerate Mean Field Type Control with Linear and Unbounded Diffusion, and their Associated Equations

Deep learning numerical methods for high-dimensional fully nonlinear PIDEs and coupled FBSDEs with jumps

Fully Coupled Nonlinear FBS$Δ$Es: Solvability and LQ Control Insights

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

Three algorithms for solving high-dimensional fully-coupled FBSDEs through deep learning