Abstract:In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only on the inputs and labels but also the differentials of the corresponding labels. This is motivated by the fact that differential deep learning can provide an efficient approximation of the labels and their derivatives with respect to inputs. The BSDEs are reformulated as differential deep learning problems by using Malliavin calculus. The Malliavin derivatives of solution to a BSDE satisfy themselves another BSDE, resulting thus in a system of BSDEs. Such formulation requires the estimation of the solution, its gradient, and the Hessian matrix, represented by the triple of processes $\left(Y, Z, \Gamma\right).$ All the integrals within this system are discretized by using the Euler-Maruyama method. Subsequently, DNNs are employed to approximate the triple of these unknown processes. The DNN parameters are backwardly optimized at each time step by minimizing a differential learning type loss function, which is defined as a weighted sum of the dynamics of the discretized BSDE system, with the first term providing the dynamics of the process $Y$ and the other the process $Z$. An error analysis is carried out to show the convergence of the proposed algorithm. Various numerical experiments up to $50$ dimensions are provided to demonstrate the high efficiency. Both theoretically and numerically, it is demonstrated that our proposed scheme is more efficient compared to other contemporary deep learning-based methodologies, especially in the computation of the process $\Gamma$.

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations

Convergence of the Deep BSDE Method for Coupled FBSDEs

Deep learning numerical methods for high-dimensional fully nonlinear PIDEs and coupled FBSDEs with jumps

Gradient boosting-based numerical methods for high-dimensional backward stochastic differential equations

Deep multi-step mixed algorithm for high dimensional non-linear PDEs and associated BSDEs

Deep Operator BSDE: a Numerical Scheme to Approximate the Solution Operators

A backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

Convergence of the Deep BSDE Method for FBSDEs with Non-Lipschitz Coefficients

Gauss Newton method for solving variational problems of PDEs with neural network discretizaitons

Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic control

Global Convergence of Deep Galerkin and PINNs Methods for Solving Partial Differential Equations

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

Continuous-time stochastic gradient descent for optimizing over the stationary distribution of stochastic differential equations

A test of backward stochastic differential equations solver for solving semilinear parabolic differential equations in 1D and 2D

A forward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

A Deep BSDE approximation of nonlinear integro-PDEs with unbounded nonlocal operators

Decentralized Stochastic Subgradient Methods for Nonsmooth Nonconvex Optimization

A backward SDE method for uncertainty quantification in deep learning