Abstract:In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only on the inputs and labels but also the differentials of the corresponding labels. This is motivated by the fact that differential deep learning can provide an efficient approximation of the labels and their derivatives with respect to inputs. The BSDEs are reformulated as differential deep learning problems by using Malliavin calculus. The Malliavin derivatives of solution to a BSDE satisfy themselves another BSDE, resulting thus in a system of BSDEs. Such formulation requires the estimation of the solution, its gradient, and the Hessian matrix, represented by the triple of processes $\left(Y, Z, \Gamma\right).$ All the integrals within this system are discretized by using the Euler-Maruyama method. Subsequently, DNNs are employed to approximate the triple of these unknown processes. The DNN parameters are backwardly optimized at each time step by minimizing a differential learning type loss function, which is defined as a weighted sum of the dynamics of the discretized BSDE system, with the first term providing the dynamics of the process $Y$ and the other the process $Z$. An error analysis is carried out to show the convergence of the proposed algorithm. Various numerical experiments up to $50$ dimensions are provided to demonstrate the high efficiency. Both theoretically and numerically, it is demonstrated that our proposed scheme is more efficient compared to other contemporary deep learning-based methodologies, especially in the computation of the process $\Gamma$.

Gradient boosting-based numerical methods for high-dimensional backward stochastic differential equations

A forward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

A backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations

A New Kind of Accurate Numerical Method for Backward Stochastic Differential Equations

Hybrid Neural Networks for Solving Fully Coupled, High-Dimensional Forward–Backward Stochastic Differential Equations

Deep multi-step mixed algorithm for high dimensional non-linear PDEs and associated BSDEs

An Efficient High-Dimensional Gradient Estimator for Stochastic Differential Equations

Solving High-Dimensional Forward-Backward Doubly SDEs and Their Related SPDEs Through Deep Learning

Towards Robust and Stable Deep Learning Algorithms for Forward Backward Stochastic Differential Equations

One-Step Multi-Derivative Methods for Backward Stochastic Differential Equations

Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Numerical Algorithms for Backward Stochastic Differential Equations with 1-D Brownian Motion: Convergence and Simulations

A backward SDE method for uncertainty quantification in deep learning

A test of backward stochastic differential equations solver for solving semilinear parabolic differential equations in 1D and 2D

Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations

Numerical methods for backward stochastic differential equations: A survey

Scalable Gradients for Stochastic Differential Equations

Numerical Computations for Backward Doubly SDEs and SPDEs