Abstract:In this work, we propose a novel backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations (BSDEs), where the deep neural network (DNN) models are trained not only on the inputs and labels but also the differentials of the corresponding labels. This is motivated by the fact that differential deep learning can provide an efficient approximation of the labels and their derivatives with respect to inputs. The BSDEs are reformulated as differential deep learning problems by using Malliavin calculus. The Malliavin derivatives of solution to a BSDE satisfy themselves another BSDE, resulting thus in a system of BSDEs. Such formulation requires the estimation of the solution, its gradient, and the Hessian matrix, represented by the triple of processes $\left(Y, Z, \Gamma\right).$ All the integrals within this system are discretized by using the Euler-Maruyama method. Subsequently, DNNs are employed to approximate the triple of these unknown processes. The DNN parameters are backwardly optimized at each time step by minimizing a differential learning type loss function, which is defined as a weighted sum of the dynamics of the discretized BSDE system, with the first term providing the dynamics of the process $Y$ and the other the process $Z$. An error analysis is carried out to show the convergence of the proposed algorithm. Various numerical experiments up to $50$ dimensions are provided to demonstrate the high efficiency. Both theoretically and numerically, it is demonstrated that our proposed scheme is more efficient compared to other contemporary deep learning-based methodologies, especially in the computation of the process $\Gamma$.

A backward SDE method for uncertainty quantification in deep learning

SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimates

Uncertainty quantification for deep learning-based schemes for solving high-dimensional backward stochastic differential equations

Milstein-driven neural stochastic differential equation model with uncertainty estimates

A backward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

Forward-Backward Stochastic Neural Networks: Deep Learning of High-dimensional Partial Differential Equations

Accurate and Reliable Forecasting using Stochastic Differential Equations

A forward differential deep learning-based algorithm for solving high-dimensional nonlinear backward stochastic differential equations

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

Gradient Convergence of Deep Learning-Based Numerical Methods for BSDEs

Neural Stochastic Differential Equations with Neural Processes Family Members for Uncertainty Estimation in Deep Learning

Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution

Solving High-Dimensional Forward-Backward Doubly SDEs and Their Related SPDEs Through Deep Learning

Safe Optimal Control Using Stochastic Barrier Functions and Deep Forward-Backward SDEs

Towards Robust and Stable Deep Learning Algorithms for Forward Backward Stochastic Differential Equations

Uncertainty Quantification in Neural Differential Equations

A Deep Learning Method for Solving Multi-Dimensional Coupled Forward–backward Doubly SDEs

Backward error analysis and the qualitative behaviour of stochastic optimization algorithms: Application to stochastic coordinate descent

Total Uncertainty Quantification in Inverse PDE Solutions Obtained with Reduced-Order Deep Learning Surrogate Models

Gradient boosting-based numerical methods for high-dimensional backward stochastic differential equations