Abstract:A modified Deep BSDE (backward differential equation) learning method with measurability loss, called Deep BSDE-ML method, is introduced in this paper to solve a kind of linear decoupled forward-backward stochastic differential equations (FBSDEs), which is encountered in the policy evaluation of learning the optimal feedback policies of a class of stochastic control problems. The measurability loss is characterized via the measurability of BSDE's state at the forward initial time, which differs from that related to terminal state of the known Deep BSDE method. Though the minima of the two loss functions are shown to be equal, this measurability loss is proved to be equal to the expected mean squared error between the true diffusion term of BSDE and its approximation. This crucial observation extends the application of the Deep BSDE method -- approximating the gradients of the solution of a partial differential equation (PDE) instead of the solution itself. Simultaneously, a learning-based framework is introduced to search an optimal feedback control of a deterministic nonlinear system. Specifically, by introducing Gaussian exploration noise, we are aiming to learn a robust optimal controller under this stochastic case. This reformulation sacrifices the optimality to some extent, but as suggested in reinforcement learning (RL) exploration noise is essential to enable the model-free learning.

A deep learning method for solving stochastic optimal control problems driven by fully-coupled FBSDEs

A Deep Learning Method for Solving Multi-Dimensional Coupled Forward–backward Doubly SDEs

Three algorithms for solving high-dimensional fully-coupled FBSDEs through deep learning

Solving Stochastic Optimal Control Problem Via Stochastic Maximum Principle with Deep Learning Method

Deep Graphic FBSDEs for Opinion Dynamics Stochastic Control

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

A novel control method for solving high-dimensional Hamiltonian systems through deep neural networks

State Constrained Stochastic Optimal Control for Continuous and Hybrid Dynamical Systems Using DFBSDE

Deep Learning Method for Solving Stochastic Optimal Control Problem Via Stochastic Maximum Principle.

Deep BSDE-ML Learning and Its Application to Model-Free Optimal Control

Towards Robust and Stable Deep Learning Algorithms for Forward Backward Stochastic Differential Equations

Solving High-Dimensional Forward-Backward Doubly SDEs and Their Related SPDEs Through Deep Learning

Generalized convergence of the deep BSDE method: a step towards fully-coupled FBSDEs and applications in stochastic control

Deep Learning Approximation for Stochastic Control Problems.

Solution to Forward-Backward Stochastic Differential Equations with Random Coefficients and Application to Deterministic Optimal Control

Deep learning numerical methods for high-dimensional fully nonlinear PIDEs and coupled FBSDEs with jumps

A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economics

Introduction to Solving Quant Finance Problems with Time-Stepped FBSDE and Deep Learning

FBSJNN: A Theoretically Interpretable and Efficiently Deep Learning method for Solving Partial Integro-Differential Equations

Nonlinear Optimal Control Based on FBDEs and its Application to AGV

Numerical Method for Multi-Dimensional Coupled Forward-Backward Stochastic Differential Equations Based on Fractional Fourier Fast Transform