Abstract:A modified Deep BSDE (backward differential equation) learning method with measurability loss, called Deep BSDE-ML method, is introduced in this paper to solve a kind of linear decoupled forward-backward stochastic differential equations (FBSDEs), which is encountered in the policy evaluation of learning the optimal feedback policies of a class of stochastic control problems. The measurability loss is characterized via the measurability of BSDE's state at the forward initial time, which differs from that related to terminal state of the known Deep BSDE method. Though the minima of the two loss functions are shown to be equal, this measurability loss is proved to be equal to the expected mean squared error between the true diffusion term of BSDE and its approximation. This crucial observation extends the application of the Deep BSDE method -- approximating the gradients of the solution of a partial differential equation (PDE) instead of the solution itself. Simultaneously, a learning-based framework is introduced to search an optimal feedback control of a deterministic nonlinear system. Specifically, by introducing Gaussian exploration noise, we are aiming to learn a robust optimal controller under this stochastic case. This reformulation sacrifices the optimality to some extent, but as suggested in reinforcement learning (RL) exploration noise is essential to enable the model-free learning.

A deep primal-dual BSDE method for optimal stopping problems

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

A New Deep Neural Network Algorithm for Multiple Stopping with Applications in Options Pricing

Deep Penalty Methods: A Class of Deep Learning Algorithms for Solving High Dimensional Optimal Stopping Problems

Deep BSDE-ML Learning and Its Application to Model-Free Optimal Control

Neural optimal stopping boundary

Solving optimal stopping problems with Deep Q-Learning

Sequential Design for Optimal Stopping Problems

Deep-learning based numerical BSDE method for barrier options

Deep neural network expressivity for optimal stopping problems

Optimal Stopping via Randomized Neural Networks

Deep Learning Algorithms for Mean Field Optimal Stopping in Finite Space and Discrete Time

A deep solver for BSDEs with jumps

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

Convergence of the deep BSDE method for stochastic control problems formulated through the stochastic maximum principle

A backward SDE method for uncertainty quantification in deep learning

Learning to Optimally Stop a Diffusion Process

Reflected Backward Stochastic Difference Equations and Optimal Stopping Problems under G-Expectation

Recursive Optimal Stopping with Poisson Stopping Constraints

Deep Operator BSDE: a Numerical Scheme to Approximate the Solution Operators

Deep neural network framework based on backward stochastic differential equations for pricing and hedging American options in high dimensions