Abstract:In this paper, we propose deep learning algorithms for ranking response surfaces with applications to optimal stopping problems in financial mathematics. The problem of ranking response surfaces is motivated by estimating optimal feedback policy maps in stochastic control problems, aiming to efficiently find the index associated with the minimal response across the entire continuous input space <math>X⊆Rd</math>. By considering points in <math>X</math> as pixels and indices of the minimal surfaces as labels, we recast the problem as an image segmentation problem which assigns a label to every pixel in an image with pixels with the same label sharing certain characteristics. This provides an alternative method for efficiently solving the problem instead of using sequential design as in our previous work [R. Hu and M. Ludkovski, Sequential design for ranking response surfaces. SIAM/ASA J. Uncertain. Quantif., 2017, 5, 212–239]. Deep learning algorithms are scalable, parallel and model-free, i.e. no parametric assumptions are needed for response surfaces. Considering ranking response surfaces as image segmentation allows one to use a broad class of deep neural networks (NNs), e.g. feed-forward NNs, UNet, SegNet, DeconvNet, which have been widely applied and numerically proven to possess good performance in the field. We also systematically study the dependence of deep learning algorithms on the input data generated on uniform grids or by sequential design sampling and observe that the performance of deep learning is not sensitive to the noise and location (close to/away from boundaries) of training data. We present a few examples, including synthetic ones and the Bermudan option pricing problem, to show the efficiency and accuracy of this method. We also simulate a 10-dimensional example to demonstrate robustness, while non-learning algorithms in general have difficulties in such high dimensions.

Deep learning for ranking response surfaces with applications to optimal stopping problems

Sequential Design for Ranking Response Surfaces

An intelligent response surface method for analyzing slope reliability based on Gaussian process regression

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

Deep Learning Algorithms for Mean Field Optimal Stopping in Finite Space and Discrete Time

Solving the optimal stopping problem with reinforcement learning: an application in financial option exercise

Efficient Low-Rank Semidefinite Programming With Robust Loss Functions

A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economics

Recent Developments in Machine Learning Methods for Stochastic Control and Games

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

Deep Learning for Explicitly Modeling Optimization Landscapes

Optimal Stopping via Randomized Neural Networks

Globally Optimal Segmentation of Mutually Interacting Surfaces using Deep Learning

Application of deep and reinforcement learning to boundary control problems

Solving Non-linear Kolmogorov Equations in Large Dimensions by Using Deep Learning: A Numerical Comparison of Discretization Schemes

A Modified Stochastic Response Surface Algorithm for Expensive Black-Box Global Optimization

Deep neural network expressivity for optimal stopping problems

Local Randomized Neural Networks Methods for Interface Problems

AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization