Abstract:Optimal stopping is the problem of determining when to stop a stochastic system in order to maximize reward, which is of practical importance in domains such as finance, operations management and healthcare. Existing methods for high-dimensional optimal stopping that are popular in practice produce deterministic linear policies -- policies that deterministically stop based on the sign of a weighted sum of basis functions -- but are not guaranteed to find the optimal policy within this policy class given a fixed basis function architecture. In this paper, we propose a new methodology for optimal stopping based on randomized linear policies, which choose to stop with a probability that is determined by a weighted sum of basis functions. We motivate these policies by establishing that under mild conditions, given a fixed basis function architecture, optimizing over randomized linear policies is equivalent to optimizing over deterministic linear policies. We formulate the problem of learning randomized linear policies from data as a smooth non-convex sample average approximation (SAA) problem. We theoretically prove the almost sure convergence of our randomized policy SAA problem and establish bounds on the out-of-sample performance of randomized policies obtained from our SAA problem based on Rademacher complexity. We also show that the SAA problem is in general NP-Hard, and consequently develop a practical heuristic for solving our randomized policy problem. Through numerical experiments on a benchmark family of option pricing problem instances, we show that our approach can substantially outperform state-of-the-art methods.

Recursive Optimal Stopping with Poisson Stopping Constraints

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

An Optimal Stopping Problem for Jump Diffusion Logistic Population Model

Optimal Stopping Problems with Restricted Stopping Times

Discounted nonzero-sum optimal stopping games under Poisson random intervention times

A deep primal-dual BSDE method for optimal stopping problems

Sequential Design for Optimal Stopping Problems

An optimal stopping problem on the finite-step simple random walk with absorbent boundaries.

Exploratory Optimal Stopping: A Singular Control Formulation

Optimal Stopping Problem for Jump–diffusion Processes with Regime-Switching

Reflected Backward Stochastic Difference Equations and Optimal Stopping Problems under G-Expectation

An Optimal Stopping Problem in the Stochastic Gilpin-Ayala Population Model

Discrete Analysis of Portfolio Selection with Optimal Stopping Time.

Optimal Stopping of BSDEs with Constrained Jumps and Related Double Obstacle PDEs

Optimal stopping problems in diffusion-type models with running maxima and drawdowns

A Sufficient Stochastic Maximum Principle for a Kind of Recursive Optimal Control Problem with Obstacle Constraint

Randomized Policy Optimization for Optimal Stopping

A New Deep Neural Network Algorithm for Multiple Stopping with Applications in Options Pricing

Constrained optimal stopping under a regime-switching model