Abstract:Optimal stopping is the problem of determining when to stop a stochastic system in order to maximize reward, which is of practical importance in domains such as finance, operations management and healthcare. Existing methods for high-dimensional optimal stopping that are popular in practice produce deterministic linear policies -- policies that deterministically stop based on the sign of a weighted sum of basis functions -- but are not guaranteed to find the optimal policy within this policy class given a fixed basis function architecture. In this paper, we propose a new methodology for optimal stopping based on randomized linear policies, which choose to stop with a probability that is determined by a weighted sum of basis functions. We motivate these policies by establishing that under mild conditions, given a fixed basis function architecture, optimizing over randomized linear policies is equivalent to optimizing over deterministic linear policies. We formulate the problem of learning randomized linear policies from data as a smooth non-convex sample average approximation (SAA) problem. We theoretically prove the almost sure convergence of our randomized policy SAA problem and establish bounds on the out-of-sample performance of randomized policies obtained from our SAA problem based on Rademacher complexity. We also show that the SAA problem is in general NP-Hard, and consequently develop a practical heuristic for solving our randomized policy problem. Through numerical experiments on a benchmark family of option pricing problem instances, we show that our approach can substantially outperform state-of-the-art methods.

On an Optimal Stopping Problem with a Discontinuous Reward

On variable annuities with surrender charges

An analytical study of participating policies with minimum rate guarantee and surrender option

Risk-Sensitive Stopping Problems for Continuous-Time Markov Chains

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

Exploratory Optimal Stopping: A Singular Control Formulation

On the free boundary of an annuity purchase

Optimal stopping problems in diffusion-type models with running maxima and drawdowns

Optimal Stopping under Model Ambiguity: a Time-Consistent Equilibrium Approach

Optimal surrender policy for reverse mortgage loans

Finite-horizon Optimality for Continuous-Time Markov Decision Processes with Unbounded Transition Rates

Discount Optimality for Unbounded Rewards

Enhancing Valuation of Variable Annuities in Lévy Models with Stochastic Interest Rate

Randomized Policy Optimization for Optimal Stopping

Partially Observable Risk-Sensitive Stopping Problems in Discrete Time

Optimal stopping problem under random horizon

Optimal Stopping Investment with Non-Smooth Utility over an Infinite Time Horizon

An explicit solution for an optimal stopping/optimal control problem which models an asset sale

Optimal Surrender Strategies for Equity-Indexed Annuity Investors with Partial Information

Optimal Reversible Annuities to Minimize the Probability of Lifetime Ruin

Infinite horizon stopping problems with (nearly) total reward criteria