Abstract:Optimal stopping is the problem of determining when to stop a stochastic system in order to maximize reward, which is of practical importance in domains such as finance, operations management and healthcare. Existing methods for high-dimensional optimal stopping that are popular in practice produce deterministic linear policies -- policies that deterministically stop based on the sign of a weighted sum of basis functions -- but are not guaranteed to find the optimal policy within this policy class given a fixed basis function architecture. In this paper, we propose a new methodology for optimal stopping based on randomized linear policies, which choose to stop with a probability that is determined by a weighted sum of basis functions. We motivate these policies by establishing that under mild conditions, given a fixed basis function architecture, optimizing over randomized linear policies is equivalent to optimizing over deterministic linear policies. We formulate the problem of learning randomized linear policies from data as a smooth non-convex sample average approximation (SAA) problem. We theoretically prove the almost sure convergence of our randomized policy SAA problem and establish bounds on the out-of-sample performance of randomized policies obtained from our SAA problem based on Rademacher complexity. We also show that the SAA problem is in general NP-Hard, and consequently develop a practical heuristic for solving our randomized policy problem. Through numerical experiments on a benchmark family of option pricing problem instances, we show that our approach can substantially outperform state-of-the-art methods.

Optimal stopping with behaviorally biased agents: The role of loss aversion and changing reference points

Optimal Stopping under Model Ambiguity: a Time-Consistent Equilibrium Approach

An agent-based model of repeated decision making under risk: modeling the role of alternate reference points and risk behavior on long-run outcomes

Present-biased optimization

Persuasion and Optimal Stopping

Randomized Policy Optimization for Optimal Stopping

Rationally Biased Learning

Optimal Stopping with Interdependent Values

A Nonparametric Algorithm for Optimal Stopping Based on Robust Optimization

Optimal Stopping Rule Meets Ambiguity

Winning Without Observing Payoffs: Exploiting Behavioral Biases to Win Nearly Every Round

Comparative Statics for Optimal Stopping Problems in Nonstationary Environments

Data-driven optimal stopping: A pure exploration analysis

Stopping Bayesian Optimization with Probabilistic Regret Bounds

Optimal Consumption and Portfolio Selection Problems under Loss Aversion with Downside Consumption Constraints

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

Are decisions under risk malleable?

Apparent sunk cost effect in rational agents

Behavioral Portfolio Selection in Continuous Time

OPTIMAL PORTFOLIO AND CONSUMPTION MODELS UNDER LOSS AVERSION IN INFINITE TIME HORIZON

Partially Observable Risk-Sensitive Stopping Problems in Discrete Time