Abstract:We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representation of excessive functions in terms of the Green kernel, the main reference being Salminen 85. In the context of one-dimensional diffusions we give a complete characterization of the solution under some assumptions on the reward function. If the optimal stopping problem is a ray, we provide a simple equation to find the boundary and discuss the validity of the smooth fit principle. We include some new examples as the optimal stopping of the skew Brownian motion and the sticky Brownian motion. In particular, we consider cases in which the smooth fit principle fails. In the general case, we propose an algorithm that finds the optimal stopping region when it is a disjoint union of intervals. We also give a simple formula for the value function. Using this algorithm we solve some examples including polynomial rewards. For general Markov processes with continuous sample paths (for instance multidimensional diffusions) we provide a verification theorem and use it to solve a particular problem. Finally we consider one-dimensional strong Markov processes with only positive (or only negative) jumps, and provide another verification theorem for right-sided (left-sided) problems. As applications of our results we address the problem of pricing an American put option in a Lévy market, and also solve an optimal stopping problem for a Lévy driven Ornstein-Uhlenbeck process.

Learning to Optimally Stop a Diffusion Process

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

Reinforcement Learning for optimal dividend problem under diffusion model

Reinforcement Learning for Jump-Diffusions, with Financial Applications

Exploratory Optimal Stopping: A Singular Control Formulation

Optimal Stopping for Strong Markov Processes: Explicit solutions and verification theorems for diffusions, multidimensional diffusions, and jump-processes

Reward Shaping via Diffusion Process in Reinforcement Learning

Learning Merton's Strategies in an Incomplete Market: Recursive Entropy Regularization and Biased Gaussian Exploration

Optimal withdrawals in a general diffusion model with control rates subject to a state-dependent upper bound

Feedback Efficient Online Fine-Tuning of Diffusion Models

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

Optimal Stopping of Branching Diffusion Processes

Learning to Stabilize Online Reinforcement Learning in Unbounded State Spaces

Solving optimal stopping problems with Deep Q-Learning

Drift Control with Discretionary Stopping for a Diffusion Process

Optimal Stopping under Model Ambiguity: a Time-Consistent Equilibrium Approach

Continuous-time Risk-sensitive Reinforcement Learning via Quadratic Variation Penalty

A deep primal-dual BSDE method for optimal stopping problems

Diffusion transformations, Black-Scholes equation and optimal stopping

Risk-sensitive Markov Decision Process and Learning under General Utility Functions