Abstract:We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representation of excessive functions in terms of the Green kernel, the main reference being Salminen 85. In the context of one-dimensional diffusions we give a complete characterization of the solution under some assumptions on the reward function. If the optimal stopping problem is a ray, we provide a simple equation to find the boundary and discuss the validity of the smooth fit principle. We include some new examples as the optimal stopping of the skew Brownian motion and the sticky Brownian motion. In particular, we consider cases in which the smooth fit principle fails. In the general case, we propose an algorithm that finds the optimal stopping region when it is a disjoint union of intervals. We also give a simple formula for the value function. Using this algorithm we solve some examples including polynomial rewards. For general Markov processes with continuous sample paths (for instance multidimensional diffusions) we provide a verification theorem and use it to solve a particular problem. Finally we consider one-dimensional strong Markov processes with only positive (or only negative) jumps, and provide another verification theorem for right-sided (left-sided) problems. As applications of our results we address the problem of pricing an American put option in a Lévy market, and also solve an optimal stopping problem for a Lévy driven Ornstein-Uhlenbeck process.

Markov Process Jump Times and Their Cox Construction

Stopping times occurring simultaneously

Optimal stopping for Markov processes with positive jumps

A martingale approach to time-dependent and time-periodic linear response in Markov jump processes

Estimation of a pure-jump stable Cox-Ingersoll-Ross process

A pure jump Markov process with a random singularity spectrum

Exit spaces for Cox processes and the Pólya sum process

A Unified Approach for Hitting Time of Jump Markov Type Processes

The law of the iterated logarithm for a piecewise deterministic Markov process assured by the properties of the Markov chain given by its post-jump locations

On the Existence and Uniqueness of Stationary Distributions for Some Piecewise Deterministic Markov Processes With State-Dependent Jump Intensity

The jumping properties of Markov branching processes

Time reversal of Markov processes with jumps under a finite entropy condition

Stochastic representation of processes with resetting

On the Poisson equation for nonreversible Markov jump processes

Markovian projections for Itô semimartingales with jumps

Feller and ergodic properties of jump–move processes with applications to interacting particle systems

Fast rare events in exit times distributions of jump processes

Hitting times of interacting drifted Brownian motions and the vertex reinforced jump process

Optimal Stopping for Strong Markov Processes: Explicit solutions and verification theorems for diffusions, multidimensional diffusions, and jump-processes