An Optimal Stopping Problem Modeling Technical Analysis

Jun Maeda,Saul D. Jacka

DOI: https://doi.org/10.48550/arXiv.1707.05253

2020-03-27

Abstract:We present a solution to an optimal stopping problem for a process with a wide-class of novel dynamics. The dynamics model the support/resistance line concept from financial technical analysis.

Mathematical Finance

What problem does this paper attempt to address?

Optimal stopping problems in diffusion-type models with running maxima and drawdowns

Pavel V. Gapeev,Neofytos Rodosthenous

DOI: https://doi.org/10.48550/arXiv.1405.4438

2014-05-18

Abstract:We study optimal stopping problems related to the pricing of perpetual American options in an extension of the Black-Merton-Scholes model in which the dividend and volatility rates of the underlying risky asset depend on the running values of its maximum and maximum drawdown. The optimal stopping times of exercise are shown to be the first times at which the price of the underlying asset exits some regions restricted by certain boundaries depending on the running values of the associated maximum and maximum drawdown processes. We obtain closed-form solutions to the equivalent free-boundary problems for the value functions with smooth fit at the optimal stopping boundaries and normal reflection at the edges of the state space of the resulting three-dimensional Markov process. We derive first-order nonlinear ordinary differential equations for the optimal exercise boundaries of the perpetual American standard options.

Probability
Comparative Statics for Optimal Stopping Problems in Nonstationary Environments

Théo Durandard,Matteo Camboni

2024-07-31

Abstract:How do decisions change with the economic environment and with time? This paper studies general nonstationary stopping problems and provides the methodological tools to answer these questions. First, we identify conditions that ensure a monotone relation between decisions' timing and outcomes. These conditions apply to a prevalent class of economic environments. Second, we develop a theory of monotone comparative statics for stopping problems, offering general and unifying qualitative insights into the decision-maker's value and stopping behavior. We apply our results to models of information acquisition, bankruptcy, irreversible investment, and option pricing to explain documented patterns at odds with current theories.

Theoretical Economics,Analysis of PDEs,Optimization and Control
Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

Yuchao Dong

DOI: https://doi.org/10.1137/22m1516725

IF: 2.2

2024-06-12

SIAM Journal on Control and Optimization

Abstract:SIAM Journal on Control and Optimization, Volume 62, Issue 3, Page 1590-1614, June 2024. In this paper, we study the optimal stopping problem in the so-called exploratory framework, in which the agent takes actions randomly conditioning on the current state and a regularization term is added to the reward functional. Such a transformation reduces the optimal stopping problem to a standard optimal control problem. For the American put option model, we derive the related HJB equation and prove its solvability. Furthermore, we give a convergence rate of policy iteration and compare our solution to the classical American put option problem. Our results indicate a trade-off between the convergence rate and bias in the choice of the temperature constant. Based on the theoretical analysis, a reinforcement learning algorithm is designed and numerical results are demonstrated for several models.

mathematics, applied,automation & control systems
Optimal Stopping under Model Ambiguity: a Time-Consistent Equilibrium Approach

Yu-Jui Huang,Xiang Yu

DOI: https://doi.org/10.1111/mafi.12312

2021-03-29

Abstract:An unconventional approach for optimal stopping under model ambiguity is introduced. Besides ambiguity itself, we take into account how ambiguity-averse an agent is. This inclusion of ambiguity attitude, via an $\alpha$-maxmin nonlinear expectation, renders the stopping problem time-inconsistent. We look for subgame perfect equilibrium stopping policies, formulated as fixed points of an operator. For a one-dimensional diffusion with drift and volatility uncertainty, we show that every equilibrium can be obtained through a fixed-point iteration. This allows us to capture much more diverse behavior, depending on an agent's ambiguity attitude, beyond the standard worst-case (or best-case) analysis. In a concrete example of real options valuation under volatility uncertainty, all equilibrium stopping policies, as well as the best one among them, are fully characterized. It demonstrates explicitly the effect of ambiguity attitude on decision making: the more ambiguity-averse, the more eager to stop -- so as to withdraw from the uncertain environment. The main result hinges on a delicate analysis of continuous sample paths in the canonical space and the capacity theory. To resolve measurability issues, a generalized measurable projection theorem, new to the literature, is also established.

Mathematical Finance,Optimization and Control
Solving the optimal stopping problem with reinforcement learning: an application in financial option exercise

Leonardo Kanashiro Felizardo,Elia Matsumoto,Emilio Del-Moral-Hernandez

DOI: https://doi.org/10.48550/arXiv.2208.00765

2022-07-22

Abstract:The optimal stopping problem is a category of decision problems with a specific constrained configuration. It is relevant to various real-world applications such as finance and management. To solve the optimal stopping problem, state-of-the-art algorithms in dynamic programming, such as the least-squares Monte Carlo (LSMC), are employed. This type of algorithm relies on path simulations using only the last price of the underlying asset as a state representation. Also, the LSMC was thinking for option valuation where risk-neutral probabilities can be employed to account for uncertainty. However, the general optimal stopping problem goals may not fit the requirements of the LSMC showing auto-correlated prices. We employ a data-driven method that uses Monte Carlo simulation to train and test artificial neural networks (ANN) to solve the optimal stopping problem. Using ANN to solve decision problems is not entirely new. We propose a different architecture that uses convolutional neural networks (CNN) to deal with the dimensionality problem that arises when we transform the whole history of prices into a Markovian state. We present experiments that indicate that our proposed architecture improves results over the previous implementations under specific simulated time series function sets. Lastly, we employ our proposed method to compare the optimal exercise of the financial options problem with the LSMC algorithm. Our experiments show that our method can capture more accurate exercise opportunities when compared to the LSMC. We have outstandingly higher (above 974\% improvement) expected payoff from these exercise policies under the many Monte Carlo simulations that used the real-world return database on the out-of-sample (test) data.

Computational Finance,Artificial Intelligence
A Nonparametric Algorithm for Optimal Stopping Based on Robust Optimization

Bradley Sturt

DOI: https://doi.org/10.1287/opre.2023.2461

IF: 2.7

2023-05-21

Operations Research

Abstract:Optimal stopping is a fundamental class of stochastic dynamic optimization problems with numerous applications in finance and operations management. In “A nonparametric algorithm for optimal stopping based on robust optimization,” the author introduces an approach based on robust optimization for computing near-optimal solutions for computationally demanding stochastic optimal stopping problems with known probability distributions. Through this new use of robust optimization, the paper develops new algorithms for solving stochastic optimal stopping problems that are practical and can outperform state-of-the-art simulation-based algorithms in the context of pricing high-dimensional financial options.

management,operations research & management science
Numerical solutions of optimal stopping problems for a class of hybrid stochastic systems

Philip A. Ernst,Xiaohang Ma,Masoud H. Nazari,Hongjiang Qian,Le Yi Wang,George Yin

DOI: https://doi.org/10.1016/j.nahs.2024.101507

IF: 5.477

2024-05-18

Nonlinear Analysis Hybrid Systems

Abstract:This paper is devoted to numerically solving a class of optimal stopping problems for stochastic hybrid systems involving both continuous states and discrete events. The motivation for solving this class of problems stems from quickest event detection problems of stochastic hybrid systems in broad application domains. We solve the optimal stopping problems numerically by constructing feasible algorithms using Markov chain approximation techniques. The key tasks we undertake include designing and constructing discrete-time Markov chains that are locally consistent with switching diffusions, proving the convergence of suitably scaled sequences, and obtaining convergence for the cost and value functions. Finally, numerical results are provided to demonstrate the performance of the algorithms.

automation & control systems,mathematics, applied
The Optimal Stopping Problem under a Random Horizon

Tahir Choulli,Safa’ Alsheyab

DOI: https://doi.org/10.3390/math12091273

IF: 2.4

2024-04-24

Mathematics

Abstract:This paper considers a pair (F,τ), where F is a filtration representing the "public" flow of information that is available to all agents over time, and τ is a random time that might not be an F-stopping time. This setting covers the case of a credit risk framework, where τ models the default time of a firm or client, and the setting of life insurance, where τ is the death time of an agent. It is clear that random times cannot be observed before their occurrence. Thus, the larger filtration, G, which incorporates F and makes τ observable, results from the progressive enlargement of F with τ. For this informational setting, governed by G, we analyze the optimal stopping problem in three main directions. The first direction consists of characterizing the existence of the solution to this problem in terms of F-observable processes. The second direction lies in deriving the mathematical structuresof the value process of this control problem, while the third direction singles out the associated optimal stopping problem under F. These three aspects allow us to deeply quantify how τ impacts the optimal stopping problem and are also vital for studying reflected backward stochastic differential equations that arise naturally from pricing and hedging of vulnerable claims.

mathematics
Robust optimal stopping with regime switching

Siyu Lv,Zhen Wu,Jie Xiong,Xin Zhang

2024-11-11

Abstract:In this paper, we study an optimal stopping problem in the presence of model uncertainty and regime switching. The max-min formulation for robust control and the dynamic programming approach are adopted to establish a general theoretical framework for such kind of problem. First, based on the dynamic programming principle, the value function of the optimal stopping problem is characterized as the unique viscosity solution to the associated Hamilton-Jacobi-Bellman equation. Then, the so-called smooth-fit principle for optimal stopping problems is proved in the current context, and a verification theorem consisting of a set of sufficient conditions for robust optimality is established. Moreover, when the Markov chain has a large state space and exhibits a two-time-scale structure, a singular perturbation approach is utilized to reduce the complexity involved and obtain an asymptotically optimal solution. Finally, an example of choosing the best time to sell a stock is provided, in which numerical experiments are reported to illustrate the implications of model uncertainty and regime switching.

Optimization and Control
Optimal stopping problem under random horizon

Tahir Choulli,Safa' Alsheyab

2024-04-23

Abstract:This paper considers a pair $(\mathbb{F},\tau)$, where $\mathbb{F}$ is a filtration representing the "public" flow of information which is available to all agents overtime, and $\tau$ is a random time which might not be an $\mathbb{F}$-stopping time. This setting covers the case of credit risk framework where $\tau$ models the default time of a firm or client, and the setting of life insurance where $\tau$ is the death time of an agent. It is clear that random times can not be observed before their occurrence. Thus the larger filtration $\mathbb{G}$, which incorporates $\mathbb{F}$ and makes $\tau$ observable, results from the progressive enlargement of $\mathbb{F}$ with $\tau$. For this informational setting, governed by $\mathbb{G}$, we analyze the optimal stopping problem in three main directions. The first direction consists of characterizing the existence of the solution to this problem in terms of $\mathbb{F}$-observable processes. The second direction lies in deriving the {\it mathematical structures} of the value process of this control problem, while the third direction singles out the associated optimal stopping problem under $\mathbb{F}$. These three aspects allow us to quantify deeply how $\tau$ impact the optimal stopping problem, while they are also vital for studying reflected backward stochastic differential equations which arise {\it naturally} from pricing and hedging of vulnerable claims.

Probability
A Non-optimality Detection Technique for Continuous Processes

Lingjian Ye,Yi Cao,Xiushui Ma,Zhihuan Song

DOI: https://doi.org/10.3182/20140824-6-za-1003.00979

2014-01-01

IFAC Proceedings Volumes

Abstract:This paper develops a novel non-optimality detection technique for continuous processes based on the theory of process monitoring. Since the optimal statuses have some common features so as to satisfy optimality necessary conditions, the distributions of process variables are found to fall in some subspace that is determined from the disturbances. To detect those statuses that are not optimally operated, non-optimality is considered as a special kind of process fault. An equivalent interpretation is also provided to demonstrate the rationale of proposed analogy. For illustration, the principal component analysis (PCA) is particularly employed as a detection tool, whose effectiveness is verified through an exothermic reactor example.
A Class of Solvable Optimal Stopping Problems of Spectrally Negative Jump Diffusions

Luis H. R. Alvarez E.,Pekka Matomäki,Teppo A. Rakkolainen

DOI: https://doi.org/10.48550/arXiv.1302.4181

2013-02-18

Abstract:We consider the optimal stopping of a class of spectrally negative jump diffusions. We state a set of conditions under which the value is shown to have a representation in terms of an ordinary nonlinear programming problem. We establish a connection between the considered problem and a stopping problem of an associated continuous diffusion process and demonstrate how this connection may be applied for characterizing the stopping policy and its value. We also establish a set of typically satisfied conditions under which increased volatility as well as higher jump-intensity decelerates rational exercise by increasing the value and expanding the continuation region.

Pricing of Securities,Optimization and Control
Optimal Stopping for Strong Markov Processes: Explicit solutions and verification theorems for diffusions, multidimensional diffusions, and jump-processes

Fabián Crocce

DOI: https://doi.org/10.48550/arXiv.1405.7539

2014-05-29

Abstract:We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representation of excessive functions in terms of the Green kernel, the main reference being Salminen 85. In the context of one-dimensional diffusions we give a complete characterization of the solution under some assumptions on the reward function. If the optimal stopping problem is a ray, we provide a simple equation to find the boundary and discuss the validity of the smooth fit principle. We include some new examples as the optimal stopping of the skew Brownian motion and the sticky Brownian motion. In particular, we consider cases in which the smooth fit principle fails. In the general case, we propose an algorithm that finds the optimal stopping region when it is a disjoint union of intervals. We also give a simple formula for the value function. Using this algorithm we solve some examples including polynomial rewards. For general Markov processes with continuous sample paths (for instance multidimensional diffusions) we provide a verification theorem and use it to solve a particular problem. Finally we consider one-dimensional strong Markov processes with only positive (or only negative) jumps, and provide another verification theorem for right-sided (left-sided) problems. As applications of our results we address the problem of pricing an American put option in a Lévy market, and also solve an optimal stopping problem for a Lévy driven Ornstein-Uhlenbeck process.

Probability
Data-driven optimal stopping: A pure exploration analysis

Sören Christensen,Niklas Dexheimer,Claudia Strauch

2023-12-10

Abstract:The standard theory of optimal stopping is based on the idealised assumption that the underlying process is essentially known. In this paper, we drop this restriction and study data-driven optimal stopping for a general diffusion process, focusing on investigating the statistical performance of the proposed estimator of the optimal stopping barrier. More specifically, we derive non-asymptotic upper bounds on the simple regret, along with uniform and non-asymptotic PAC bounds. Minimax optimality is verified by completing the upper bound results with matching lower bounds on the simple regret. All results are shown both under general conditions on the payoff functions and under more refined assumptions that mimic the margin condition used in binary classification, leading to an improved rate of convergence. Additionally, we investigate how our results on the simple regret transfer to the cumulative regret for a specific exploration-exploitation strategy, both with respect to lower bounds and upper bounds.

Statistics Theory,Optimization and Control,Machine Learning
Exploratory Optimal Stopping: A Singular Control Formulation

Jodi Dianetti,Giorgio Ferrari,Renyuan Xu

2024-10-02

Abstract:This paper explores continuous-time and state-space optimal stopping problems from a reinforcement learning perspective. We begin by formulating the stopping problem using randomized stopping times, where the decision maker's control is represented by the probability of stopping within a given time--specifically, a bounded, non-decreasing, càdlàg control process. To encourage exploration and facilitate learning, we introduce a regularized version of the problem by penalizing it with the cumulative residual entropy of the randomized stopping time. The regularized problem takes the form of an (n+1)-dimensional degenerate singular stochastic control with finite-fuel. We address this through the dynamic programming principle, which enables us to identify the unique optimal exploratory strategy. For the specific case of a real option problem, we derive a semi-explicit solution to the regularized problem, allowing us to assess the impact of entropy regularization and analyze the vanishing entropy limit. Finally, we propose a reinforcement learning algorithm based on policy iteration. We show both policy improvement and policy convergence results for our proposed algorithm.

Optimization and Control,Machine Learning,Mathematical Finance
A class of optimal stopping problems for Markov processes

Diana Dorobantu

DOI: https://doi.org/10.48550/arXiv.0809.4990

2008-09-29

Abstract:Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the first time when the Markov process passes over the boundary depending on time. Moreover, we propose a method to find the optimal boundary function.

Probability
Optimal stopping of the stable process with state-dependent killing

K. van Schaik,A. R. Watson,X. Xu

2024-02-28

Abstract:We describe the solution of an optimal stopping problem for a stable Lévy process killed at state-dependent rate, which can be seen as a model for bankruptcy. The killing rate is chosen in such a way that the killed process remains self-similar, and the solution to the optimal stopping problem is obtained by characterising a self-similar Markov process associated with the stable process. The optimal stopping strategy is to stop upon first passage into an interval, found explicitly in terms of the parameters of the model.

Probability
Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

Chengfan Gao,Siping Gao,Ruimeng Hu,Zimu Zhu

2023-08-24

Abstract:The optimal stopping problem is one of the core problems in financial markets, with broad applications such as pricing American and Bermudan options. The deep BSDE method [Han, Jentzen and E, PNAS, 115(34):8505-8510, 2018] has shown great power in solving high-dimensional forward-backward stochastic differential equations (FBSDEs), and inspired many applications. However, the method solves backward stochastic differential equations (BSDEs) in a forward manner, which can not be used for optimal stopping problems that in general require running BSDE backwardly. To overcome this difficulty, a recent paper [Wang, Chen, Sudjianto, Liu and Shen, <a class="link-https" data-arxiv-id="1807.06622" href="https://arxiv.org/abs/1807.06622">arXiv:1807.06622</a>, 2018] proposed the backward deep BSDE method to solve the optimal stopping problem. In this paper, we provide the rigorous theory for the backward deep BSDE method. Specifically, 1. We derive the a posteriori error estimation, i.e., the error of the numerical solution can be bounded by the training loss function; and; 2. We give an upper bound of the loss function, which can be sufficiently small subject to universal approximations. We give two numerical examples, which present consistent performance with the proved theory.

Probability,Machine Learning,Numerical Analysis
A Mathematical Analysis of Technical Analysis

Matthew Lorig,Zhou Zhou,Bin Zou

DOI: https://doi.org/10.48550/arXiv.1710.09476

2019-02-23

Abstract:In this paper, we investigate trading strategies based on exponential moving averages (ExpMAs) of an underlying risky asset. We study both logarithmic utility maximization and long-term growth rate maximization problems and find closed-form solutions when the drift of the underlying is modeled by either an Ornstein-Uhlenbeck process or a two-state continuous-time Markov chain. For the case of an Ornstein-Uhlenbeck drift, we carry out several Monte Carlo experiments in order to investigate how the performance of optimal ExpMA strategies is affected by variations in model parameters and by transaction costs.

Mathematical Finance

An Optimal Stopping Problem Modeling Technical Analysis

Optimal stopping problems in diffusion-type models with running maxima and drawdowns

Comparative Statics for Optimal Stopping Problems in Nonstationary Environments

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

Optimal Stopping under Model Ambiguity: a Time-Consistent Equilibrium Approach

Solving the optimal stopping problem with reinforcement learning: an application in financial option exercise

A Nonparametric Algorithm for Optimal Stopping Based on Robust Optimization

Numerical solutions of optimal stopping problems for a class of hybrid stochastic systems

The Optimal Stopping Problem under a Random Horizon

Robust optimal stopping with regime switching

Optimal stopping problem under random horizon

A Non-optimality Detection Technique for Continuous Processes

A Class of Solvable Optimal Stopping Problems of Spectrally Negative Jump Diffusions

Optimal Stopping for Strong Markov Processes: Explicit solutions and verification theorems for diffusions, multidimensional diffusions, and jump-processes

Data-driven optimal stopping: A pure exploration analysis

Exploratory Optimal Stopping: A Singular Control Formulation

A class of optimal stopping problems for Markov processes

Optimal stopping of the stable process with state-dependent killing

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

A Mathematical Analysis of Technical Analysis