Abstract:The optimal stopping problem is a category of decision problems with a specific constrained configuration. It is relevant to various real-world applications such as finance and management. To solve the optimal stopping problem, state-of-the-art algorithms in dynamic programming, such as the least-squares Monte Carlo (LSMC), are employed. This type of algorithm relies on path simulations using only the last price of the underlying asset as a state representation. Also, the LSMC was thinking for option valuation where risk-neutral probabilities can be employed to account for uncertainty. However, the general optimal stopping problem goals may not fit the requirements of the LSMC showing auto-correlated prices. We employ a data-driven method that uses Monte Carlo simulation to train and test artificial neural networks (ANN) to solve the optimal stopping problem. Using ANN to solve decision problems is not entirely new. We propose a different architecture that uses convolutional neural networks (CNN) to deal with the dimensionality problem that arises when we transform the whole history of prices into a Markovian state. We present experiments that indicate that our proposed architecture improves results over the previous implementations under specific simulated time series function sets. Lastly, we employ our proposed method to compare the optimal exercise of the financial options problem with the LSMC algorithm. Our experiments show that our method can capture more accurate exercise opportunities when compared to the LSMC. We have outstandingly higher (above 974\% improvement) expected payoff from these exercise policies under the many Monte Carlo simulations that used the real-world return database on the out-of-sample (test) data.

A New Deep Neural Network Algorithm for Multiple Stopping with Applications in Options Pricing

Optimal Stopping via Randomized Neural Networks

A deep learning method for pricing high-dimensional American-style options via state-space partition

Deep neural network expressivity for optimal stopping problems

A deep primal-dual BSDE method for optimal stopping problems

Solving the optimal stopping problem with reinforcement learning: an application in financial option exercise

Pricing and hedging American-style options with deep learning

Solving optimal stopping problems with Deep Q-Learning

Deep Learning Algorithms for Mean Field Optimal Stopping in Finite Space and Discrete Time

Deep Reinforcement Learning for Optimal Stopping with Application in Financial Engineering

Convergence of the Backward Deep BSDE Method with Applications to Optimal Stopping Problems

Deep Penalty Methods: A Class of Deep Learning Algorithms for Solving High Dimensional Optimal Stopping Problems

Deep neural network framework based on backward stochastic differential equations for pricing and hedging American options in high dimensions

A Nonparametric Algorithm for Optimal Stopping Based on Robust Optimization

Sequential Design for Optimal Stopping Problems

Randomized Optimal Stopping Problem in Continuous Time and Reinforcement Learning Algorithm

The Deep Parametric PDE Method: Application to Option Pricing

Simultaneous upper and lower bounds of American-style option prices with hedging via neural networks

Option Pricing by Neural Stochastic Differential Equations: A Simulation-Optimization Approach

Solving barrier options under stochastic volatility using deep learning

A Machine Learning Algorithm for Finite-Horizon Stochastic Control Problems in Economics