Abstract:This paper contributes to the existing literature on hedging American options with Deep Reinforcement Learning (DRL). The study first investigates hyperparameter impact on hedging performance, considering learning rates, training episodes, neural network architectures, training steps, and transaction cost penalty functions. Results highlight the importance of avoiding certain combinations, such as high learning rates with a high number of training episodes or low learning rates with few training episodes and emphasize the significance of utilizing moderate values for optimal outcomes. Additionally, the paper warns against excessive training steps to prevent instability and demonstrates the superiority of a quadratic transaction cost penalty function over a linear version. This study then expands upon the work of Pickard et al. (2024), who utilize a Chebyshev interpolation option pricing method to train DRL agents with market calibrated stochastic volatility models. While the results of Pickard et al. (2024) showed that these DRL agents achieve satisfactory performance on empirical asset paths, this study introduces a novel approach where new agents at weekly intervals to newly calibrated stochastic volatility models. Results show DRL agents re-trained using weekly market data surpass the performance of those trained solely on the sale date. Furthermore, the paper demonstrates that both single-train and weekly-train DRL agents outperform the Black-Scholes Delta method at transaction costs of 1% and 3%. This practical relevance suggests that practitioners can leverage readily available market data to train DRL agents for effective hedging of options in their portfolios.

Pricing and hedging American-style options with deep learning

A deep learning method for pricing high-dimensional American-style options via state-space partition

Simultaneous upper and lower bounds of American-style option prices with hedging via neural networks

Deep learning of optimal exercise boundaries for American options

Pricing high-dimensional Bermudan options using deep learning and higher-order weak approximation

Efficient Learning of Nested Deep Hedging using Multiple Options

Deep neural network framework based on backward stochastic differential equations for pricing and hedging American options in high dimensions

Hedging American Put Options with Deep Reinforcement Learning

Deeply Learning Derivatives

Optimizing Deep Reinforcement Learning for American Put Option Hedging

A New Deep Neural Network Algorithm for Multiple Stopping with Applications in Options Pricing

Pricing American Options using Machine Learning Algorithms

Efficient Estimation of Lower and Upper Bounds for Pricing Higher-Dimensional American Arithmetic Average Options by Approximating Their Payoff Functions

On Extensions of the Barone-Adesi & Whaley Method to Price American-Type Options

Backward Hedging for American Options with Transaction Costs

Gradient-enhanced sparse Hermite polynomial expansions for pricing and hedging high-dimensional American options

Pricing Barrier Options with DeepBSDEs

On pricing of discrete Asian and Lookback options under the Heston model

Pricing American options using martingale bases

Deep-learning based numerical BSDE method for barrier options