Abstract:Recently equal risk pricing, a framework for fair derivative pricing, was extended to consider dynamic risk measures. However, all current implementations either employ a static risk measure that violates time consistency, or are based on traditional dynamic programming solution schemes that are impracticable in problems with a large number of underlying assets (due to the curse of dimensionality) or with incomplete asset dynamics information. In this paper, we extend for the first time a famous off-policy deterministic actor-critic deep reinforcement learning (ACRL) algorithm to the problem of solving a risk averse Markov decision process that models risk using a time consistent recursive expectile risk measure. This new ACRL algorithm allows us to identify high quality time consistent hedging policies (and equal risk prices) for options, such as basket options, that cannot be handled using traditional methods, or in context where only historical trajectories of the underlying assets are available. Our numerical experiments, which involve both a simple vanilla option and a more exotic basket option, confirm that the new ACRL algorithm can produce 1) in simple environments, nearly optimal hedging policies, and highly accurate prices, simultaneously for a range of maturities 2) in complex environments, good quality policies and prices using reasonable amount of computing resources; and 3) overall, hedging strategies that actually outperform the strategies produced using static risk measures when the risk is evaluated at later points of time.

Deep Hedging: Continuous Reinforcement Learning for Hedging of General Portfolios across Multiple Risk Aversions

Deep Bellman Hedging

Research on the Dynamic Hedging Trading Strategy for Portfolios Based on Deep Reinforcement Learning

Deep Reinforcement Learning for Equal Risk Pricing and Hedging under Dynamic Expectile Risk Measures

Adversarial Deep Hedging: Learning to Hedge without Price Process Modeling

Deep Learning Algorithms for Hedging with Frictions

Deep Partial Hedging

Deep Hedging: Learning to Remove the Drift under Trading Frictions with Minimal Equivalent Near-Martingale Measures

Deep Hedging with Market Impact

Deeper Hedging: A New Agent-based Model for Effective Deep Hedging

Implementing portfolio risk management and hedging in practice

Hedging Beyond the Mean: A Distributional Reinforcement Learning Perspective for Hedging Portfolios with Structured Products

CVA Hedging by Risk-Averse Stochastic-Horizon Reinforcement Learning

Robust Risk-Aware Option Hedging

Adversarial Deep Reinforcement Learning in Portfolio Management

Pseudo-model-free hedging for variable annuities via deep reinforcement learning

Deep Hedging: Learning Risk-Neutral Implied Volatility Dynamics

Neural-Progressive Hedging: Enforcing Constraints in Reinforcement Learning with Stochastic Programming

Option Hedging with Risk Averse Reinforcement Learning

The Efficient Hedging Frontier with Deep Neural Networks

Fast Deep Hedging with Second-Order Optimization