Deeper Hedging: A New Agent-based Model for Effective Deep Hedging

Kang Gao,Stephen Weston,Perukrishnen Vytelingum,Namid R. Stillman,Wayne Luk,Ce Guo
DOI: https://doi.org/10.1145/3604237.3626913
2023-10-29
Abstract:We propose the Chiarella-Heston model, a new agent-based model for improving the effectiveness of deep hedging strategies. This model includes momentum traders, fundamental traders, and volatility traders. The volatility traders participate in the market by innovatively following a Heston-style volatility signal. The proposed model generalises both the extended Chiarella model and the Heston stochastic volatility model, and is calibrated to reproduce as many empirical stylized facts as possible. According to the stylised facts distance metric, the proposed model is able to reproduce more realistic financial time series than three baseline models: the extended Chiarella model, the Heston model, and the Geometric Brownian Motion. The proposed model is further validated by the Generalized Subtracted L-divergence metric. With the proposed Chiarella-Heston model, we generate a training dataset to train a deep hedging agent for optimal hedging strategies under various transaction cost levels. The deep hedging agent employs the Deep Deterministic Policy Gradient algorithm and is trained to maximize profits and minimize risks. Our testing results reveal that the deep hedging agent, trained with data generated by our proposed model, outperforms the baseline in most transaction cost levels. Furthermore, the testing process, which is conducted using empirical data, demonstrates the effective performance of the trained deep hedging agent in a realistic trading environment.
Computational Finance
What problem does this paper attempt to address?
The paper attempts to address the problem of how to improve the effectiveness of hedging strategies in financial derivatives hedging. Specifically, the authors propose a new agent-based model (ABM) — the Chiarella-Heston model, to generate synthetic data that more closely resembles the dynamics of real financial markets. This data is used to train a deep reinforcement learning (DRL) agent, namely the deep hedging agent, to formulate optimal hedging strategies under different levels of transaction costs. Traditional hedging methods often rely on theoretical models or expert knowledge, but in real markets, there are various friction factors such as transaction costs and slippage, which make it difficult for traditional methods to achieve ideal hedging effects. Therefore, this paper aims to overcome the limitations of existing methods by combining agent-based market simulation and deep reinforcement learning techniques, thereby enhancing the performance of hedging strategies. The main contributions of the paper include: 1. **Proposing an innovative agent-based model**: The Chiarella-Heston model integrates features of the extended Chiarella model and the Heston stochastic volatility model, better simulating the complex dynamics of financial markets, especially phenomena like volatility clustering. 2. **Generating more realistic synthetic data**: By calibrating model parameters, the generated synthetic data can reproduce multiple stylized facts of real financial markets, such as the fat tails of return distributions, return autocorrelation, and volatility clustering. 3. **Optimizing deep hedging strategies**: Using the generated synthetic data to train a deep reinforcement learning agent, enabling it to maximize profits and minimize risks under different transaction cost levels. Experimental results show that the deep hedging agent trained on the Chiarella-Heston model outperforms baseline models at most transaction cost levels and also demonstrates good performance in real market data tests. In summary, this paper proposes a new agent-based market simulation model and deep reinforcement learning method to address the challenges in financial derivatives hedging, aiming to improve the effectiveness and robustness of hedging strategies.