Performance of Deep Reinforcement Learning for High Frequency Market Making on Actual Tick Data.

Ziyi Xu,Xue Cheng,Yangbo He
2022-01-01
Abstract:High frequency market making is a trading strategy in which agent quotes passively at both ask and bid sides. In this paper, by applying Dueling Double Deep Q Network (D3QN) and a novel reward function, we develop market making agents who can balance profit and inventory robustly, flexibly and full-automatically. Thanks to the actual tick data of stock, we are able to train and test D3QN agents in a relatively realistic environment. To further explore the agent's performance, we also consider a double-agent situation, where the agent competes with a special-designed market maker. And we find in this case, with further training, the D3QN agent learns to quote more narrowly to increase transaction probability. Furthermore, we analyze the impact of high frequency market making on market quality in both single-agent and double-agent cases.
What problem does this paper attempt to address?