Abstract:Market making strategy is one of the most popular high frequency trading strategies, where a market maker continuously quotes on both bid and ask side of the limit order book to profit from capturing bid-ask spread and to provide liquidity to the market. A market maker should consider three types of risk: 1) inventory risk, 2) adverse selection risk, and 3) non-execution risk. While there have been a lot of studies on market making via deep reinforcement learning, most of them focus on the first risk. However, in highly competitive markets, the latter two risks are very important to make stable profit from market making. For better control of the latter two risks, it is important to reserve good queue position of their resting limit orders. For this purpose, practitioners frequently adopt order stacking framework where their limit orders are quoted at multiple price levels beyond the best limit price. To the best of our knowledge, there have been no studies that adopt order stacking framework for market making. In this regard, we develop a deep reinforcement learning model for market making under order stacking framework. We use a modified state representation to efficiently encode the queue positions of the resting limit orders. We conduct comprehensive ablation study to show that by utilizing deep reinforcement learning, a market making agent under order stacking framework successfully learns to improve the PL while reducing various risks. For the training and testing of our model, we use complete limit order book data of KOSPI200 Index Futures from November 1, 2019 to January 31, 2020 which is comprised of 61 trading days.

Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model

Reinforcement Learning Approaches to Optimal Market Making

Deep Reinforcement Learning for Market Making

Market Making with Deep Reinforcement Learning from Limit Order Books

Deep Reinforcement Learning for High-Frequency Market Making

Reinforcement Learning in Non-Markov Market-Making

Market Making under Order Stacking Framework: A Deep Reinforcement Learning Approach

Market Making Strategy Optimization via Deep Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for High-Frequency Multi-Market Making

Deep Hawkes process for high-frequency market making

Performance of Deep Reinforcement Learning for High Frequency Market Making on Actual Tick Data.

Multi-agent reinforcement learning in a realistic limit order book market simulation

Optimizing Market Making using Multi-Agent Reinforcement Learning

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Over-the-Counter Market Making via Reinforcement Learning

Market making and incentives design in the presence of a dark pool: a deep reinforcement learning approach

Market Making of Options via Reinforcement Learning

Deep Q-Learning Market Makers in a Multi-Agent Simulated Stock Market

A data-driven deep learning approach for options market making