Abstract:Market making strategy is one of the most popular high frequency trading strategies, where a market maker continuously quotes on both bid and ask side of the limit order book to profit from capturing bid-ask spread and to provide liquidity to the market. A market maker should consider three types of risk: 1) inventory risk, 2) adverse selection risk, and 3) non-execution risk. While there have been a lot of studies on market making via deep reinforcement learning, most of them focus on the first risk. However, in highly competitive markets, the latter two risks are very important to make stable profit from market making. For better control of the latter two risks, it is important to reserve good queue position of their resting limit orders. For this purpose, practitioners frequently adopt order stacking framework where their limit orders are quoted at multiple price levels beyond the best limit price. To the best of our knowledge, there have been no studies that adopt order stacking framework for market making. In this regard, we develop a deep reinforcement learning model for market making under order stacking framework. We use a modified state representation to efficiently encode the queue positions of the resting limit orders. We conduct comprehensive ablation study to show that by utilizing deep reinforcement learning, a market making agent under order stacking framework successfully learns to improve the PL while reducing various risks. For the training and testing of our model, we use complete limit order book data of KOSPI200 Index Futures from November 1, 2019 to January 31, 2020 which is comprised of 61 trading days.

Market Making of Options via Reinforcement Learning

Over-the-Counter Market Making via Reinforcement Learning

Market Making Strategy Optimization via Deep Reinforcement Learning

Reinforcement Learning Approaches to Optimal Market Making

Reinforcement Learning in Non-Markov Market-Making

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Deep Reinforcement Learning for Market Making

Market Making via Reinforcement Learning in China Commodity Market

Market Making with Deep Reinforcement Learning from Limit Order Books

Reinforcement Learning for Options Trading

A data-driven deep learning approach for options market making

Market Making under Order Stacking Framework: A Deep Reinforcement Learning Approach

Performance of Deep Reinforcement Learning for High Frequency Market Making on Actual Tick Data.

Deep Reinforcement Learning for High-Frequency Market Making

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model

Reinforcement Learning in High-frequency Market Making

Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making

Optimizing Market Making using Multi-Agent Reinforcement Learning

A reinforcement learning approach to improve the performance of the Avellaneda-Stoikov market-making algorithm