Abstract:Optimization of market making strategy is a vital issue for participants in security markets. Traditional strategies are mostly designed manually, and orders are mechanically issued according to rules based on predefined market conditions. On one hand, market conditions cannot be well represented by arbitrarily defined indicators, and on the other hand, rule-based strategies cannot fully capture relations between the market conditions and strategies’ actions. Therefore, it is worthwhile to investigate how to incorporate deep reinforcement learning model to address those issues. In this paper, we propose an end-to-end deep reinforcement learning market making model, i.e., Deep Reinforcement Learning Market Making. It exploits long short-term memory network to extract temporal patterns of the market directly from limit order books, and it learns state-action relations via a reinforcement learning approach. In order to control inventory risk and information asymmetry, a deep Q-network is introduced to adaptively select different action subsets and train the market making agent according to the inventory states. Experiments are conducted on a six-month Level-2 data set, including 10 stock, from Shanghai Stock Exchange in China. Our model is compared with a conventional market making baseline and a state-of-the-art market making model. Experimental results show that our approach outperforms the benchmarks over 10 stocks by at least 10.63%.

Multi-Agent Deep Reinforcement Learning for High-Frequency Multi-Market Making

Deep Reinforcement Learning for High-Frequency Market Making

Deep Reinforcement Learning for Market Making

Performance of Deep Reinforcement Learning for High Frequency Market Making on Actual Tick Data.

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Deep Hawkes process for high-frequency market making

Optimizing Market Making using Multi-Agent Reinforcement Learning

Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations

Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making

Multi-agent reinforcement learning in a realistic limit order book market simulation

Market Making with Deep Reinforcement Learning from Limit Order Books

Deep Q-Learning Market Makers in a Multi-Agent Simulated Stock Market

Market Making Strategy Optimization via Deep Reinforcement Learning

Reinforcement Learning in Non-Markov Market-Making

Deep Calibration of Multi-Agent Model for Simulating Real-World Stock Trading

Stock market microstructure inference via multi-agent reinforcement learning

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Integrating Tick-level Data and Periodical Signal for High-frequency Market Making

Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model