Abstract:Optimization of market making strategy is a vital issue for participants in security markets. Traditional strategies are mostly designed manually, and orders are mechanically issued according to rules based on predefined market conditions. On one hand, market conditions cannot be well represented by arbitrarily defined indicators, and on the other hand, rule-based strategies cannot fully capture relations between the market conditions and strategies’ actions. Therefore, it is worthwhile to investigate how to incorporate deep reinforcement learning model to address those issues. In this paper, we propose an end-to-end deep reinforcement learning market making model, i.e., Deep Reinforcement Learning Market Making. It exploits long short-term memory network to extract temporal patterns of the market directly from limit order books, and it learns state-action relations via a reinforcement learning approach. In order to control inventory risk and information asymmetry, a deep Q-network is introduced to adaptively select different action subsets and train the market making agent according to the inventory states. Experiments are conducted on a six-month Level-2 data set, including 10 stock, from Shanghai Stock Exchange in China. Our model is compared with a conventional market making baseline and a state-of-the-art market making model. Experimental results show that our approach outperforms the benchmarks over 10 stocks by at least 10.63%.

Research on Reinforcement Learning Negotiation Strategy and Its Optimization

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Towards General Negotiation Strategies with End-to-End Reinforcement Learning

A Q-learning Approach to Generating Behavior of Emotional Persuasion with Adaptive Time Belief in Decision-making of Agent-based Negotiation

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

A Fairness-Driven Method for Learning Human-Compatible Negotiation Strategies

A Dynamic Strategy Coach for Effective Negotiation

A Portfolio Strategy Design for Human-Computer Negotiations in e-Retail

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

Automated Configuration of Negotiation Strategies

A Negotiator's Backup Plan: Optimal Concessions with a Reservation Value

Market Making Strategy Optimization via Deep Reinforcement Learning

Offer with Choices and Accept with Delay: A Win-Win Strategy Model for Agent Based Automated Negotiation.

A Negotiation Optimization Strategy of Collaborative Procurement with Supply Chain Based on Multi-Agent System

Decoupling Strategy and Generation in Negotiation Dialogues

Prosocial or Selfish? Agents with Different Behaviors for Contract Negotiation Using Reinforcement Learning

Alternate Strategies for a Win-Win Seeking Agent in Agent-Human Negotiations.

Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactions

Targeted Data Acquisition for Evolving Negotiation Agents

Negotiating Team Formation Using Deep Reinforcement Learning