Abstract:A pairs trading strategy (PTS) constructs and monitors a stationary portfolio by shorting (longing) when the portfolio is adequately over- (under-)priced measured by a predetermined open threshold. We close this position to earn the price differences when the portfolio's value reverts back to the mean level. When the portfolio is significantly over- (under-)priced measured by another predetermined stop-loss threshold, we close the position to stop loss. This paper develops a two-stage deep learning method to improve the investment performance of a PTS. Note that the literature executes a PTS by selecting the best trigger threshold (a combination of open and stop-loss thresholds) from a restricted, heuristically-determined set of trigger thresholds. Such a design significantly degrades investment performance. However, selecting the best threshold from all possible thresholds yields a non-converged training problem. To resolve this dilemma, we propose in the first stage of our method a representative label mechanism by which to construct a set of candidate trigger thresholds based on all possible thresholds and then train a deep learning (DL) model to select the best from the set. Experiments demonstrate that the proposed first-stage method avoids the non-converged training problem and outperforms most state-of-the-art methods. To further reduce the trading risk, the second stage trains another DL with the profitability of each trade labeled by executing the PTS with trigger thresholds recommended in the first-stage mechanism to remove unprofitable trades. Compared to models that indirectly judge profitability by price movement similarity without considering the quality of the recommended trigger thresholds, our model produces higher win rates and average profits. Furthermore, we find that training with the PTS portfolio value process exhibiting time invariance clearly outperforms training with only time-varying stock/return processes, even though - he latter training set contains more information. This is because unpredictable changes in market trends cause the model to learn time-varying patterns from the training set that may not apply to the testing set.

Deep Reinforcement Learning and Genetic Algorithm for a Pairs Trading Task on commodities

Hybrid Deep Reinforcement Learning for Pairs Trading

Commodities Trading through Deep Policy Gradient Methods

Reinforcement Learning Pair Trading: A Dynamic Scaling approach

Mastering Pair Trading with Risk-Aware Recurrent Reinforcement Learning

Deep reinforcement learning on a multi-asset environment for trading

A Reinforcement Learning Algorithm for Trading Commodities

Evaluation of Deep Reinforcement Learning Based Stock Trading.

Stochastic Spread Pairs Trading in the Indian Commodity Market

Deep Reinforcement Learning Approach for Trading Automation in The Stock Market

Improving Pairs Trading Strategies Using Two-Stage Deep Learning Methods and Analyses of Time (In)variant Inputs for Trading Performance

Combining Deep Learning on Order Books with Reinforcement Learning for Profitable Trading

Deep Reinforcement Learning in Quantitative Algorithmic Trading: A Review

Deep Reinforcement Learning Based Optimization and Risk Control of Trading Strategies

Adaptive stock trading strategies with deep reinforcement learning methods

Practical Deep Reinforcement Learning Approach for Stock Trading

A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading

Combining Transformer based Deep Reinforcement Learning with Black-Litterman Model for Portfolio Optimization

Self-adaptive Pairs Trading Model Based on Reinforcement Learning Algorithm

A General Framework for Pairs Trading with a Control-Theoretic Point of View

A parallel multi-module deep reinforcement learning algorithm for stock trading