Abstract:The financial market, as a complex nonlinear dynamic system frequently influenced by various factors, such as international investment capital, is very challenging to build trading strategies from the obtained market information. Deep Reinforcement Learning (DRL) combines the perceptual capability of deep learning and the control decision making capability of reinforcement learning to learn the mapping between financial market states and trading decisions by interacting with the environment. In this paper, an enhanced stock trading strategy, denominated efficient deep State-Action-Reward-State-Action (SARSA), is presented to tackle the algorithmic trading problem of determining optimal trading positions in the daily trading activities of the stock market. This algorithm is recognized for its properties of stable learning and convergence, attributes of critical significance within the financial domain, where stability assumes paramount importance, and excessive risk-taking should be averted. Furthermore, a novel deep network architecture called Bidirectional Long Short-Term Memory (BiLSTM)-Attention is introduced to address the challenge of accurately presenting the complex and volatile stock market. The BiLSTM-Attention greatly enhances the network's capacity to recognize key features and patterns in stock market data, allowing agents to focus on the most relevant aspects of the data. Evaluations on DJI, SP500, GE, IXIC datasets from January 1, 2008 to December 31, 2022 show that our efficient deep SARSA algorithm outperforms a wide range of traditional strategies (B&H, S&H, MR, TF) and DRL-based strategies (TDQN, DQN-Vanilla). For example, on the IXIC dataset, the efficient deep SARSA strategy achieves an attractive Cumulative Return (CR) of 582.17% and a Sharpe Ratio (ShR) of 1.86, outperforming all other methods. These experimental results prove the performance of our method in enhancing stock trading strategies.

Integrating Weak Aggregating Algorithm and Reinforcement Learning for Online Portfolio Selection: The WARL Strategy

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

Deep Reinforcement Learning Approach to Portfolio Optimization in the Australian Stock Market

Developing A Multi-Agent and Self-Adaptive Framework with Deep Reinforcement Learning for Dynamic Portfolio Risk Management

Boosting Moving Average Reversion Strategy for Online Portfolio Selection: A Meta-learning Approach.

Continual portfolio selection in dynamic environments via incremental reinforcement learning

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

DeepTrader: A Deep Reinforcement Learning Approach for Risk-Return Balanced Portfolio Management with Market Conditions Embedding

Robust and adaptive algorithms for online portfolio selection

Vector Autoregressive Weighting Reversion Strategy for Online Portfolio Selection.

Aggregating closing position experts for online portfolio selection

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

MetaTrader: An Reinforcement Learning Approach Integrating Diverse Policies for Portfolio Optimization

Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction States

Combining Transformer based Deep Reinforcement Learning with Black-Litterman Model for Portfolio Optimization

Online portfolio management via deep reinforcement learning with high-frequency data

Benchmarking Robustness of Deep Reinforcement Learning approaches to Online Portfolio Management

A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading

A new deep reinforcement learning model for dynamic portfolio optimization

Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approach

Fairness in Multi-agent Reinforcement Learning for Stock Trading