Abstract:The financial market, as a complex nonlinear dynamic system frequently influenced by various factors, such as international investment capital, is very challenging to build trading strategies from the obtained market information. Deep Reinforcement Learning (DRL) combines the perceptual capability of deep learning and the control decision making capability of reinforcement learning to learn the mapping between financial market states and trading decisions by interacting with the environment. In this paper, an enhanced stock trading strategy, denominated efficient deep State-Action-Reward-State-Action (SARSA), is presented to tackle the algorithmic trading problem of determining optimal trading positions in the daily trading activities of the stock market. This algorithm is recognized for its properties of stable learning and convergence, attributes of critical significance within the financial domain, where stability assumes paramount importance, and excessive risk-taking should be averted. Furthermore, a novel deep network architecture called Bidirectional Long Short-Term Memory (BiLSTM)-Attention is introduced to address the challenge of accurately presenting the complex and volatile stock market. The BiLSTM-Attention greatly enhances the network's capacity to recognize key features and patterns in stock market data, allowing agents to focus on the most relevant aspects of the data. Evaluations on DJI, SP500, GE, IXIC datasets from January 1, 2008 to December 31, 2022 show that our efficient deep SARSA algorithm outperforms a wide range of traditional strategies (B&H, S&H, MR, TF) and DRL-based strategies (TDQN, DQN-Vanilla). For example, on the IXIC dataset, the efficient deep SARSA strategy achieves an attractive Cumulative Return (CR) of 582.17% and a Sharpe Ratio (ShR) of 1.86, outperforming all other methods. These experimental results prove the performance of our method in enhancing stock trading strategies.

Deep Reinforcement Learning for Dynamic Strategy Interchange in Financial Markets

Deep reinforcement learning on a multi-asset environment for trading

FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance

Deep Robust Reinforcement Learning for Practical Algorithmic Trading

Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity

A Futures Quantitative Trading Strategy Based on a Deep Reinforcement Learning Algorithm

A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

FinRL-Meta: A Universe of Near-Real Market Environments for Data-Driven Deep Reinforcement Learning in Quantitative Finance

Deep Reinforcement Learning Based Optimization and Risk Control of Trading Strategies

Dynamic Optimization of Portfolio Allocation Using Deep Reinforcement Learning

Optimal Action Space Search: an Effective Deep Reinforcement Learning Method for Algorithmic Trading

Deep Reinforcement Trading with Predictable Returns

Safe-FinRL: A Low Bias and Variance Deep Reinforcement Learning Implementation for High-Freq Stock Trading

Time-driven Feature-Aware Jointly Deep Reinforcement Learning for Financial Signal Representation and Algorithmic Trading

Bridging the gap between Markowitz planning and deep reinforcement learning

Large Language Model for Dynamic Strategy Interchange in Financial Markets

Deep Reinforcement Learning for Quantitative Trading

Developing A Multi-Agent and Self-Adaptive Framework with Deep Reinforcement Learning for Dynamic Portfolio Risk Management

DeepScalper: A Risk-Aware Reinforcement Learning Framework to Capture Fleeting Intraday Trading Opportunities

Deep Reinforcement Learning for Stock Trading with Behavioral Finance Strategy.