Abstract:The financial market, as a complex nonlinear dynamic system frequently influenced by various factors, such as international investment capital, is very challenging to build trading strategies from the obtained market information. Deep Reinforcement Learning (DRL) combines the perceptual capability of deep learning and the control decision making capability of reinforcement learning to learn the mapping between financial market states and trading decisions by interacting with the environment. In this paper, an enhanced stock trading strategy, denominated efficient deep State-Action-Reward-State-Action (SARSA), is presented to tackle the algorithmic trading problem of determining optimal trading positions in the daily trading activities of the stock market. This algorithm is recognized for its properties of stable learning and convergence, attributes of critical significance within the financial domain, where stability assumes paramount importance, and excessive risk-taking should be averted. Furthermore, a novel deep network architecture called Bidirectional Long Short-Term Memory (BiLSTM)-Attention is introduced to address the challenge of accurately presenting the complex and volatile stock market. The BiLSTM-Attention greatly enhances the network's capacity to recognize key features and patterns in stock market data, allowing agents to focus on the most relevant aspects of the data. Evaluations on DJI, SP500, GE, IXIC datasets from January 1, 2008 to December 31, 2022 show that our efficient deep SARSA algorithm outperforms a wide range of traditional strategies (B&H, S&H, MR, TF) and DRL-based strategies (TDQN, DQN-Vanilla). For example, on the IXIC dataset, the efficient deep SARSA strategy achieves an attractive Cumulative Return (CR) of 582.17% and a Sharpe Ratio (ShR) of 1.86, outperforming all other methods. These experimental results prove the performance of our method in enhancing stock trading strategies.

Intelligent trading strategy based on improved directional change and regime change detection

Incorporating Improved Directional Change and Regime Change Detection to Formulate Trading Strategies in Foreign Exchange Markets

An Overview of Event Based Directional Change for Algorithmic Trading

Deep Learning for Algorithmic Trading: Enhancing MACD Strategy.

An LSTM-based optimization algorithm for enhancing quantitative arbitrage trading

Trading Strategy Design in Financial Investment Through a Turning Points Prediction Scheme

AI-Driven Intraday Trading: Applying Machine Learning and Market Activity for Enhanced Decision Support in Financial Markets

Enhanced Bollinger Band Stock Quantitative Trading Strategy Based on Random Forest

Evaluating the Building Blocks of a Dynamically Adaptive Systematic Trading Strategy

Automated Trading Based on Biclustering Mining and Fuzzy Modeling

Biclustering Learning of Trading Rules

Improved Deep Reinforcement Learning Algorithms and Applications in Quantitative Trading in Extreme Stock Markets

Quantitative Investment Decisions Based On Machine Learning And Investor Attention Analysis

Stock trading rule discovery with an evolutionary trend following model

An adaptive financial trading strategy based on proximal policy optimization and financial signal representation

A hybrid forecasting model based on deep learning feature extraction and statistical arbitrage methods for stock trading strategies

Improved Method of Stock Trading under Reinforcement Learning Based on DRQN and Sentiment Indicators ARBR

Intelligent Stock Trading System Based on Improved Technical Analysis and Echo State Network.

Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models

R-DDQN: Optimizing Algorithmic Trading Strategies Using a Reward Network in a Double DQN

A novel deep reinforcement learning framework with BiLSTM-Attention networks for algorithmic trading