Abstract:Advancements in machine learning have led to an increased interest in applying deep reinforcement learning techniques to investment decision-making problems. Despite this, existing approaches often rely solely on single-scaling daily data, neglecting the importance of multi-scaling information, such as weekly or monthly data, in decision-making processes. To address this limitation, a multi-scaling convolutional neural network for reinforcement learning-based stock trading, termed multi-scaling convolutional neural network SARSA (state, action, reward, state, action), is proposed. Our method utilizes a multi-scaling convolutional neural network to obtain multi-scaling features of daily and weekly financial data automatically. This involves using a convolutional neural network with several filter sizes to perform a multi-scaling extraction of temporal features. Multiple-scaling feature mining allows agents to operate over longer time scaling, identifying low stock positions on the weekly line and avoiding daily fluctuations during continuous declines. This mimics the human approach of considering information at varying temporal and spatial scaling during stock trading. We further enhance the network's robustness by adding an average pooling layer to the backbone convolutional neural network, reducing overfitting. State, action, reward, state, action, as an on-policy reinforcement learning method, generates dynamic trading strategies that combine multi-scaling information across different time scaling, while avoiding dangerous strategies. We evaluate the effectiveness of our proposed method on four real-world datasets (Dow Jones, NASDAQ, General Electric, and AAPLE) spanning from 1 January 2007 to 31 December 2020, and demonstrate its superior profits compared to several baseline methods. In addition, we perform various comparative and ablation tests in order to demonstrate the superiority of the proposed network architecture. Through these experiments, our proposed multi-scaling module yields better results compared to the single-scaling module.

CNN-DRL for Scalable Actions in Finance

CNN-DRL with Shuffled Features in Finance

A Multi-Scaling Reinforcement Learning Trading System Based on Multi-Scaling Convolutional Neural Networks

Gradient Reduction Convolutional Neural Network Policy for Financial Deep Reinforcement Learning

Deep reinforcement learning on a multi-asset environment for trading

A Novel Deep Reinforcement Learning Based Automated Stock Trading System Using Cascaded LSTM Networks

FinRL-Podracer: High Performance and Scalable Deep Reinforcement Learning for Quantitative Finance

Learning financial asset-specific trading rules via deep reinforcement learning

Deep Reinforcement Learning Approach for Trading Automation in The Stock Market

Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity

Deep Reinforcement Learning for Active High Frequency Trading

Advancing Algorithmic Trading: A Multi-Technique Enhancement of Deep Q-Network Models

A synchronous deep reinforcement learning model for automated multi-stock trading

Financial Trading as a Game: A Deep Reinforcement Learning Approach

FinRL: Deep Reinforcement Learning Framework to Automate Trading in Quantitative Finance

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

A Reinforcement Learning Based Encoder-Decoder Framework for Learning Stock Trading Rules

Financial Time Series Forecasting using CNN and Transformer

Deep reinforcement learning based on transformer and U-Net framework for stock trading

Deep Direct Reinforcement Learning for Financial Signal Representation and Trading.

Deep Reinforcement Learning For Trading - A Critical Survey