Abstract:Reinforcement learning (RL) has been applied to financial portfolio management in recent years. Current studies mostly focus on profit accumulation without much consideration of risk. Some risk‐return balanced studies extract features from price and volume data only, which is highly correlated and missing representation of risk features. To tackle these problems, we propose a weight control unit (WCU) to effectively manage the position of portfolio management in different market statuses. A loss penalty term is also designed in the reward function to prevent sharp drawdown during trading. Moreover, stock spatial interrelation representing the correlation between two different stocks is captured by a graph convolution network based on fundamental data. Temporal interrelation is also captured by a temporal convolutional network based on new factors designed with price and volume data. Both spatial and temporal interrelation work for better feature extraction from historical data and also make the model more interpretable. Finally, a deep deterministic policy gradient actor–critic RL is applied to explore optimal policy in portfolio management. We conduct our approach in a challenging non‐short‐selling market, and the experiment results show that our method outperforms the state‐of‐the‐art methods in both profit and risk criteria. Specifically, with 6.72% improvement on an annualized rate of return, 7.72% decrease in maximum drawdown, and a better annualized Sharpe ratio of 0.112. Also, the loss penalty and WCU provide new aspects for future work in risk control.

An Automated Portfolio Trading System with Feature Preprocessing and Recurrent Reinforcement Learning

Financial Trading with Feature Preprocessing and Recurrent Reinforcement Learning

Portfolio management based on a reinforcement learning framework

Deep Stock Trading: A Hierarchical Reinforcement Learning Framework for Portfolio Optimization and Order Execution

Evaluation of Deep Reinforcement Learning Based Stock Trading.

A parallel multi-module deep reinforcement learning algorithm for stock trading

Practical Deep Reinforcement Learning Approach for Stock Trading

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Automatic Financial Trading Agent for Low-risk Portfolio Management using Deep Reinforcement Learning

A Novel Deep Reinforcement Learning Based Automated Stock Trading System Using Cascaded LSTM Networks

A Risk-sensitive Automatic Stock Trading Strategy Based on Deep Reinforcement Learning and Transformer

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

Deep reinforcement learning based on transformer and U-Net framework for stock trading

A Deep Reinforcement Learning Framework For Financial Portfolio Management

Stock Trading Strategies Based on Deep Reinforcement Learning

Agent Performing Autonomous Stock Trading under Good and Bad Situations

Portfolio Management using Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

A Novel Trading Strategy Framework Based on Reinforcement Deep Learning for Financial Market Predictions

Online portfolio management via deep reinforcement learning with high-frequency data

High-Dimensional Stock Portfolio Trading with Deep Reinforcement Learning