Abstract:Deep reinforcement learning (DRL) can be used to extract deep features that can be incorporated into reinforcement learning systems to enable improved decision-making; DRL can therefore also be used for managing stock portfolios. Traditional methods cannot fully exploit the advantages of DRL because they are generally based on real-time stock quotes, which do not have sufficient features for making comprehensive decisions. In this study, in addition to stock quotes, we introduced stock financial indices as additional stock features. Moreover, we used Markowitz mean-variance theory for determining stock correlation. A three-agent deep reinforcement learning model called Collaborative Multi-agent reinforcement learning-based stock Portfolio management System (CMPS) was designed and trained based on fused data. In CMPS, each agent was implemented with a deep Q-network to obtain the features of time-series stock data, and a self-attention network was used to combine the output of each agent. We added a risk-free asset strategy to CMPS to prevent risks and referred to this model as CMPS-Risk Free (CMPS-RF). We conducted experiments under different market conditions using the stock data of China Shanghai Stock Exchange 50 and compared our model with the state-of-the-art models. The results showed that CMPS could obtain better profits than the compared benchmark models, and CMPS-RF was able to accurately recognize the market risk and achieved the best Sharpe and Calmar ratios. The study findings are expected to aid in the development of an efficient investment-trading strategy.

Online Optimal Investment Portfolio Model Based on Deep Reinforcement Learning

A new deep reinforcement learning model for dynamic portfolio optimization

A novel stock portfolio model based on deep reinforcement learning

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

Dynamic Graph-based Deep Reinforcement Learning with Long and Short-term Relation Modeling for Portfolio Optimization.

A Deep Reinforcement Learning Model for Portfolio Management Incorporating Historical Stock Prices and Risk Information

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

A Deep Reinforcement Learning Framework For Financial Portfolio Management

Deep Reinforcement Learning Model for Stock Portfolio Management Based on Data Fusion

Model Based Reinforcement Learning with Non-Gaussian Environment Dynamics and Its Application to Portfolio Optimization

PortPortfolio Management Based on Deep Reinforcement Learning Method with Data Augment

Cryptocurrency Portfolio Management with Deep Reinforcement Learning

Portfolio management based on a reinforcement learning framework

Application of Features and Neural Network to Enhance the Performance of Deep Reinforcement Learning in Portfolio Management

Online portfolio management via deep reinforcement learning with high-frequency data

Applications of Markov Decision Process Model and Deep Learning in Quantitative Portfolio Management During the COVID-19 Pandemic

A Deep Reinforcement Learning Model for Portfolio Management Based on Weight Adjustment

Optimizing Portfolio Management and Risk Assessment in Digital Assets Using Deep Learning for Predictive Analysis

Application of Deep Q-Network in Portfolio Management

Factor Representation and Decision Making in Stock Markets Using Deep Reinforcement Learning

Dynamic Optimization of Portfolio Allocation Using Deep Reinforcement Learning