Abstract:Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of research for financial problems. Asset allocation, where the goal is to obtain the weights of the assets that maximize the rewards in a given state of the market considering risk and transaction costs, is a problem easily framed using a reinforcement learning framework. It is first a prediction problem for expected returns and covariance matrix and then an optimization problem for returns, risk, and market impact. Investors and financial researchers have been working with approaches like mean-variance optimization, minimum variance, risk parity, and equally weighted and several methods to make expected returns and covariance matrices' predictions more robust. This paper demonstrates the application of reinforcement learning to create a financial model-free solution to the asset allocation problem, learning to solve the problem using time series and deep neural networks. We demonstrate this on daily data for the top 24 stocks in the US equities universe with daily rebalancing. We use a deep reinforcement model on US stocks using different architectures. We use Long Short Term Memory networks, Convolutional Neural Networks, and Recurrent Neural Networks and compare them with more traditional portfolio management. The Deep Reinforcement Learning approach shows better results than traditional approaches using a simple reward function and only being given the time series of stocks. In Finance, no training to test error generalization results come guaranteed. We can say that the modeling framework can deal with time series prediction and asset allocation, including transaction costs.

A Deep Residual Shrinkage Neural Network-based Deep Reinforcement Learning Strategy in Financial Portfolio Management

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

A Deep Reinforcement Learning Framework For Financial Portfolio Management

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

Application of Deep Q-Network in Portfolio Management

Cryptocurrency Portfolio Management with Deep Reinforcement Learning

CAD: Clustering And Deep Reinforcement Learning Based Multi-Period Portfolio Management Strategy

AlphaStock: A Buying-Winners-and-Selling-Losers Investment Strategy using Interpretable Deep Reinforcement Attention Networks

Evaluation of Deep Reinforcement Learning Based Stock Trading.

Practical Deep Reinforcement Learning Approach for Stock Trading

Online portfolio management via deep reinforcement learning with high-frequency data

Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approach

Optimizing Portfolio Management and Risk Assessment in Digital Assets Using Deep Learning for Predictive Analysis

DeepTrader: A Deep Reinforcement Learning Approach for Risk-Return Balanced Portfolio Management with Market Conditions Embedding

Optimistic Bull or Pessimistic Bear: Adaptive Deep Reinforcement Learning for Stock Portfolio Allocation

Deep Reinforcement Learning for Asset Allocation in US Equities

Deep reinforcement learning for portfolio management of markets with a dynamic number of assets

Portfolio management based on a reinforcement learning framework

Deep Stock Trading: A Hierarchical Reinforcement Learning Framework for Portfolio Optimization and Order Execution

Portfolio Management using Deep Reinforcement Learning

Online Optimal Investment Portfolio Model Based on Deep Reinforcement Learning