Abstract:Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of research for financial problems. Asset allocation, where the goal is to obtain the weights of the assets that maximize the rewards in a given state of the market considering risk and transaction costs, is a problem easily framed using a reinforcement learning framework. It is first a prediction problem for expected returns and covariance matrix and then an optimization problem for returns, risk, and market impact. Investors and financial researchers have been working with approaches like mean-variance optimization, minimum variance, risk parity, and equally weighted and several methods to make expected returns and covariance matrices' predictions more robust. This paper demonstrates the application of reinforcement learning to create a financial model-free solution to the asset allocation problem, learning to solve the problem using time series and deep neural networks. We demonstrate this on daily data for the top 24 stocks in the US equities universe with daily rebalancing. We use a deep reinforcement model on US stocks using different architectures. We use Long Short Term Memory networks, Convolutional Neural Networks, and Recurrent Neural Networks and compare them with more traditional portfolio management. The Deep Reinforcement Learning approach shows better results than traditional approaches using a simple reward function and only being given the time series of stocks. In Finance, no training to test error generalization results come guaranteed. We can say that the modeling framework can deal with time series prediction and asset allocation, including transaction costs.

A Deep Temporal Factor Analysis Method for Large Scale Financial Portfolio Selection

Spatiotemporal Adaptive Neural Network for Long-term Forecasting of Financial Time Series

Financial APT-Based Gaussian TFA Learning for Adaptive Portfolio Management

Factor Investing with a Deep Multi-Factor Model

Optimizing Financial Portfolios from the Perspective of Mining Temporal Structures of Stock Returns.

Application of Deep Learning for Factor Timing in Asset Management

Arbitrage Pricing Theory-Based Gaussian Temporal Factor Analysis For Adaptive Portfolio Management

Deep Portfolio Optimization via Distributional Prediction of Residual Factors

Neural Networks for Portfolio Analysis With Cardinality Constraints

Large (and Deep) Factor Models

NeuralFactors: A Novel Factor Learning Approach to Generative Modeling of Equities

Deep Learning in Asset Pricing

Neural Network-based Automatic Factor Construction

DoubleEnsemble: A New Ensemble Method Based on Sample Reweighting and Feature Selection for Financial Data Analysis

Deep Reinforcement Learning for Asset Allocation in US Equities

A new deep reinforcement learning model for dynamic portfolio optimization

Learning Temporal Relationships Between Financial Signals

Stock Price and Index Forecasting by Arbitrage Pricing Theory-Based Gaussian TFA Learning

Deep Learning for Finance: Deep Portfolios

Time-driven Feature-Aware Jointly Deep Reinforcement Learning for Financial Signal Representation and Algorithmic Trading

Deep Learning-Based Stock Market Prediction and Investment Model for Financial Management