Abstract:Reinforcement learning is a machine learning approach concerned with solving dynamic optimization problems in an almost model-free way by maximizing a reward function in state and action spaces. This property makes it an exciting area of research for financial problems. Asset allocation, where the goal is to obtain the weights of the assets that maximize the rewards in a given state of the market considering risk and transaction costs, is a problem easily framed using a reinforcement learning framework. It is first a prediction problem for expected returns and covariance matrix and then an optimization problem for returns, risk, and market impact. Investors and financial researchers have been working with approaches like mean-variance optimization, minimum variance, risk parity, and equally weighted and several methods to make expected returns and covariance matrices' predictions more robust. This paper demonstrates the application of reinforcement learning to create a financial model-free solution to the asset allocation problem, learning to solve the problem using time series and deep neural networks. We demonstrate this on daily data for the top 24 stocks in the US equities universe with daily rebalancing. We use a deep reinforcement model on US stocks using different architectures. We use Long Short Term Memory networks, Convolutional Neural Networks, and Recurrent Neural Networks and compare them with more traditional portfolio management. The Deep Reinforcement Learning approach shows better results than traditional approaches using a simple reward function and only being given the time series of stocks. In Finance, no training to test error generalization results come guaranteed. We can say that the modeling framework can deal with time series prediction and asset allocation, including transaction costs.

Solving The Dynamic Volatility Fitting Problem: A Deep Reinforcement Learning Approach

Adaptive learning for financial markets mixing model-based and model-free RL for volatility targeting

Bridging the gap between Markowitz planning and deep reinforcement learning

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

Hedging American Put Options with Deep Reinforcement Learning

Deep Reinforcement Trading with Predictable Returns

Deep reinforcement learning on a multi-asset environment for trading

Deep Deterministic Portfolio Optimization

Optimizing Deep Reinforcement Learning for American Put Option Hedging

Deep differentiable reinforcement learning and optimal trading

Deep Reinforcement Learning for Equal Risk Pricing and Hedging under Dynamic Expectile Risk Measures

A Primer on Deep Reinforcement Learning for Finance

Applying Deep Learning to Calibrate Stochastic Volatility Models

From Bandits Model to Deep Deterministic Policy Gradient, Reinforcement Learning with Contextual Information

Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity

Deep Reinforcement Learning for Online Optimal Execution Strategies

Deep Reinforcement Learning Approach for Trading Automation in The Stock Market

Deep Hedging with Market Impact

Deep Reinforcement Learning for Asset Allocation in US Equities

Deep Reinforcement Learning for Portfolio Optimization using Latent Feature State Space (LFSS) Module

Mean-Variance Efficient Reinforcement Learning with Applications to Dynamic Financial Investment