Abstract:Dynamic Portfolio optimization is the process of distribution and rebalancing of a fund into different financial assets such as stocks, cryptocurrencies, etc, in consecutive trading periods to maximize accumulated profits or minimize risks over a time horizon. This field saw huge developments in recent years, because of the increased computational power and increased research in sequential decision making through control theory. Recently Reinforcement Learning(RL) has been an important tool in the development of sequential and dynamic portfolio optimization theory. In this paper, we design a Deep Reinforcement Learning(DRL) framework as an autonomous portfolio optimization agent consisting of a Latent Feature State Space(LFSS) Module for filtering and feature extraction of financial data which is used as a state space for deep RL model. We develop an extensive RL agent with high efficiency and performance advantages over several benchmarks and model-free RL agents used in prior work. The noisy and non-stationary behaviour of daily asset prices in the financial market is addressed through Kalman Filter. Autoencoders, ZoomSVD, and restricted Boltzmann machines were the models used and compared in the module to extract relevant time series features as state space. We simulate weekly data, with practical constraints and transaction costs, on a portfolio of S&P 500 stocks. We introduce a new benchmark based on technical indicator Kd-Index and Mean-Variance Model as compared to equal weighted portfolio used in most of the prior work. The study confirms that the proposed RL portfolio agent with state space function in the form of LFSS module gives robust results with an attractive performance profile over baseline RL agents and given benchmarks.

Portfolio management based on a reinforcement learning framework

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

A Deep Reinforcement Learning Framework For Financial Portfolio Management

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

Application of Features and Neural Network to Enhance the Performance of Deep Reinforcement Learning in Portfolio Management

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

New reinforcement learning based on representation transfer for portfolio management

Online portfolio management via deep reinforcement learning with high-frequency data

Deep reinforcement learning for portfolio management of markets with a dynamic number of assets

Deep Stock Trading: A Hierarchical Reinforcement Learning Framework for Portfolio Optimization and Order Execution

Online Optimal Investment Portfolio Model Based on Deep Reinforcement Learning

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Reinforcement Learning Portfolio Manager Framework with Monte Carlo Simulation

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

GPM: A Graph Convolutional Network based Reinforcement Learning Framework for Portfolio Management

Cryptocurrency Portfolio Management with Deep Reinforcement Learning

Deep Reinforcement Learning for Stock Portfolio Optimization

Deep Reinforcement Learning for Portfolio Optimization using Latent Feature State Space (LFSS) Module

A Deep Residual Shrinkage Neural Network-based Deep Reinforcement Learning Strategy in Financial Portfolio Management

A Hierarchical Reinforcement Learning Framework for Stock Selection and Portfolio

Developing A Multi-Agent and Self-Adaptive Framework with Deep Reinforcement Learning for Dynamic Portfolio Risk Management