Abstract:Portfolio management facilitates trading off risks against returns for multiple financial assets. Reinforcement Learning (RL) is one of the most promising algorithms for portfolio management. However, these state-of-the-art RL algorithms only complete the task of portfolio management, i.e., acquire the different asset features of portfolio, without considering the global context information from portfolio, which leads to non-optimal portfolio representations; Moreover, the corresponding optimizations are implemented using only the loss function in the viewpoint of RL, without considering the relationships between the local asset information and global context embeddings, which leads to non-optimal portfolio policies. To deal with these issues, this paper proposes a Task-Context Mutual Actor–Critic (TC-MAC) algorithm for portfolio management. Specifically, TC-MAC algorithm is developed based on: (1) representation learning introduces a proposed Task-Context (TC) learning algorithm, which not only encodes the task (i.e., acquire different asset features) of portfolio, but also encodes the global dynamic context of portfolio, thus which helps to learn optimal portfolio embeddings; (2) policy learning introduces a proposed Mutual Actor–Critic (MAC) framework, which can measure the relationships between local embedding of each asset and global context embeddings by maximizing mutual information, the corresponding Mutual-Information loss function combines with RL loss function (i.e., Actor–Critic loss) to collectively optimize the whole algorithm, thus which helps to learn optimal portfolio policies. Experimental results on real-world datasets demonstrate the superior performance of TC-MAC algorithm over the well-known traditional portfolio methods and these state-of-the-art RL algorithms, at the same time, show its advantageous transferability.

Twin-system recurrent reinforcement learning for optimizing portfolio strategy

Portfolio management based on a reinforcement learning framework

A Deep Reinforcement Learning Framework For Financial Portfolio Management

Continual portfolio selection in dynamic environments via incremental reinforcement learning

Reinforcement Learning Portfolio Manager Framework with Monte Carlo Simulation

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

A hybrid decision support system for adaptive trading strategies: Combining a rule-based expert system with a deep reinforcement learning strategy

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management

Deep reinforcement learning for portfolio management

Deep Reinforcement Learning for Stock Portfolio Optimization

A Deep Residual Shrinkage Neural Network-based Deep Reinforcement Learning Strategy in Financial Portfolio Management

From deterministic to stochastic: an interpretable stochastic model-free reinforcement learning framework for portfolio optimization

Optimizing Automated Trading Systems with Deep Reinforcement Learning

Online portfolio management via deep reinforcement learning with high-frequency data

Causal Inference on Investment Constraints and Non-stationarity in Dynamic Portfolio Optimization through Reinforcement Learning

New reinforcement learning based on representation transfer for portfolio management

Optimizing Portfolio with Two-Sided Transactions and Lending: A Reinforcement Learning Framework

A Hierarchical Reinforcement Learning Framework for Stock Selection and Portfolio