Abstract:Portfolio management facilitates trading off risks against returns for multiple financial assets. Reinforcement Learning (RL) is one of the most promising algorithms for portfolio management. However, these state-of-the-art RL algorithms only complete the task of portfolio management, i.e., acquire the different asset features of portfolio, without considering the global context information from portfolio, which leads to non-optimal portfolio representations; Moreover, the corresponding optimizations are implemented using only the loss function in the viewpoint of RL, without considering the relationships between the local asset information and global context embeddings, which leads to non-optimal portfolio policies. To deal with these issues, this paper proposes a Task-Context Mutual Actor–Critic (TC-MAC) algorithm for portfolio management. Specifically, TC-MAC algorithm is developed based on: (1) representation learning introduces a proposed Task-Context (TC) learning algorithm, which not only encodes the task (i.e., acquire different asset features) of portfolio, but also encodes the global dynamic context of portfolio, thus which helps to learn optimal portfolio embeddings; (2) policy learning introduces a proposed Mutual Actor–Critic (MAC) framework, which can measure the relationships between local embedding of each asset and global context embeddings by maximizing mutual information, the corresponding Mutual-Information loss function combines with RL loss function (i.e., Actor–Critic loss) to collectively optimize the whole algorithm, thus which helps to learn optimal portfolio policies. Experimental results on real-world datasets demonstrate the superior performance of TC-MAC algorithm over the well-known traditional portfolio methods and these state-of-the-art RL algorithms, at the same time, show its advantageous transferability.

Relation-Aware Transformer for Portfolio Policy Learning

Online portfolio management via deep reinforcement learning with high-frequency data

Attention is all you need: An interpretable transformer-based asset allocation approach

Adaptive Long-Short Pattern Transformer for Stock Investment Selection

Asset correlation based deep reinforcement learning for the portfolio selection

Transfer learning model for cash-instrument prediction adopting a Transformer derivative

Cost-Sensitive Portfolio Selection via Deep Reinforcement Learning

Lower Risks, Better Choices: Stock Correlation Based Portfolio Selection in Stock Markets.

Portfolio Transformer for Attention-Based Asset Allocation

Portfolio Optimization with 2D Relative-Attentional Gated Transformer

New reinforcement learning based on representation transfer for portfolio management

Revolutionising Financial Portfolio Management: the Non-Stationary Transformer’s Fusion of Macroeconomic Indicators and Sentiment Analysis in a Deep Reinforcement Learning Framework

A Risk-sensitive Automatic Stock Trading Strategy Based on Deep Reinforcement Learning and Transformer

Deep reinforcement learning for portfolio management

AlphaPortfolio for Investment and Economically Interpretable AI

Temporal Relational Ranking for Stock Prediction

Reinforcement-Learning based Portfolio Management with Augmented Asset Movement Prediction States

RAT: Retrieval-Augmented Transformer for Click-Through Rate Prediction

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

HATR-I: Hierarchical Adaptive Temporal Relational Interaction for Stock Trend Prediction

Transformer-based Reinforcement Learning Model for Optimized Quantitative Trading