Abstract:Financial portfolio management investment policies computed quantitatively by modern portfolio theory techniques like the Markowitz model rely on a set on assumptions that are not supported by data in high volatility markets. Hence, quantitative researchers are looking for alternative models to tackle this problem. Concretely, portfolio management is a problem that has been successfully addressed recently by Deep Reinforcement Learning (DRL) approaches. In particular, DRL algorithms train an agent by estimating the distribution of the expected reward of every action performed by an agent given any financial state in a simulator. However, these methods rely on Deep Neural Networks model to represent such a distribution, that although they are universal approximator models, they cannot explain its behaviour, given by a set of parameters that are not interpretable. Critically, financial investors policies require predictions to be interpretable, so DRL agents are not suited to follow a particular policy or explain their actions. In this work, we developed a novel Explainable Deep Reinforcement Learning (XDRL) approach for portfolio management, integrating the Proximal Policy Optimization (PPO) with the model agnostic explainable techniques of feature importance, SHAP and LIME to enhance transparency in prediction time. By executing our methodology, we can interpret in prediction time the actions of the agent to assess whether they follow the requisites of an investment policy or to assess the risk of following the agent suggestions. To the best of our knowledge, our proposed approach is the first explainable post hoc portfolio management financial policy of a DRL agent. We empirically illustrate our methodology by successfully identifying key features influencing investment decisions, which demonstrate the ability to explain the agent actions in prediction time.

Explainable Post hoc Portfolio Management Financial Policy of a Deep Reinforcement Learning agent

Explainable Deep Reinforcement Learning for Portfolio Management: An Empirical Approach

XPM: an Explainable Deep Reinforcement Learning Framework for Portfolio Management

Adversarial Deep Reinforcement Learning in Portfolio Management

A Novel Anti-Risk Method for Portfolio Trading Using Deep Reinforcement Learning

A Deep Reinforcement Learning Approach for Portfolio Management in Non‐Short‐Selling Market

The Design and Implementation of Quantum Finance-based Hybrid Deep Reinforcement Learning Portfolio Investment System

Deep Reinforcement Learning for ESG financial portfolio management

Bridging the gap between Markowitz planning and deep reinforcement learning

Model-based Deep Reinforcement Learning for Dynamic Portfolio Optimization

A General Framework on Enhancing Portfolio Management with Reinforcement Learning

Evaluation of Deep Reinforcement Learning Algorithms for Portfolio Optimisation

Deep Reinforcement Learning for Portfolio Optimization using Latent Feature State Space (LFSS) Module

A Novel Experts Advice Aggregation Framework Using Deep Reinforcement Learning for Portfolio Management

Advancing Investment Frontiers: Industry-grade Deep Reinforcement Learning for Portfolio Optimization

Combining Transformer based Deep Reinforcement Learning with Black-Litterman Model for Portfolio Optimization

Reinforcement Learning-Based Multimodal Model for the Stock Investment Portfolio Management Task

PortPortfolio Management Based on Deep Reinforcement Learning Method with Data Augment

Experiential Explanations for Reinforcement Learning

Uncertainty-Aware Reinforcement Learning for Portfolio Optimization

Model-Free Reinforcement Learning for Asset Allocation