Abstract:Black-box artificial intelligence (AI) induction methods such as deep reinforcement learning (DRL) are increasingly being used to find optimal policies for a given control task. Although policies represented using a black-box AI are capable of efficiently executing the underlying control task and achieving optimal closed-loop performance-controlling the agent from the initial time step until the successful termination of an episode, the developed control rules are often complex and neither interpretable nor explainable. In this article, we use a recently proposed nonlinear decision-tree (NLDT) approach to find a hierarchical set of control rules in an attempt to maximize the open-loop performance for approximating and explaining the pretrained black-box DRL (oracle) agent using the labeled state-action dataset. Recent advances in nonlinear optimization approaches using evolutionary computation facilitate finding a hierarchical set of nonlinear control rules as a function of state variables using a computationally fast bilevel optimization procedure at each node of the proposed NLDT. In addition, we propose a reoptimization procedure for enhancing the closed-loop performance of an already derived NLDT. We evaluate our proposed methodologies (open- and closed-loop NLDTs) on different control problems having multiple discrete actions. In all these problems, our proposed approach is able to find relatively simple and interpretable rules involving one to four nonlinear terms per rule, while simultaneously achieving on par closed-loop performance when compared to a trained black-box DRL agent. A postprocessing approach for simplifying the NLDT is also suggested. The obtained results are inspiring as they suggest the replacement of complicated black-box DRL policies involving thousands of parameters (making them noninterpretable) with relatively simple interpretable policies. The results are encouraging and motivating to pursue further applications of proposed approach in solving more complex control tasks.

Natural Language Specification of Reinforcement Learning Policies Through Differentiable Decision Trees

Natural Language Reinforcement Learning

Toward Interpretable-AI Policies Using Evolutionary Nonlinear Decision Trees for Discrete-Action Systems

Towards Interpretable-AI Policies Induction using Evolutionary Nonlinear Decision Trees for Discrete Action Systems

Natural Language-conditioned Reinforcement Learning with Inside-out Task Language Development and Translation

Neural-to-Tree Policy Distillation with Policy Improvement Criterion

Learning Interpretable, High-Performing Policies for Autonomous Driving

Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents

Interpretable and Editable Programmatic Tree Policies for Reinforcement Learning

Synthesizing Programmatic Reinforcement Learning Policies with Large Language Model Guided Search

Natural Language Instruction-following with Task-related Language Development and Translation.

Influencing Reinforcement Learning through Natural Language Guidance

Distilling Reinforcement Learning Policies for Interpretable Robot Locomotion: Gradient Boosting Machines and Symbolic Regression

A Policy Search Method For Temporal Logic Specified Reinforcement Learning Tasks

Can Differentiable Decision Trees Enable Interpretable Reward Learning from Human Feedback?

Deep Reinforcement Learning with Temporal Logics

Policy Agnostic RL: Offline RL and Online RL Fine-Tuning of Any Class and Backbone

Safe Reinforcement Learning with Free-form Natural Language Constraints and Pre-Trained Language Models

Conservative Q-Improvement: Reinforcement Learning for an Interpretable Decision-Tree Policy

Sample Efficient Model-free Reinforcement Learning from LTL Specifications with Optimality Guarantees

Mission-driven Exploration for Accelerated Deep Reinforcement Learning with Temporal Logic Task Specifications