Abstract:Abstract When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors, with decision aids, such as decision trees and flowcharts. Designing effective decision aids is a difficult problem. We propose that recently developed reinforcement learning methods for discovering clever heuristics for good decision-making can be partially leveraged to assist human experts in this design process. One of the biggest remaining obstacles to leveraging the aforementioned methods for improving human decision-making is that the policies they learn are opaque to people. To solve this problem, we introduce AI-Interpret: a general method for transforming idiosyncratic policies into simple and interpretable descriptions. Our algorithm combines recent advances in imitation learning and program induction with a new clustering method for identifying a large subset of demonstrations that can be accurately described by a simple, high-performing decision rule. We evaluate our new AI-Interpret algorithm and employ it to translate information-acquisition policies discovered through metalevel reinforcement learning. The results of three large behavioral experiments showed that providing the decision rules generated by AI-Interpret as flowcharts significantly improved people’s planning strategies and decisions across three different classes of sequential decision problems. Moreover, our fourth experiment revealed that this approach is significantly more effective at improving human decision-making than training people by giving them performance feedback. Finally, a series of ablation studies confirmed that our AI-Interpret algorithm was critical to the discovery of interpretable decision rules and that it is ready to be applied to other reinforcement learning problems. We conclude that the methods and findings presented in this article are an important step towards leveraging automatic strategy discovery to improve human decision-making. The code for our algorithm and the experiments is available at https://github.com/RationalityEnhancement/InterpretableStrategyDiscovery .

dtControl 2.0: Explainable Strategy Representation via Decision Tree Learning Steered by Experts

dtControl: Decision Tree Learning Algorithms for Controller Representation

Strategy Representation by Decision Trees in Reactive Synthesis

CDT: Cascading Decision Trees for Explainable Reinforcement Learning

A Framework for Understanding and Visualizing Strategies of RL Agents

Counterexample Explanation by Learning Small Strategies in Markov Decision Processes

SOS: Safe, Optimal and Small Strategies for Hybrid Markov Decision Processes

Digging for Decision Trees: A Case Study in Strategy Sampling and Learning

Can Differentiable Decision Trees Enable Interpretable Reward Learning from Human Feedback?

Structure and Reduction of MCTS for Explainable-AI

Interactive Decision Tree Creation and Enhancement with Complete Visualization for Explainable Modeling

Conservative Q-Improvement: Reinforcement Learning for an Interpretable Decision-Tree Policy

Automatic discovery of interpretable planning strategies

In Search of Trees: Decision-Tree Policy Synthesis for Black-Box Systems via Search

Exact and Cost-Effective Automated Transformation of Neural Network Controllers to Decision Tree Controllers

Toward Interpretable-AI Policies Using Evolutionary Nonlinear Decision Trees for Discrete-Action Systems

SkillTree: Explainable Skill-Based Deep Reinforcement Learning for Long-Horizon Control Tasks

GPTree: Towards Explainable Decision-Making via LLM-powered Decision Trees

Learning Safety Constraints From Demonstration Using One-Class Decision Trees

Towards Interpretable-AI Policies Induction using Evolutionary Nonlinear Decision Trees for Discrete Action Systems

Optimal Interpretability-Performance Trade-off of Classification Trees with Black-Box Reinforcement Learning