Abstract:Abstract When making decisions, people often overlook critical information or are overly swayed by irrelevant information. A common approach to mitigate these biases is to provide decision-makers, especially professionals such as medical doctors, with decision aids, such as decision trees and flowcharts. Designing effective decision aids is a difficult problem. We propose that recently developed reinforcement learning methods for discovering clever heuristics for good decision-making can be partially leveraged to assist human experts in this design process. One of the biggest remaining obstacles to leveraging the aforementioned methods for improving human decision-making is that the policies they learn are opaque to people. To solve this problem, we introduce AI-Interpret: a general method for transforming idiosyncratic policies into simple and interpretable descriptions. Our algorithm combines recent advances in imitation learning and program induction with a new clustering method for identifying a large subset of demonstrations that can be accurately described by a simple, high-performing decision rule. We evaluate our new AI-Interpret algorithm and employ it to translate information-acquisition policies discovered through metalevel reinforcement learning. The results of three large behavioral experiments showed that providing the decision rules generated by AI-Interpret as flowcharts significantly improved people’s planning strategies and decisions across three different classes of sequential decision problems. Moreover, our fourth experiment revealed that this approach is significantly more effective at improving human decision-making than training people by giving them performance feedback. Finally, a series of ablation studies confirmed that our AI-Interpret algorithm was critical to the discovery of interpretable decision rules and that it is ready to be applied to other reinforcement learning problems. We conclude that the methods and findings presented in this article are an important step towards leveraging automatic strategy discovery to improve human decision-making. The code for our algorithm and the experiments is available at https://github.com/RationalityEnhancement/InterpretableStrategyDiscovery .

SCARI: Separate and conquer algorithm for action rules and recommendations induction

GuideR: a guided separate-and-conquer rule learning in classification, regression, and survival settings

Improved Rule Based Rough Set Approach for Target Recognition

Rule Induction for Complete Information Systems in Knowledge Acquisition and Classification

FRRI: a novel algorithm for fuzzy-rough rule induction

Induction of classification rules by Gini-index based rule generation

Algorithm for Extracting All Decision Rules from Decision Information Systems

An Algorithm of Extracting Multi-hierarchical Decision Rules in Attribute-Oriented Induction

Automatic discovery of interpretable planning strategies

Predictive air combat decision model with segmented reward allocation

Dominance-based Decision Rule Induction for Multicriteria Ranking.

An Incremental Rule Induction Algorithm Based on Ordering Relations

Algorithms or Actions? A Study in Large-Scale Reinforcement Learning

Separate and conquer heuristic allows robust mining of contrast sets in classification, regression, and survival data

Learning Decision Trees and Forests with Algorithmic Recourse

Rule Induction For Incomplete Information Systems

A Scalable Two Stage Approach to Computing Optimal Decision Sets

Rule Induction Algorithm Based on Dominance-Based Rough Set Approach

bsnsing: A decision tree induction method based on recursive optimal boolean rule composition

Visual Exploration of Machine Learning Model Behavior with Hierarchical Surrogate Rule Sets

HGR 2.0: A New Rule Induction Algorithm