Abstract:This article describes a novel approach to the problem of developing explainable machine learning models. We consider a deep reinforcement learning (DRL) model representing a highway path planning policy for autonomous highway driving [1]. The model constitutes a mapping from the continuous multidimensional state space characterizing vehicle positions and velocities to a discrete set of actions in longitudinal and lateral direction. It is obtained by applying a customized version of the double deep <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="1.838ex" height="2.509ex" style="vertical-align: -0.671ex;" viewBox="0 -791.3 791.5 1080.4" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-51" x="0" y="0"></use></g></svg></span>-network learning algorithm [2]. The main idea is to approximate the DRL model with a set of IF–THEN rules that provide an alternative interpretable model, which is further enhanced by visualizing the rules. This concept is rationalized by the universal approximation properties of the rule-based models with fuzzy predicates. The proposed approach includes a learning engine composed of zero-order fuzzy rules, which generalize locally around the prototypes by using multivariate function models. The adjacent (in the data space) prototypes, which correspond to the same action, are further grouped and merged into the so-called MegaClouds reducing significantly the number of fuzzy rules. The input selection method is based on ranking the density of the individual inputs. Experimental results show that the specific DRL agent can be interpreted by approximating with families of rules of different granularity. The method is computationally efficient and can be potentially extended to addressing the explainability of the broader set of fully connected deep neural network models.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-51" d="M399 -80Q399 -47 400 -30T402 -11V-7L387 -11Q341 -22 303 -22Q208 -22 138 35T51 201Q50 209 50 244Q50 346 98 438T227 601Q351 704 476 704Q514 704 524 703Q621 689 680 617T740 435Q740 255 592 107Q529 47 461 16L444 8V3Q444 2 449 -24T470 -66T516 -82Q551 -82 583 -60T625 -3Q631 11 638 11Q647 11 649 2Q649 -6 639 -34T611 -100T557 -165T481 -194Q399 -194 399 -87V-80ZM636 468Q636 523 621 564T580 625T530 655T477 665Q429 665 379 640Q277 591 215 464T153 216Q153 110 207 59Q231 38 236 38V46Q236 86 269 120T347 155Q372 155 390 144T417 114T429 82T435 55L448 64Q512 108 557 185T619 334T636 468ZM314 18Q362 18 404 39L403 49Q399 104 366 115Q354 117 347 117Q344 117 341 117T337 118Q317 118 296 98T274 52Q274 18 314 18Z"></path></defs></svg>

CauseRuDi: Explaining Behavior Sequence Models by Causal Statistics Generation and Rule Distillation

RuDi: Explaining Behavior Sequence Models by Automatic Statistics Generation and Rule Distillation

Causal State Distillation for Explainable Reinforcement Learning

Explainable Neural Rule Learning

Highly explainable cumulative belief rule-based system with effective rule-base modeling and inference scheme

Doing Experiments and Revising Rules with Natural Language and Probabilistic Reasoning

Explaining Deep Learning Models Through Rule-Based Approximation and Visualization

Causal Rule Learning: Enhancing the Understanding of Heterogeneous Treatment Effect via Weighted Causal Rules

FINRule: Feature Interactive Neural Rule Learning

Learning Post-Hoc Causal Explanations for Recommendation

MetaRule: A Meta-path Guided Ensemble Rule Set Learning for Explainable Fraud Detection.

An Explainable Student Performance Prediction Method Based on Dual-Level Progressive Classification Belief Rule Base

DISCO: DISCovering Overfittings as Causal Rules for Text Classification Models

CIER: A Novel Experience Replay Approach with Causal Inference in Deep Reinforcement Learning

Subgroup Analysis via Model-based Rule Forest

From Observational Studies to Causal Rule Mining

Deep Explainable Learning with Graph Based Data Assessing and Rule Reasoning

CRTRE: Causal Rule Generation with Target Trial Emulation Framework

Learning by Doing: An Online Causal Reinforcement Learning Framework with Causal-Aware Policy

Enabling Regional Explainability by Automatic and Model-agnostic Rule Extraction

CDT: Cascading Decision Trees for Explainable Reinforcement Learning