Abstract:The interpretability of models has become a crucial issue in Machine Learning because of algorithmic decisions' growing impact on real-world applications. Tree ensemble methods, such as Random Forests or XgBoost, are powerful learning tools for classification tasks. However, while combining multiple trees may provide higher prediction quality than a single one, it sacrifices the interpretability property resulting in "black-box" models. In light of this, we aim to develop an interpretable representation of a tree-ensemble model that can provide valuable insights into its behavior. First, given a target tree-ensemble model, we develop a hierarchical visualization tool based on a heatmap representation of the forest's feature use, considering the frequency of a feature and the level at which it is selected as an indicator of importance. Next, we propose a mixed-integer linear programming (MILP) formulation for constructing a single optimal multivariate tree that accurately mimics the target model predictions. The goal is to provide an interpretable surrogate model based on oblique hyperplane splits, which uses only the most relevant features according to the defined forest's importance indicators. The MILP model includes a penalty on feature selection based on their frequency in the forest to further induce sparsity of the splits. The natural formulation has been strengthened to improve the computational performance of {mixed-integer} software. Computational experience is carried out on benchmark datasets from the UCI repository using a state-of-the-art off-the-shelf solver. Results show that the proposed model is effective in yielding a shallow interpretable tree approximating the tree-ensemble decision function.

Visualizing the Random Forest by 3D Techniques

Random Forest Ensemble Visualization

Visualisation of Random Forest classification

Forest Floor Visualizations of Random Forests

Visualizing Random Forest with Self-Organising Map

A Visualization Method in Virtual Educational System

On random hyper-class random forest for visual classification

Interactive Graphics for Visually Diagnosing Forest Classifiers in R

Classifying Very High-Dimensional Data with Random Forests Built from Small Subspaces

Learn Decision Trees with Deep Visual Primitives

Dive into Decision Trees and Forests: A Theoretical Demonstration

A random forest guided tour

Unboxing Tree Ensembles for interpretability: a hierarchical visualization tool and a multivariate optimal re-built tree

The random subspace method for constructing decision forests

A Truly Spatial Random Forests Algorithm for Geoscience Data Analysis and Modelling

Visualizing the decision-making process in deep neural decision forest

GeoRF: a geospatial random forest

ggRandomForests: Visually Exploring a Random Forest for Regression

3D Adapted Random Forest Vision (3DARFV) for Untangling Heterogeneous-Fabric Exceeding Deep Learning Semantic Segmentation Efficiency at the Utmost Accuracy

A Novel Feature Subspace Selection Method in Random Forests for High Dimensional Data.

Distributed Representation Learning with Skip-Gram Model for Trained Random Forests