Abstract:Cost‐sensitive ensemble learning as a combination of two approaches, ensemble learning and cost‐sensitive learning, enables generation of cost‐sensitive tree‐based ensemble models using the cost‐sensitive decision tree (CSDT) learning algorithm. In general, tree‐based models characterize nice graphical representation that can explain a model's decision‐making process. However, the depth of the tree and the number of base models in the ensemble can be a limiting factor in comprehending the model's decision for each sample. The CSDT models are widely used in finance (e.g., credit scoring and fraud detection) but lack effective explanation methods. We previously addressed this gap with cost‐sensitive tree Shapley Additive Explanation Method (CSTreeSHAP), a cost‐sensitive tree explanation method for the single‐tree CSDT model. Here, we extend the introduced methodology to cost‐sensitive ensemble models, particularly cost‐sensitive random forest models. The paper details the theoretical foundation and implementation details of CSTreeSHAP for both single CSDT and ensemble models. The usefulness of the proposed method is demonstrated by providing explanations for single and ensemble CSDT models trained on well‐known benchmark credit scoring datasets. Finally, we apply our methodology and analyze the stability of explanations for those models compared to the cost‐insensitive tree‐based models. Our analysis reveals statistically significant differences between SHAP values despite seemingly similar global feature importance plots of the models. This highlights the value of our methodology as a comprehensive tool for explaining CSDT models.

A-PETE: Adaptive Prototype Explanations of Tree Ensembles

ProtoTEx: Explaining Model Decisions with Prototype Tensors

Evaluation and Improvement of Interpretability for Self-Explainable Part-Prototype Networks

This looks more like that: Enhancing Self-Explaining Models by Prototypical Relevance Propagation

Probabilistic Modeling Ensemble Vision Transformer Improves Complex Polyp Segmentation

Exploiting Patterns to Explain Individual Predictions

Decision Predicate Graphs: Enhancing Interpretability in Tree Ensembles

Prototype-based Embedding Network for Scene Graph Generation

Optimal Counterfactual Explanations in Tree Ensembles

Extending Explainable Ensemble Trees (E2Tree) to regression contexts

Conceptual views on tree ensemble classifiers

PETapter: Leveraging PET-style classification heads for modular few-shot parameter-efficient fine-tuning

GPTree: Towards Explainable Decision-Making via LLM-powered Decision Trees

BELLATREX: Building Explanations through a LocaLly AccuraTe Rule EXtractor

PAGE: Prototype-Based Model-Level Explanations for Graph Neural Networks

Post-hoc Part-prototype Networks

Inherently Interpretable Tree Ensemble Learning

A Hierarchical Prototype-Based Approach for Classification.

PEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure

Policy Trees for Prediction: Interpretable and Adaptive Model Selection for Machine Learning

Cost‐sensitive tree SHAP for explaining cost‐sensitive tree‐based models