Abstract:Across various sectors such as healthcare, criminal justice, national security, finance, and technology, large-scale machine learning (ML) and artificial intelligence (AI) systems are being deployed to make critical data-driven decisions. Many have asked if we can and should trust these ML systems to be making these decisions. Two critical components are prerequisites for trust in ML systems: interpretability, or the ability to understand why the ML system makes the decisions it does, and fairness, which ensures that ML systems do not exhibit bias against certain individuals or groups. Both interpretability and fairness are important and have separately received abundant attention in the ML literature, but so far, there have been very few methods developed to directly interpret models with regard to their fairness. In this paper, we focus on arguably the most popular type of ML interpretation: feature importance scores. Inspired by the use of decision trees in knowledge distillation, we propose to leverage trees as interpretable surrogates for complex black-box ML models. Specifically, we develop a novel fair feature importance score for trees that can be used to interpret how each feature contributes to fairness or bias in trees, tree-based ensembles, or tree-based surrogates of any complex ML system. Like the popular mean decrease in impurity for trees, our Fair Feature Importance Score is defined based on the mean decrease (or increase) in group bias. Through simulations as well as real examples on benchmark fairness datasets, we demonstrate that our Fair Feature Importance Score offers valid interpretations for both tree-based ensembles and tree-based surrogates of other ML systems.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to explain the impact of features on the fairness of prediction in machine - learning models. Specifically, the author focuses on Feature Importance Scores (FIS), which is a common method for explaining decision trees and their ensemble models. However, the existing FIS mainly focuses on the impact of features on the prediction accuracy of the model, without considering the impact of these features on the fairness of the model (i.e., reducing or increasing bias). Therefore, the paper proposes a new Fair Feature Importance Score (FairFIS) to explain the contribution of features in improving or reducing the fairness of model prediction. ### Main contributions of the paper: 1. **Proposing FairFIS**: This is the first feature importance score specifically designed to explain the impact of features on fairness in decision trees. FairFIS calculates the importance of each feature based on the change in group bias before and after splitting. 2. **Extension to tree - based models**: The author details how to apply FairFIS to tree - based ensemble models (such as random forests and gradient boosting) and tree - based global surrogate models for complex machine - learning systems. 3. **Empirical verification**: Through experiments on simulated data and benchmark datasets, the effectiveness of FairFIS is verified. The results show that FairFIS can accurately reflect the contribution of features to the fairness of the model and performs consistently in different types of models. ### Formula analysis: - **FIS (Feature Importance Score)**: \[ \text{FIS}_j=\sum_{t = 0}^{T - 1}1\{(t,j)\}\left(w_tL(y_t,\hat{y}_t)-\left(w_{c_{\ell}(t)}L(y_{c_{\ell}(t)},\hat{y}_{c_{\ell}(t)})+w_{c_r(t)}L(y_{c_r(t)},\hat{y}_{c_r(t)})\right)\right) \] where \(L\) is the loss function, \(w_t\) is the weighted number of samples at node \(t\), and \(1\{(t,j)\}\) is an indicator variable indicating whether feature \(j\) is split at node \(t\). - **FairFIS (Fair Feature Importance Score)**: \[ \text{FairFIS}_j=\sum_{t = 0}^{T - 1}1\{(t,j)\}w_t\left(\text{Bias}(\text{lev}(t))-\text{Bias}(c(t))\right) \] where \(\text{Bias}(\text{lev}(t))\) and \(\text{Bias}(c(t))\) are the bias measures at the level of node \(t\) and its child nodes respectively. - **Bias measures**: - **Demographic Parity (DP)**: \[ \text{Bias}_{\text{DP}}(\text{lev}(t))=\left|E(\hat{y}_i|z_i = 1,i\in\text{lev}(t))-E(\hat{y}_i|z_i = 0,i\in\text{lev}(t))\right| \] - **Equality of Opportunity (EQOP)**: \[ \text{Bias}_{\text{EQOP}}(\text{lev}(t))=\left|E(\hat{y}_i = 1|y_i = 1,z_i = 1,i\in\text{lev}(t))-E(\hat{y}_i = 1|y_i = 1,z_i

Fair Feature Importance Scores for Interpreting Tree-Based Methods and Surrogates

From unbiased MDI Feature Importance to Explainable AI for Trees

EiFFFeL: Enforcing Fairness in Forests by Flipping Leaves

Learning Optimal and Fair Decision Trees for Non-Discriminative Decision-Making

Wasserstein-based fairness interpretability framework for machine learning models

Online Decision Trees with Fairness

Unboxing Tree Ensembles for interpretability: a hierarchical visualization tool and a multivariate optimal re-built tree

Importance measures derived from random forests: characterisation and extension

How Biased are Your Features?: Computing Fairness Influence Functions with Global Sensitivity Analysis

Learning Optimal Fair Scoring Systems for Multi-Class Classification

A Debiased MDI Feature Importance Measure for Random Forests

FairSense: Long-Term Fairness Analysis of ML-Enabled Systems

Fairer and more accurate, but for whom?

On marginal feature attributions of tree-based models

Fairness-aware Summarization for Justified Decision-Making

Towards A Holistic View of Bias in Machine Learning: Bridging Algorithmic Fairness and Imbalanced Learning

Single Sample Feature Importance: An Interpretable Algorithm for Low-Level Feature Analysis

Variable importance analysis with interpretable machine learning for fair risk prediction

Beyond Importance Scores: Interpreting Tabular ML by Visualizing Feature Semantics

DeforestVis: Behavior Analysis of Machine Learning Models with Surrogate Decision Stumps

Toward a Fairness-Aware Scoring System for Algorithmic Decision-Making