Abstract:Variable importance plays a pivotal role in interpretable machine learning as it helps measure the impact of factors on the output of the prediction model. Model agnostic methods based on the generation of "null" features via permutation (or related approaches) can be applied. Such analysis is often utilized in pharmaceutical applications due to its ability to interpret black-box models, including tree-based ensembles. A major challenge and significant confounder in variable importance estimation however is the presence of between-feature correlation. Recently, several adjustments to marginal permutation utilizing feature knockoffs were proposed to address this issue, such as the variable importance measure known as conditional predictive impact (CPI). Assessment and evaluation of such approaches is the focus of our work. We first present a comprehensive simulation study investigating the impact of feature correlation on the assessment of variable importance. We then theoretically prove the limitation that highly correlated features pose for the CPI through the knockoff construction. While we expect that there is always no correlation between knockoff variables and its corresponding predictor variables, we prove that the correlation increases linearly beyond a certain correlation threshold between the predictor variables. Our findings emphasize the absence of free lunch when dealing with high feature correlation, as well as the necessity of understanding the utility and limitations behind methods in variable importance estimation.

Importance Analysis for Models with Correlated Variables and Its Sparse Grid Solution

Model free variable importance for high dimensional data

Sparsity Oriented Importance Learning for High-dimensional Linear Regression

Variable importance in regression models

Regression and Independence Based Variable Importance Measure.

Challenges in Variable Importance Ranking Under Correlation

Sensitivity Analysis of High-Dimensional Models with Correlated Inputs

Shapley Marginal Surplus for Strong Models

Shapley variable importance cloud for interpretable machine learning

An Overview of Computational Sparse Models and Their Applications in Artificial Intelligence

A simple approach for local and global variable importance in nonlinear regression models

Shapley variable importance clouds for interpretable machine learning

Sparsified simultaneous confidence intervals for high-dimensional linear models

Lazy Estimation of Variable Importance for Large Neural Networks

Variance estimation for sparse ultra-high dimensional varying coefficient models

Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Additive Models

Variable Importance Clouds: A Way to Explore Variable Importance for the Set of Good Models

The Importance of Variable Importance

Calculations of Sobol indices for the Gaussian process metamodel

A Computational Exploration of Emerging Methods of Variable Importance Estimation

Variance Based Global Sensitivity Analysis For Uncorrelated And Correlated Inputs With Gaussian Processes