Abstract:Deep neural networks (DNNs) have been shown to outperform traditional machine learning algorithms in a broad variety of application domains due to their effectiveness in modeling complex problems and handling high-dimensional datasets. Many real-life datasets, however, are of increasingly high dimensionality, where a large number of features may be irrelevant for both supervised and unsupervised learning tasks. The inclusion of such features would not only introduce unwanted noise but also increase computational complexity. Furthermore, due to high non-linearity and dependency among a large number of features, DNN models tend to be unavoidably opaque and perceived as black-box methods because of their not well-understood internal functioning. Their algorithmic complexity is often simply beyond the capacities of humans to understand the interplay among myriads of hyperparameters. A well-interpretable model can identify statistically significant features and explain the way they affect the model's outcome. In this paper, we propose an efficient method to improve the interpretability of black-box models for classification tasks in the case of high-dimensional datasets. First, we train a black-box model on a high-dimensional dataset to learn the embeddings on which the classification is performed. To decompose the inner working principles of the black-box model and to identify top-k important features, we employ different probing and perturbing techniques. We then approximate the behavior of the black-box model by means of an interpretable surrogate model on the top-k feature space. Finally, we derive decision rules and local explanations from the surrogate model to explain individual decisions. Our approach outperforms state-of-the-art methods like TabNet and XGboost when tested on different datasets with varying dimensionality between 50 and 20,000 w.r.t metrics and explainability.

Incorporation of Data-Mined Knowledge into Black-Box SVM for Interpretability.

Enhancing Transparency of Black-box Soft-margin SVM by Integrating Data-based Prior Information

A Novel Svm Modeling Approach For Highly Imbalanced And Overlapping Classification

Linear Priors Mined and Integrated for Transparency of Blast Furnace Black-Box SVM Model

Mining Knowledge from Unbalanced Data Based on Ν-Support Vector Machine

Mining Knowledge from Unbalanced Data: Effect of Class Distribution on SVM Classification

Explaining Black-box Models for Biomedical Text Classification

A Study of Discriminatory Speech Classification Based on Improved Smote and SVM-RF

A Double Penalty Model for Interpretability

Hybrid Predictive Model: When an Interpretable Model Collaborates with a Black-box Model

A Grey-Box Ensemble Model Exploiting Black-Box Accuracy and White-Box Intrinsic Interpretability

Domain Level Interpretability: Interpreting Black-box Model with Domain-specific Embedding.

Interpretability from a new lens: Integrating Stratification and Domain knowledge for Biomedical Applications

Personalized Interpretable Classification

A Joint Learning Framework for Optimal Feature Extraction and Multi-class SVM

Explanations of Black-Box Models based on Directional Feature Interactions

Interpreting Black-box Machine Learning Models for High Dimensional Datasets

Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence

Efficient Learning of Pinball TWSVM using Privileged Information and its applications

Integrating White and Black Box Techniques for Interpretable Machine Learning

Discriminative Feature Attributions: Bridging Post Hoc Explainability and Inherent Interpretability