Feature Importance and Explainability in Quantum Machine Learning

Luke Power,Krishnendu Guha
2024-05-15
Abstract:Many Machine Learning (ML) models are referred to as black box models, providing no real insights into why a prediction is made. Feature importance and explainability are important for increasing transparency and trust in ML models, particularly in settings such as healthcare and finance. With quantum computing's unique capabilities, such as leveraging quantum mechanical phenomena like superposition, which can be combined with ML techniques to create the field of Quantum Machine Learning (QML), and such techniques may be applied to QML models. This article explores feature importance and explainability insights in QML compared to Classical ML models. Utilizing the widely recognized Iris dataset, classical ML algorithms such as SVM and Random Forests, are compared against hybrid quantum counterparts, implemented via IBM's Qiskit platform: the Variational Quantum Classifier (VQC) and Quantum Support Vector Classifier (QSVC). This article aims to provide a comparison of the insights generated in ML by employing permutation and leave one out feature importance methods, alongside ALE (Accumulated Local Effects) and SHAP (SHapley Additive exPlanations) explainers.
Machine Learning,Quantum Algebra
What problem does this paper attempt to address?
This paper explores the issues of feature importance and interpretability in quantum machine learning (QML). In the context where many machine learning models are referred to as "black-box" models, lacking insights into the predictions, researchers focus on improving the transparency and trustworthiness of the models. They combine the characteristics of quantum computing, such as superposition, with classical machine learning to create QML models and attempt to apply them in QML. The main objective of the paper is to analyze the insights of QML in feature importance and interpretability by comparing it with classical machine learning algorithms such as SVM and Support Vector Classifier (SVC), as well as Quantum Variational Classifier (VQC) and Quantum Support Vector Classifier (QSVC). By using the Iris dataset, the paper evaluates the performance and understanding of the models through feature elimination, permutation methods, as well as ALE (Accumulated Local Effects) and SHAP (SHapley Additive exPlanations) interpreters. The authors also introduce the basic concepts of quantum computing, such as quantum bits and superposition, and how classical data can be applied to quantum algorithms. In addition, the paper discusses the importance of feature importance and interpretability, including the need to increase trust in fields such as healthcare and finance. In the paper, the authors apply various methods to evaluate feature importance, such as leave-one-out (LOO) and permutation importance, and provide explanations for individual predictions using SHAP values. Overall, this paper aims to fill the gap of applying interpretability methods to QML models for multi-class data and explores new insights in data understanding in QML.