Info-CELS: Informative Saliency Map Guided Counterfactual Explanation

Peiyu Li,Omar Bahri,Pouya Hosseinzadeh,Soukaïna Filali Boubrahimi,Shah Muhammad Hamdi
2024-10-28
Abstract:As the demand for interpretable machine learning approaches continues to grow, there is an increasing necessity for human involvement in providing informative explanations for model decisions. This is necessary for building trust and transparency in AI-based systems, leading to the emergence of the Explainable Artificial Intelligence (XAI) field. Recently, a novel counterfactual explanation model, CELS, has been introduced. CELS learns a saliency map for the interest of an instance and generates a counterfactual explanation guided by the learned saliency map. While CELS represents the first attempt to exploit learned saliency maps not only to provide intuitive explanations for the reason behind the decision made by the time series classifier but also to explore post hoc counterfactual explanations, it exhibits limitations in terms of high validity for the sake of ensuring high proximity and sparsity. In this paper, we present an enhanced approach that builds upon CELS. While the original model achieved promising results in terms of sparsity and proximity, it faced limitations in validity. Our proposed method addresses this limitation by removing mask normalization to provide more informative and valid counterfactual explanations. Through extensive experimentation on datasets from various domains, we demonstrate that our approach outperforms the CELS model, achieving higher validity and producing more informative explanations.
Machine Learning
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of insufficient interpretability in time - series classification, especially the challenges faced by existing counterfactual explanation methods in generating effective and informative explanations. Specifically, the paper points out: 1. **Limitations of existing methods**: - Existing counterfactual explanation methods (such as CELS) perform well in sparsity and proximity, but are deficient in validity. That is, the generated counterfactual explanations cannot always successfully change the model's prediction results. - These methods usually rely on mask normalization, which may introduce unnecessary noise, leading to a decline in the effectiveness and interpretability of the explanations. 2. **Proposed new method**: - The paper proposes an improved method - Info - CELS (Informative Saliency Map Guided Counterfactual Explanation), which improves the effectiveness and informativeness of counterfactual explanations by removing the normalization step. - The goal of Info - CELS is to generate smoother and less abrupt counterfactual explanations, thereby reducing noise and enhancing the reliability of the explanations. 3. **Research objectives**: - Improve the validity of counterfactual explanations and ensure that the generated explanations can successfully change the model's prediction results. - Generate more informative and interpretable counterfactual explanations while maintaining sparsity and proximity. - Through extensive experimental verification, prove the superior performance of Info - CELS on multiple datasets. ### Summary The main purpose of the paper is to propose a new counterfactual explanation generation method - Info - CELS by improving the existing CELS method, in order to solve the problems existing in the current methods when generating effective and informative explanations. Specifically, Info - CELS improves the effectiveness and informativeness of counterfactual explanations by removing the normalization step, thus providing a more reliable and transparent explanation method for time - series classification.