Investigating Poor Performance Regions of Black Boxes: LIME-based Exploration in Sepsis Detection

Mozhgan Salimiparsa,Surajsinh Parmar,San Lee,Choongmin Kim,Yonghwan Kim,Jang Yong Kim
2023-06-22
Abstract:Interpreting machine learning models remains a challenge, hindering their adoption in clinical settings. This paper proposes leveraging Local Interpretable Model-Agnostic Explanations (LIME) to provide interpretable descriptions of black box classification models in high-stakes sepsis detection. By analyzing misclassified instances, significant features contributing to suboptimal performance are identified. The analysis reveals regions where the classifier performs poorly, allowing the calculation of error rates within these regions. This knowledge is crucial for cautious decision-making in sepsis detection and other critical applications. The proposed approach is demonstrated using the eICU dataset, effectively identifying and visualizing regions where the classifier underperforms. By enhancing interpretability, our method promotes the adoption of machine learning models in clinical practice, empowering informed decision-making and mitigating risks in critical scenarios.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The main objective of this paper is to address the challenge of interpretability of machine learning models in clinical settings, particularly in high-risk tasks such as sepsis detection. Specifically, the research team aims to use the Local Interpretable Model-agnostic Explanations (LIME) technique to identify and explain specific scenarios where black-box predictive models perform poorly or yield unexpected results. By analyzing instances of misclassification, they are able to pinpoint key features that lead to suboptimal performance and reveal areas where the model underperforms. This information is crucial for making cautious decisions, especially in critical applications like sepsis detection. By enhancing the interpretability of the model, this approach helps to better apply machine learning models in clinical practice, thereby promoting informed decision-making and reducing potential risks in high-risk scenarios. In short, the paper aims to improve the interpretability and reliability of machine learning models in sepsis detection through the use of LIME technology, helping healthcare practitioners identify situations where the model may err, and thus make more informed judgments.