Inherently Interpretable Time Series Classification via Multiple Instance Learning

Joseph Early,Gavin KC Cheung,Kurt Cutajar,Hanting Xie,Jas Kandola,Niall Twomey

2024-03-16

Abstract:Conventional Time Series Classification (TSC) methods are often black boxes that obscure inherent interpretation of their decision-making processes. In this work, we leverage Multiple Instance Learning (MIL) to overcome this issue, and propose a new framework called MILLET: Multiple Instance Learning for Locally Explainable Time series classification. We apply MILLET to existing deep learning TSC models and show how they become inherently interpretable without compromising (and in some cases, even improving) predictive performance. We evaluate MILLET on 85 UCR TSC datasets and also present a novel synthetic dataset that is specially designed to facilitate interpretability evaluation. On these datasets, we show MILLET produces sparse explanations quickly that are of higher quality than other well-known interpretability methods. To the best of our knowledge, our work with MILLET, which is available on GitHub (<a class="link-external link-https" href="https://github.com/JAEarly/MILTimeSeriesClassification" rel="external noopener nofollow">this https URL</a>), is the first to develop general MIL methods for TSC and apply them to an extensive variety of domains

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

The paper aims to address two main issues in Time Series Classification (TSC):

1. **Black-box problem**: Existing deep learning methods, while performing well in terms of predictive performance, are often considered "black boxes," meaning they cannot explain the key features (class-conditional discriminative patterns) in their decision-making process. This lack of transparency hinders the model's practical application.
2. **Loss of time point representation**: Traditional methods tend to weight all time points equally during aggregation, leading to the loss of representation information for each time point.

To overcome these issues, the authors propose a new framework called MILLET (Multiple Instance Learning for Locally Explainable Time series classification), which leverages Multiple Instance Learning (MIL) techniques to achieve intrinsic interpretability of the model without sacrificing, and even enhancing, predictive performance. Specifically, MILLET treats a time series as a "bag" in MIL, where each time point is considered an "instance." This approach not only identifies the key time points that influence predictions but also demonstrates its superiority in effectiveness and interpretability across multiple datasets.