Abstract:Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contrast, deep neural networks can learn low-dimensional features efficiently, and in particular, Convolutional Neural Networks (CNN) have shown promising results in classifying Multivariate Time Series (MTS) data. A key factor in the success of deep neural networks is this astonishing expressive power. However, this power comes at the cost of complex, black-boxed models, conflicting with the goals of building reliable and human-understandable models. An essential criterion in understanding such predictive deep models involves quantifying the contribution of time-varying input variables to the classification. Hence, in this work, we introduce a new framework for interpreting multivariate time series data by extracting and clustering the input representative patterns that highly activate CNN neurons. This way, we identify each signal's role and dependencies, considering all possible combinations of signals in the MTS input. Then, we construct a graph that captures the temporal relationship between the extracted patterns for each layer. An effective graph merging strategy finds the connection of each node to the previous layer's nodes. Finally, a graph embedding algorithm generates new representations of the created interpretable time-series features. To evaluate the performance of our proposed framework, we run extensive experiments on eight datasets of the UCR/UEA archive, along with HAR and PAM datasets. The experiments indicate the benefit of our time-aware graph-based representation in MTS classification while enriching them with more interpretability.

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve The paper attempts to address the interpretability issue in Multivariate Time Series (MTS) classification. Specifically, traditional time series classification methods based on pattern bags or shapelets face a significant challenge of a large number of feature candidates when dealing with high-dimensional multivariate data. Although deep neural networks (especially Convolutional Neural Networks, CNNs) perform excellently in classifying multivariate time series data, these models usually have a black-box nature and lack interpretability, which is a major issue in applications requiring reliable and human-understandable models. To improve model interpretability, the authors propose a new framework—MTS2Graph, which interprets multivariate time series data by extracting and clustering representative patterns of highly activated CNN neurons' inputs. This framework identifies the role and dependencies of each signal by constructing a graph that captures the temporal relationships between the extracted patterns and generates new time series feature representations. Experimental results show that this method enhances model interpretability while improving the performance of multivariate time series classification.

MTS2Graph: Interpretable Multivariate Time Series Classification with Temporal Evolving Graphs

XCM: an Explainable Convolutional Neural Network for Multivariate Time Series Classification.

Multivariate Time Series Clustering based on Graph Convolutional Network

TV-Net: Temporal-Variable feature harmonizing Network for multivariate time series classification and interpretation

Expressing Multivariate Time Series as Graphs with Time Series Attention Transformer

Multivariate Time Series Classification with Hierarchical Variational Graph Pooling

End-to-end Multivariate Time Series Classification Via Hybrid Deep Learning Architectures

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Graph neural networks for multivariate time series regression with application to seismic data

MTHetGNN: A Heterogeneous Graph Embedding Framework for Multivariate Time Series Forecasting

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

An Explainable Dual-Mode Convolutional Neural Network for Multivariate Time Series Classification

Irregularly Sampled Multivariate Time Series Classification: A Graph Learning Approach

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

MagNet: Multilevel Dynamic Wavelet Graph Neural Network for Multivariate Time Series Classification

Multivariate Time Series Forecasting Based on Causal Inference with Transfer Entropy and Graph Neural Network

Exploiting Multi-Channels Deep Convolutional Neural Networks for Multivariate Time Series Classification

A Deep Neural Network for Multivariate Time Series Clustering with Result Interpretation

A Novel Encoder-Decoder Model for Multivariate Time Series Forecasting

Multivariate Time Series Forecasting with Transfer Entropy Graph