Abstract:Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contrast, deep neural networks can learn low-dimensional features efficiently, and in particular, Convolutional Neural Networks (CNN) have shown promising results in classifying Multivariate Time Series (MTS) data. A key factor in the success of deep neural networks is this astonishing expressive power. However, this power comes at the cost of complex, black-boxed models, conflicting with the goals of building reliable and human-understandable models. An essential criterion in understanding such predictive deep models involves quantifying the contribution of time-varying input variables to the classification. Hence, in this work, we introduce a new framework for interpreting multivariate time series data by extracting and clustering the input representative patterns that highly activate CNN neurons. This way, we identify each signal's role and dependencies, considering all possible combinations of signals in the MTS input. Then, we construct a graph that captures the temporal relationship between the extracted patterns for each layer. An effective graph merging strategy finds the connection of each node to the previous layer's nodes. Finally, a graph embedding algorithm generates new representations of the created interpretable time-series features. To evaluate the performance of our proposed framework, we run extensive experiments on eight datasets of the UCR/UEA archive, along with HAR and PAM datasets. The experiments indicate the benefit of our time-aware graph-based representation in MTS classification while enriching them with more interpretability.

MagNet: Multilevel Dynamic Wavelet Graph Neural Network for Multivariate Time Series Classification

Multilevel Dynamic Time Warping: A Parameter-Light Method for Fast Time Series Classification

TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

TV-Net: Temporal-Variable feature harmonizing Network for multivariate time series classification and interpretation

Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting

Multi-Scale Adaptive Graph Neural Network for Multivariate Time Series Forecasting

Multivariate time series classification based on fusion features

Multivariate Time Series Classification with Hierarchical Variational Graph Pooling

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

MTS2Graph: Interpretable Multivariate Time Series Classification with Temporal Evolving Graphs

Multi-Scale Convolutional Neural Networks for Time Series Classification

MST-GNN: A Multi-scale Temporal-Enhanced Graph Neural Network for Anomaly Detection in Multivariate Time Series.

Attention Based CNN-LSTM Network for Anomaly Pattern Classification of Multivariate Time Series

A Multi-scale Multivariate Time Series Classification Method Based on Bag of Patterns

TimeMIL: Advancing Multivariate Time Series Classification via a Time-aware Multiple Instance Learning

TapNet: Multivariate Time Series Classification with Attentional Prototypical Network

End-to-end Multivariate Time Series Classification Via Hybrid Deep Learning Architectures

CATodyNet: Cross-attention Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

Exploiting Multi-Channels Deep Convolutional Neural Networks for Multivariate Time Series Classification

Wavelet-Temporal Neural Network for Multivariate Time Series Prediction

Multivariate Time Series Clustering based on Graph Convolutional Network