Abstract:Conventional time series classification approaches based on bags of patterns or shapelets face significant challenges in dealing with a vast amount of feature candidates from high-dimensional multivariate data. In contrast, deep neural networks can learn low-dimensional features efficiently, and in particular, Convolutional Neural Networks (CNN) have shown promising results in classifying Multivariate Time Series (MTS) data. A key factor in the success of deep neural networks is this astonishing expressive power. However, this power comes at the cost of complex, black-boxed models, conflicting with the goals of building reliable and human-understandable models. An essential criterion in understanding such predictive deep models involves quantifying the contribution of time-varying input variables to the classification. Hence, in this work, we introduce a new framework for interpreting multivariate time series data by extracting and clustering the input representative patterns that highly activate CNN neurons. This way, we identify each signal's role and dependencies, considering all possible combinations of signals in the MTS input. Then, we construct a graph that captures the temporal relationship between the extracted patterns for each layer. An effective graph merging strategy finds the connection of each node to the previous layer's nodes. Finally, a graph embedding algorithm generates new representations of the created interpretable time-series features. To evaluate the performance of our proposed framework, we run extensive experiments on eight datasets of the UCR/UEA archive, along with HAR and PAM datasets. The experiments indicate the benefit of our time-aware graph-based representation in MTS classification while enriching them with more interpretability.

Multivariate Time Series Classification with Hierarchical Variational Graph Pooling

TodyNet: Temporal Dynamic Graph Neural Network for Multivariate Time Series Classification

XCM: an Explainable Convolutional Neural Network for Multivariate Time Series Classification.

Multivariate Time Series Clustering based on Graph Convolutional Network

TV-Net: Temporal-Variable feature harmonizing Network for multivariate time series classification and interpretation

MTS2Graph: Interpretable Multivariate Time Series Classification with Temporal Evolving Graphs

MagNet: Multilevel Dynamic Wavelet Graph Neural Network for Multivariate Time Series Classification

MTHetGNN: A Heterogeneous Graph Embedding Framework for Multivariate Time Series Forecasting

A Multi-scale Multivariate Time Series Classification Method Based on Bag of Patterns

Multivariate time series classification based on fusion features

TDG4MSF: A temporal decomposition enhanced graph neural network for multivariate time series forecasting

Parallel Multi-Scale Dynamic Graph Neural Network for Multivariate Time Series Forecasting

Densely Knowledge-Aware Network for Multivariate Time Series Classification

FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classification

End-to-end Multivariate Time Series Classification Via Hybrid Deep Learning Architectures

Hierarchical Multi-View Graph Pooling with Structure Learning

Multi-scale Graph Pooling Approach with Adaptive Key Subgraph for Graph Representations

Irregularly Sampled Multivariate Time Series Classification: A Graph Learning Approach

Multivariate Time Series Forecasting with Transfer Entropy Graph

An Explainable Dual-Mode Convolutional Neural Network for Multivariate Time Series Classification

Multivariate Time Series Classification with Crucial Timestamps Guidance