Abstract:Time series are ubiquitous in data mining applications. Similar to other types of data, annotations can be challenging to acquire, thus preventing from training time series classification models. In this context, clustering methods can be an appropriate alternative as they create homogeneous groups allowing a better analysis of the data structure. Time series clustering has been investigated for many years and multiple approaches have already been proposed. Following the advent of deep learning in computer vision, researchers recently started to study the use of deep clustering to cluster time series data. The existing approaches mostly rely on representation learning (imported from computer vision), which consists of learning a representation of the data and performing the clustering task using this new representation. The goal of this paper is to provide a careful study and an experimental comparison of the existing literature on time series representation learning for deep clustering. In this paper, we went beyond the sole comparison of existing approaches and proposed to decompose deep clustering methods into three main components: (1) network architecture, (2) pretext loss, and (3) clustering loss. We evaluated all combinations of these components (totaling 300 different models) with the objective to study their relative influence on the clustering performance. We also experimentally compared the most efficient combinations we identified with existing non-deep clustering methods. Experiments were performed using the largest repository of time series datasets (the UCR/UEA archive) composed of 128 univariate and 30 multivariate datasets. Finally, we proposed an extension of the class activation maps method to the unsupervised case which allows to identify patterns providing highlights on how the network clustered the time series.

Incorporating with Recursive Model Training in Time Series Clustering

A Hidden Markov Model-based fuzzy modeling of multivariate time series

Recurrent Deep Divergence-based Clustering for simultaneous feature learning and clustering of variable length time series

Clustering Time Series Utilizing A Dimension Hierarchical Decomposition Approach

Learning Representations for Incomplete Time Series Clustering

End-to-end deep representation learning for time series clustering: a comparative study

Mining Complex Time-Series Data by Learning Markovian Models

A New Text Clustering Method Using Hidden Markov Model

Hierarchical Clustering using Auto-encoded Compact Representation for Time-series Analysis

Incorporating Taylor Series and Recursive Structure in Neural Networks for Time Series Prediction

Hierarchical Clustering Supported by Reciprocal Nearest Neighbors

Graph-based Time Series Clustering for End-to-End Hierarchical Forecasting

Time Series Overlapping Clustering Based on Link Community Detection

Model-Based Clustering of Time-Evolving Networks through Temporal Exponential-Family Random Graph Models

Canonical Sequence Extraction And Hmm Model Building Based On Hierarchical Clustering

Clustering hidden Markov models with variational HEM

Exploring More Representative States of Hidden Markov Model in Optical Character Recognition: A Clustering-Based Model Pre-Training Approach

Efficient Forecasting of Large Scale Hierarchical Time Series via Multilevel Clustering

Constructing hierarchical time series through clustering: Is there an optimal way for forecasting?

Forecasting Hierarchical Time Series

A machine learning approach for forecasting hierarchical time series