Abstract:Most time series data mining algorithms use similarity search as a core subroutine, and thus the time taken for similarity search is the bottleneck for virtually all time series data mining algorithms, including classification, clustering, motif discovery, anomaly detection, and so on. The difficulty of scaling a search to large datasets explains to a great extent why most academic work on time series data mining has plateaued at considering a few millions of time series objects, while much of industry and science sits on billions of time series objects waiting to be explored. In this work we show that by using a combination of four novel ideas we can search and mine massive time series for the first time. We demonstrate the following unintuitive fact: in large datasets we can exactly search under Dynamic Time Warping (DTW) much more quickly than the current state-of-the-art Euclidean distance search algorithms. We demonstrate our work on the largest set of time series experiments ever attempted. In particular, the largest dataset we consider is larger than the combined size of all of the time series datasets considered in all data mining papers ever published. We explain how our ideas allow us to solve higher-level time series data mining problems such as motif discovery and clustering at scales that would otherwise be untenable. Moreover, we show how our ideas allow us to efficiently support the uniform scaling distance measure, a measure whose utility seems to be underappreciated, but which we demonstrate here. In addition to mining massive datasets with up to one trillion datapoints, we will show that our ideas also have implications for real-time monitoring of data streams, allowing us to handle much faster arrival rates and/or use cheaper and lower powered devices than are currently possible.

Finding surprising patterns in a time series database in linear time and space

Research on methodology of time serial data mining

A Two-Phase Approach for Unexpected Pattern Mining.

Mining Surprising Periodic Patterns

Indexing And Mining Of The Local Patterns In Sequence Database

Discovering Sequential Patterns from Non-Uniform Databases

Efficient Algorithm for a Novel Pattern of Time Series

Discovery of Generalized Local Patterns in Long Sequence

Discovery of Periodic Patterns in Sequence Data: A Variance-Based Approach

Sequence Pattern Matching over Time-Series Data with Temporal Uncertainty

Scalable Sampling for High Utility Patterns

Segmental semi-markov model based online series pattern detection under arbitrary time scaling

Discovering Local Patterns From Multiple Temporal Sequences

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Addressing Big Data Time Series: Mining Trillions of Time Series Subsequences Under Dynamic Time Warping

Mining frequent temporal duration-based patterns on time interval sequential database

On the Need for Time Series Data Mining Benchmarks: A Survey and Empirical Demonstration

Surprising and novel multivariate sequential patterns using odds ratio for temporal evolution in healthcare

Sequential Pattern Mining in Databases with Temporal Uncertainty

Discovering High-Order Periodic Patterns

Discovering Temporal Patterns in Multiple Granularities.