Abstract:Most time series data mining algorithms use similarity search as a core subroutine, and thus the time taken for similarity search is the bottleneck for virtually all time series data mining algorithms, including classification, clustering, motif discovery, anomaly detection, and so on. The difficulty of scaling a search to large datasets explains to a great extent why most academic work on time series data mining has plateaued at considering a few millions of time series objects, while much of industry and science sits on billions of time series objects waiting to be explored. In this work we show that by using a combination of four novel ideas we can search and mine massive time series for the first time. We demonstrate the following unintuitive fact: in large datasets we can exactly search under Dynamic Time Warping (DTW) much more quickly than the current state-of-the-art Euclidean distance search algorithms. We demonstrate our work on the largest set of time series experiments ever attempted. In particular, the largest dataset we consider is larger than the combined size of all of the time series datasets considered in all data mining papers ever published. We explain how our ideas allow us to solve higher-level time series data mining problems such as motif discovery and clustering at scales that would otherwise be untenable. Moreover, we show how our ideas allow us to efficiently support the uniform scaling distance measure, a measure whose utility seems to be underappreciated, but which we demonstrate here. In addition to mining massive datasets with up to one trillion datapoints, we will show that our ideas also have implications for real-time monitoring of data streams, allowing us to handle much faster arrival rates and/or use cheaper and lower powered devices than are currently possible.

An Adaptive Filtering Technique For Time Series Search

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Multilevel Dynamic Time Warping: A Parameter-Light Method for Fast Time Series Classification

Speed Up Similarity Search of Time Series under Dynamic Time Warping

Segment-based similar time series search

LSH and DTW-based for Searching Similar Time Series

Fast Similarity Search Of Multi-Dimensional Time Series Via Segment Rotation

Underlying techniques of efficient similarity search on time series

Searching Time Series with Invariance to Large Amounts of Uniform Scaling

Speed Up Dynamic Time Warpingof Multivariate Time Series

Addressing Big Data Time Series: Mining Trillions of Time Series Subsequences Under Dynamic Time Warping

Similarity Search over Time Series Data Based on Walsh Transform

An Efficient Similarity Searching Algorithm Based on Clustering for Time Series

Piecewise Statistic Approximation Based Similarity Measure for Time Series

Sparsification of the Alignment Path Search Space in Dynamic Time Warping

Similarity Search over Time Series Data Using DCT

Efficient Search of the Optimal Prefix and Suffix Invariant Size for Dynamic Time Warping.

Exact Indexing for Massive Time Series Databases under Time Warping Distance

Invariant subspace learning for time series data based on dynamic time warping distance

Affine and Regional Dynamic Time Warpng

A Novel Parallel Scheme for Fast Similarity Search in Large Time Series