Abstract:Most time series data mining algorithms use similarity search as a core subroutine, and thus the time taken for similarity search is the bottleneck for virtually all time series data mining algorithms, including classification, clustering, motif discovery, anomaly detection, and so on. The difficulty of scaling a search to large datasets explains to a great extent why most academic work on time series data mining has plateaued at considering a few millions of time series objects, while much of industry and science sits on billions of time series objects waiting to be explored. In this work we show that by using a combination of four novel ideas we can search and mine massive time series for the first time. We demonstrate the following unintuitive fact: in large datasets we can exactly search under Dynamic Time Warping (DTW) much more quickly than the current state-of-the-art Euclidean distance search algorithms. We demonstrate our work on the largest set of time series experiments ever attempted. In particular, the largest dataset we consider is larger than the combined size of all of the time series datasets considered in all data mining papers ever published. We explain how our ideas allow us to solve higher-level time series data mining problems such as motif discovery and clustering at scales that would otherwise be untenable. Moreover, we show how our ideas allow us to efficiently support the uniform scaling distance measure, a measure whose utility seems to be underappreciated, but which we demonstrate here. In addition to mining massive datasets with up to one trillion datapoints, we will show that our ideas also have implications for real-time monitoring of data streams, allowing us to handle much faster arrival rates and/or use cheaper and lower powered devices than are currently possible.

DTW-Based Subsequence Similarity Search on AMD Heterogeneous Computing Platform

Accelerating subsequence similarity search based on dynamic time warping distance with FPGA.

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Parallelization of Dynamic Time Warping on a Heterogeneous Platform.

Energy-efficient Pipelined DTW Architecture on Hybrid Embedded Platforms

Segment-based similar time series search

Parallelizing Dynamic Time Warping Algorithm Using Prefix Computations on GPU

A new parallel method of smith-waterman algorithm on a heterogeneous platform

ASW: Accelerating Smith–Waterman Algorithm on Coupled CPU–GPU Architecture

A Novel Parallel Scheme for Fast Similarity Search in Large Time Series

Accelerating Dynamic Time Warping with Memristor-Based Customized Fabrics.

Speed Up Similarity Search of Time Series under Dynamic Time Warping

An Improved Smith-Waterman Algorithm on Heterogeneous CPU-GPU Systems

GPU Accelerated Biological Sequence Alignment

A GPU-based Parallel Algorithm for Time Series Pattern Mining

A GPU Acceleration Framework for Motif and Discord Based Pattern Mining.

Accelerating Time Series Similarity Search under Move-Split-Merge Distance Via Dissimilarity Space Embedding

Addressing Big Data Time Series: Mining Trillions of Time Series Subsequences Under Dynamic Time Warping

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search

Fast Similarity Matching on Data Stream with Noise.

CuHMMer: A load-balanced CPU-GPU cooperative bioinformatics application