Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

Underlying techniques of efficient similarity search on time series

An efficient method for time series similarity search using binary code representation and hamming distance

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

An Efficient Similarity Searching Algorithm Based on Clustering for Time Series

A Novel Similarity Search Approach for Streaming Time Series

Segment-based similar time series search

Efficient Similarity Searching Approach For Streaming Time Series

LSH and DTW-based for Searching Similar Time Series

Time series similarity searching algorithm based on Map/Reduce

Feature-Based Online Representation Algorithm for Streaming Time Series Similarity Search.

Efficient Algorithm for a Novel Pattern of Time Series

Similar Time Series Retrieval Using Only Important Segments

Subsequence Similarity Search under Time Shifting

An Adaptive Filtering Technique For Time Series Search

An Effective Similarity Measure Algorithm for Time Series Based on Key Points

Similarity Search over Time Series Data Using DCT

Similarity Match over High Speed Time-Series Streams

A NEW ALGORITHM OF SIMILARITY MINING IN TIME SERIES DATA

Set-Based Similarity Search For Time Series

Towards a faster symbolic aggregate approximation method

Fast Online Similarity Search for Uncertain Time Series