Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

Querying Similar Well-Logging Data Based on Segmented Time Series

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

A novel piecewise linear segmentation for time series

An efficient method for time series similarity search using binary code representation and hamming distance

A Novel Similarity Measure Approach for Time Series Based on PLA and DTW

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

Variable Step Algorithm for Sub-Trend Sequence Searching

Efficient Algorithm for a Novel Pattern of Time Series

Segmental semi-markov model based online series pattern detection under arbitrary time scaling

A Data-Adaptive and Dynamic Segmentation Index for Whole Matching on Time Series

Interest-Based Queries For Time Series Data

Subsequence Similarity Search under Time Shifting

Piecewise Statistic Approximation Based Similarity Measure for Time Series

Fast Online Similarity Search for Uncertain Time Series

EPLA-DSTree: Extending Piecewise Linear Approximation on a Dynamic Segmentation Tree Index in Sensor-Cloud Systems

Discovering similar time-series patterns with fuzzy clustering and DTW methods

Similarity-Based Queries for Time Series Data

On-line segmentation of time-series data

Online Series Pattern Detection Based on Advanced Segmental Semi-Markov Model

Accelerating Time Series Similarity Search under Move-Split-Merge Distance Via Dissimilarity Space Embedding

Similarity Join on Time Series by Utilizing a Dynamic Segmentation Index