Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

Quarter-Point Product Quantization for approximate nearest neighbor search

Quarter-Point Codeword Expansion for Product Quantization.

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Flexible Product Quantization for Fast Approximate Nearest Neighbor Search.

Product quantization with dual codebooks for approximate nearest neighbor search

Codebook-softened product quantization for high accuracy approximate nearest neighbor search

Mean-Removed Product Quantization for Approximate Nearest Neighbor Search.

Transformed Residual Quantization for Approximate Nearest Neighbor Search

Local Deep Learning Quantization for Approximate Nearest Neighbor Search

PQBF: I/O-Efficient Approximate Nearest Neighbor Search by Product Quantization.

Distribution Sensitive Product Quantization.

Dynamic programming based optimized product quantization for approximate nearest neighbor search.

Optimized High Order Product Quantization for Approximate Nearest Neighbors Search.

Approximate Nearest Neighbor Based Feature Quantization Algorithm For Robust Hashing

Semi-supervised product quantization for approximate nearest neighbor search

RaBitQ: Quantizing High-Dimensional Vectors with a Theoretical Error Bound for Approximate Nearest Neighbor Search

Derived Codebooks for High-Accuracy Nearest Neighbor Search

Composite Quantization for Approximate Nearest Neighbor Search

Stacked Product Quantization For Nearest Neighbor Search On Large Datasets

Fast Norm-Ordered Nearest-Neighbor Codeword Search Algorithms For Image Vector Quantization

Equal-Average Equal-Variance Nearest Neighbor Search Algorithm Based on Hadamard Transform