Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

Fast Correlation Coefficient Estimation Algorithm for HBase-based Massive Time Series Data

An efficient method for time series similarity search using binary code representation and hamming distance

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Fast approximate correlation for massive time-series data.

KV-match: An Efficient Subsequence Matching Approach for Large Scale Time Series.

A Distributed Multi-level Composite Index for KNN Processing on Long Time Series

A Novel Parallel Scheme for Fast Similarity Search in Large Time Series

Indexable Online Time Series Segmentation with Error Bound Guarantee

Analytic Queries over Geospatial Time-Series Data Using Distributed Hash Tables

Efficient Evaluation of Composite Correlations for Streaming Time Series

Dangoron: Network Construction on Large-scale Time Series Data across Sliding Windows

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Two-step Clustering Method of Time Series Clustering Based on Cross-Correlation

MOST: Model-Based Compression with Outlier Storage for Time Series Data

HGST: A Hilbert-GeoSOT Spatio-Temporal Meshing and Coding Method for Efficient Spatio-Temporal Range Query on Massive Trajectory Data

Distributed storage of network measurement data on HBase

A Hilbert-GeoSOT Spatio-Temporal Meshing and Coding Method for Efficient Spatio-Temporal Range Query on Massive Trajectory Data

Statistical Learning-Based Prediction of Execution Time of Data-Intensive Program Under Hadoop2.0.

An Effective Constraint-Based Anomaly Detection Approach on Multivariate Time Series.

Deep Hashing-based Dynamic Stock Correlation Estimation Via Normalizing Flow.

Effective Temporal Dependence Discovery in Time Series Data