Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

NLC: Search Correlated Window Pairs on Long Time Series

Mining Associated and Item-Item Correlated Frequent Patterns

Multilevel Dynamic Time Warping: A Parameter-Light Method for Fast Time Series Classification

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

Mining Spatio-Temporal Co-Location Patterns With Weighted Sliding Window

A Windowed Phase Correlation Algorithm For Subpixel Motion Estimation

RLC: ranking lag correlations with flexible sliding windows in data streams

Static and Streaming Discovery of Maximal Linear Representation Between Time Series

Dangoron: Network Construction on Large-scale Time Series Data across Sliding Windows

Local Correlation Detection with Linearity Enhancement in Streaming Data

Finding Maximal Significant Linear Representation Between Long Time Series

A Distributed Multi-level Composite Index for KNN Processing on Long Time Series

The Normalized Kld Coefficient and Its Application in Detection of Correlation and Synchronization from Multivariable Series

Coordinated Web Scan Detection Based on Hierarchical Correlation

Constructing Compact Time Series Index for Efficient Window Query Processing

Correlation Joins over Time Series Data Streams Utilizing Complementary Dimension Reduction and Transformation

Approximate Nearest Neighbor Search with Window Filters

Mining Partial Periodic Correlations in Time Series

L-Match: A Lightweight and Effective Subsequence Matching Approach.

Research on network events correlation based on topological dependence and sliding window

An integrated approach to the assessment of long range correlation in time series data