Abstract:The similarity search on sensor data generated by a myriad of sensing devices is a frequently encountered problem in the era of the Internet of Things (IoT). This sensor data generally appear in the form of time series, a temporally ordered sequence of real numbers obtained regularly in time. It has been widely accepted that the dynamic time warping (DTW) currently is the most prevalent similarity measure in the time-series mining community, mainly due to its flexibility and broad applicability. However, calculating DTW between two time series has quadratic time complexity, leading to unsatisfactory efficiency when performing the similarity search over the large time-series data set. The main contribution of this article is to propose a method called product quantization (PQ)-based DTW (PQDTW) for fast time-series approximate similarity search under DTW. The PQ, a well-known approximate nearest neighbor search approach, is used in PQDTW. Nevertheless, the conventional PQ is developed with the Euclidean distance and is not designed for DTW. To solve this problem, the DTW barycenter averaging (DBA) technique is utilized to adapt the PQ for DTW before using it. We employ PQDTW along with the filter-and-refine framework to efficiently and accurately perform the time-series similarity search. Our method can reasonably reduce many DTW computations in the filtering phase; thus, the query process is accelerated. We compare PQDTW with related popular algorithms using public time-series data sets. Experimental results verify that the proposal achieves the best tradeoff between query efficiency and retrieval accuracy compared to the competitors.

Interest-Based Queries For Time Series Data

Research on methodology of time serial data mining

Dynamic Time Warping under Product Quantization, with Applications to Time-Series Data Similarity Search

An efficient method for time series similarity search using binary code representation and hamming distance

Micro Similarity Queries in Time Series Database

Interactive Rare-Category-of-Interest Mining from Large Datasets

Similarity Measure Based on Partial Information of Time Series

Similarity-Based Queries for Time Series Data

Multi-Querying: A Subsequence Matching Approach to Support Multiple Queries.

Data Mining in Time Series: Current Study and Future Trend

An Approach to Discovering Multi-Temporal Patterns and Its Application to Financial Databases

Time-dependent Semantic Similarity Measure of Queries Using Historical Click-Through Data.

Efficient Algorithm for a Novel Pattern of Time Series

General Hierarchical Model (ghm) to Measure Similarity of Time Series

Towards a faster symbolic aggregate approximation method

The Research and Application of Multivariate Time Series Similarity Data Mining

Discovering similar time-series patterns with fuzzy clustering and DTW methods

Relation-driven Query of Multiple Time Series

Dynamic Semantic Clustering Approach For Web User Interest

Towards a Near Universal Time Series Data Mining Tool: Introducing the Matrix Profile

An Efficient Content-based Time Series Retrieval System