Abstract:Time series data have exploded due to the popularity of new applications, like data center management and IoT. Time series data management system (TSDB), emerges to store and query the large volume of time series data. Subsequence matching is critical in many time series mining algorithms, and extensive approaches have been proposed. However, the shift of distributed storage system and the performance gap make these approaches not compatible with TSDB. To fill this gap, we propose a new index structure, KV-index, and the corresponding matching algorithm, KV-match. KV-index is a file-based structure, which can be easily implemented on local files, HDFS or HBase tables. KV-match algorithm probes the index efficiently with a few sequential scans. Moreover, two optimization techniques, window reduction and window reordering, are proposed to further accelerate the processing. To support the query of arbitrary lengths, we extend KV-match to KV-match$_{DP}$, which utilizes multiple varied length indexes to process the query simultaneously. A two-dimensional dynamic programming algorithm is proposed to find the optimal query segmentation. We implement our approach on both local files and HBase tables, and conduct extensive experiments on synthetic and real-world datasets. Results show that our index is of comparable size to the popular tree-style index while our query processing is order of magnitudes more efficient.

Improving Indexing Approach on Time Series Based on Minimum Bounding Rectangle

An efficient method for time series similarity search using binary code representation and hamming distance

A novel piecewise linear segmentation for time series

A New Representation and Distance Measure for Financial Time Series

Integrating Data-Driven Segmentation, Local Feature Extraction and Fisher Kernel Encoding to Improve Time Series Classification

CIVET: Exploring Compact Index for Variable-Length Subsequence Matching on Time Series

Time series indexing by dynamic covering with cross-range constraints

A Data-Adaptive and Dynamic Segmentation Index for Whole Matching on Time Series

Similarity Search of Time Series with Moving Average Based Indexing

Indexable Online Time Series Segmentation with Error Bound Guarantee

Fast Similarity Search Of Multi-Dimensional Time Series Via Segment Rotation

KV-match: An Efficient Subsequence Matching Approach for Large Scale Time Series.

Segmental semi-markov model based online series pattern detection under arbitrary time scaling

Finding Discriminative Subsequences Via a Coverage Measure and Mutual Information Selection Strategy for Multi-Class Time Series Classification

Time series representation: a random shifting perspective

KV-match: A Subsequence Matching Approach Supporting Normalization and Time Warping

An Efficient Content-based Time Series Retrieval System

Fine-grained Pattern Matching Over Streaming Time Series

An Improved Important Points Based on Method for Time Series Data Segmentation

Supporting Subseries Nearest Neighbor Search Via Approximation

Temporal Treasure Hunt: Content-based Time Series Retrieval System for Discovering Insights