Abstract:In the era of big data, practical applications in various domains continually generate large-scale time-series data. Among them, some data show significant or potential periodicity characteristics, such as meteorological and financial data. It is critical to efficiently identify the potential periodic patterns from massive time-series data and provide accurate predictions. In this paper, a Periodicity-based Parallel Time Series Prediction (PPTSP) algorithm for large-scale time-series data is proposed and implemented in the Apache Spark cloud computing environment. To effectively handle the massive historical datasets, a Time Series Data Compression and Abstraction (TSDCA) algorithm is presented, which can reduce the data scale as well as accurately extracting the characteristics. Based on this, we propose a multi-layer time series periodic pattern recognition (MTSPPR) algorithm using the Fourier Spectrum Analysis (FSA) method. In addition, a Periodicity-based Time Series Prediction (PTSP) algorithm is proposed. Data in the subsequent period are predicted based on all previous period models, in which a time attenuation factor is introduced to control the impact of different periods on the prediction results. Moreover, to improve the performance of the proposed algorithms, we propose a parallel solution on the Apache Spark platform, using the Streaming real-time computing module. To efficiently process the large-scale time-series datasets in distributed computing environments, Distributed Streams (DStreams) and Resilient Distributed Datasets (RDDs) are used to store and calculate these datasets. Logical and data dependencies of RDDs in the P-TSDCA, P-MTSPPR, and P-PTSP processes are considered, and the corresponding parallel execution solutions are conducted. Extensive experimental results show that our PPTSP algorithm has significant advantages compared with other algorithms in terms of prediction accuracy and performance.

Pseudo Period Detection on Time Series Stream with Scale Smoothing

An Algorithm for Data Stream Speed Anomaly Detection Based on RCSW

Supervised Anomaly Detection in Uncertain Pseudo-Periodic Data Streams

Segmental semi-markov model based online series pattern detection under arbitrary time scaling

Multiscale water quality contamination events detection based on sensitive time scales reconstruction

Similarity Match over High Speed Time-Series Streams

PeriodicSketch: Finding Periodic Items in Data Streams

Effective variation management for pseudo periodical streams.

Online Series Pattern Detection Based on Advanced Segmental Semi-Markov Model

Detecting Changes in Data Streams without Knowing the True Class Labels

Fine-grained Pattern Matching Over Streaming Time Series

Pgg: an Online Pattern Based Approach for Stream Variation Management

A Segment-Wise Method for Pseudo Periodic Time Series Prediction

Time-domain period detection in short-duration videos

Multi-scale streaming anomalies detection for time series

Anomaly Detection for Time Series Data Stream

Efficient Detection of Discords for Time Series Stream

Detecting Lasting and Abrupt Bursts in Data Streams Using Two-Layered Wavelet Tree

Multi-Dimensional Regression Analysis of Time-Series Data Streams.

Mining Asynchronous Periodic Patterns in Time Series Data.

A periodicity-based parallel time series prediction algorithm in cloud computing environments