Abstract:In the era of big data, practical applications in various domains continually generate large-scale time-series data. Among them, some data show significant or potential periodicity characteristics, such as meteorological and financial data. It is critical to efficiently identify the potential periodic patterns from massive time-series data and provide accurate predictions. In this paper, a Periodicity-based Parallel Time Series Prediction (PPTSP) algorithm for large-scale time-series data is proposed and implemented in the Apache Spark cloud computing environment. To effectively handle the massive historical datasets, a Time Series Data Compression and Abstraction (TSDCA) algorithm is presented, which can reduce the data scale as well as accurately extracting the characteristics. Based on this, we propose a multi-layer time series periodic pattern recognition (MTSPPR) algorithm using the Fourier Spectrum Analysis (FSA) method. In addition, a Periodicity-based Time Series Prediction (PTSP) algorithm is proposed. Data in the subsequent period are predicted based on all previous period models, in which a time attenuation factor is introduced to control the impact of different periods on the prediction results. Moreover, to improve the performance of the proposed algorithms, we propose a parallel solution on the Apache Spark platform, using the Streaming real-time computing module. To efficiently process the large-scale time-series datasets in distributed computing environments, Distributed Streams (DStreams) and Resilient Distributed Datasets (RDDs) are used to store and calculate these datasets. Logical and data dependencies of RDDs in the P-TSDCA, P-MTSPPR, and P-PTSP processes are considered, and the corresponding parallel execution solutions are conducted. Extensive experimental results show that our PPTSP algorithm has significant advantages compared with other algorithms in terms of prediction accuracy and performance.

A Parallelized DynTARM Algorithm for the Discovery of Predictive Co-Occurrences Within Streaming Time Stamped Data

A General and Parallel Platform for Mining Co-Movement Patterns over Large-scale Trajectories.

Addressing Big Data Time Series: Mining Trillions of Time Series Subsequences Under Dynamic Time Warping

DAMP: accurate time series anomaly detection on trillions of datapoints and ultra-fast arriving data streams

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Effective Temporal Dependence Discovery in Time Series Data

Real-Time Anomaly Detection for Streaming Analytics

Parallel Detection Of Temporal Events From Streaming Data

Energy-efficient Pipelined DTW Architecture on Hybrid Embedded Platforms

Analytic Queries over Geospatial Time-Series Data Using Distributed Hash Tables

Real-time distributed co-movement pattern detection on streaming trajectories

Mining Scalable Pattern Based on Temporal Logic over Data Streams

Multi-Dimensional Regression Analysis of Time-Series Data Streams.

Beyond streams and graphs: dynamic tensor analysis.

A periodicity-based parallel time series prediction algorithm in cloud computing environments

A Framework for Pattern Mining and Anomaly Detection in Multi-dimensional Time Series and Event Logs

Periodicity-Oriented Data Analytics on Time-Series Data for Intelligence System

Dynamic statistical inference in massive datastreams

A new predictive method supporting streaming data with hybrid recurring concept drifts in process industry

Efficient Discovery of Emerging Frequent Patterns in ArbitraryWindows on Data Streams

Unsupervised real-time anomaly detection for streaming data