Abstract:Data missing in collections of time series occurs frequently in practical applications and turns out to be a major menace to precise data analysis. However, most of the existing methods either might be infeasible or could be inefficient to predict the missing values in large-scale coevolving time series. Also, the evolving of time series needs to be handled properly to adapt to the temporal characteristic. Furthermore, more massive volume of data is generated in many areas than ever before. In this paper, we have taken up the challenge of missing data prediction in coevolving time series by employing temporal dynamic matrix factorization techniques. First, our approaches are optimally designed to largely utilize both the interior patterns of each time series and the information of time series across multiple sources to build an initial model. Based on the idea, we have imposed hybrid regularization terms to constrain the objective functions of matrix factorization. Then, temporal dynamic matrix factorization is proposed to effectively update the initial already trained models. In the process of dynamic matrix factorization, batch updating and fine-tuning strategies are also employed to build an effective and efficient model. Extensive experiments on real-world data sets and synthetic data set demonstrate that the proposed approaches can effectively improve the performance of missing data prediction. Even when the missing ratio reaches as high as 90%, our proposed methods still show low prediction errors. Dynamic performance demonstrates that the methods can obtain satisfactory effectiveness and efficiency. Furthermore, we have also demonstrated how to take advantage of the high processing power of Apache Spark to perform missing data prediction in large-scale coevolving time series.

LIFE: Learning Individual Features for Multivariate Time Series Prediction with Missing Values

Foreformer: an Enhanced Transformer-Based Framework for Multivariate Time Series Forecasting

TriD-MAE: A Generic Pre-trained Model for Multivariate Time Series with Missing Values

DBT-DMAE: An Effective Multivariate Time Series Pre-Train Model under Missing Data

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

An End-to-End Model for Time Series Classification In the Presence of Missing Values

Order-Preserving Metric Learning for Mining Multivariate Time Series

Enhancing Multivariate Time Series Forecasting with Mutual Information-driven Cross-Variable and Temporal Modeling

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

Temporal Dynamic Matrix Factorization for Missing Data Prediction in Large Scale Coevolving Time Series

A Fuzzy C-means Clustering-Based Hybrid Multivariate Time Series Prediction Framework with Feature Selection

Evolutionary Ensemble Learning for Multivariate Time Series Prediction

Effective Prediction of Missing Data on Apache Spark over Multivariable Time Series.

Face Image Modeling by Multilinear Subspace Analysis with Missing Values

CATS: Enhancing Multivariate Time Series Forecasting by Constructing Auxiliary Time Series as Exogenous Variables

Missing Value Imputation on Multidimensional Time Series

Relevance Vector Machines-Based Time Series Prediction for Incomplete Training Dataset: Two Comparative Approaches

A dual-stage attention-based Bi-LSTM network for multivariate time series prediction

Incomplete Electrocardiogram Time Series Prediction

A Divide-and-Rule Combined Learning Method for Truly Multivariate Time Series Prediction

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting