Abstract:In real-world scenarios like traffic and energy, massive time-series data with missing values and noises are widely observed, even sampled irregularly. While many imputation methods have been proposed, most of them work with a local horizon, which means models are trained by splitting the long sequence into batches of fit-sized patches. This local horizon can make models ignore global trends or periodic patterns. More importantly, almost all methods assume the observations are sampled at regular time stamps, and fail to handle complex irregular sampled time series arising from different applications. Thirdly, most existing methods are learned in an offline manner. Thus, it is not suitable for many applications with fast-arriving streaming data. To overcome these limitations, we propose BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition. We treat the multivariate time series as the weighted combination of groups of low-rank temporal factors with different patterns. We apply a group of Gaussian Processes (GPs) with different kernels as functional priors to fit the factors. For computational efficiency, we further convert the GPs into a state-space prior by constructing an equivalent stochastic differential equation (SDE), and developing a scalable algorithm for online inference. The proposed method can not only handle imputation over arbitrary time stamps, but also offer uncertainty quantification and interpretability for the downstream application. We evaluate our method on both synthetic and real-world datasets.We release the code at {<a class="link-external link-https" href="https://github.com/xuangu-fang/BayOTIDE" rel="external noopener nofollow">this https URL</a>}

Multiple Imputation Based on Bayesian Principal Component Analysis and Bootstrap

Multiple Imputation of Missing Categorical and Continuous Values via Bayesian Mixture Models with Local Dependence

PCA-Based Missing Information Imputation for Real-Time Crash Likelihood Prediction under Imbalanced Data.

Principal Component Analysis based frameworks for efficient missing data imputation algorithms

An Empirical Comparison of Multiple Imputation Methods for Categorical Data

Multiple Imputation for Time Series Data with Amelia Package

BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition

MIMCA: Multiple imputation for categorical variables with multiple correspondence analysis

Hybrid Multi-kernels Estimation Method for Data Imputation

A Bayesian two-step multiple imputation approach based on mixed models for the missing in EMA data

Multiple Imputation of Hierarchical Nonlinear Time Series Data with an Application to School Enrollment Data

BRITS: Bidirectional Recurrent Imputation for Time Series

A Data Imputation Method Based on Deep Belief Network

A Bpca Based Missing Value Imputing Method For Traffic Flow Volume Data

Bootstrap inference for multiple imputation under uncongeniality and misspecification

Bayesian Recurrent Framework for Missing Data Imputation and Prediction with Clinical Time Series

Multiple Imputation Through XGBoost

Multiple imputation in data that grow over time: A comparison of three strategies

A BPCA Based Missing Value Imputation and Its Impact on Traffic Incident Prediction

A Hybrid Imputation Method Based on Denoising Restricted Boltzmann Machine

Multiple imputation method of missing credit risk assessment data based on generative adversarial networks