Abstract:Multi-modal time series data in real applications often contain data of different dimensionalities, e.g., high-dimensional modality such as image data series, and low-dimensional univariate time series. Multi-modal time series data with missing high-dimensional modal values are ubiquitous in real-world classification and regression applications. To accurately predict the target labels, it is important to appropriately impute the high-dimensional modal missing values. However, most existing imputation methods focus on multivariate time series, fail to simultaneously consider temporal dependencies within each series and the correlations across the series, and also lack a probabilistic interpretation. In this paper, we propose a novel method, which uses a new structured variational approximation technique for the imputation of missing values in multi-modal time series. Instead of directly imputing high-dimensional modal missing values, we use the variational approximation technique to impute intermediate lower-dimensional feature representations of high-dimensional modal missing values from simple modalities related to high-dimensional modality and then feed them into a dynamical model. The dynamical model captures the temporal dependencies of the feature representations and finally predicts the target labels. In order to address the optimization difficulties caused by the lack of ground truth values of lower-dimensional feature representations, we also propose a two-stage isolated optimization strategy for better convergence. We evaluate our method on a real-world stream monitoring dataset. Our extensive experiments demonstrate that the proposed method outperforms several state-of-the-art methods in both data imputation and prediction performance.

VIMTS: Variational-based Imputation for Multi-modal Time Series

Missing Value Imputation on Multidimensional Time Series

Probabilistic Imputation for Time-series Classification with Missing Data

BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition

TriD-MAE: A Generic Pre-trained Model for Multivariate Time Series with Missing Values

GP-VAE: Deep Probabilistic Time Series Imputation

On-Line Imputation For Missing Values

Deep Learning for Multivariate Time Series Imputation: A Survey

Missing Value Imputation for Traffic-Related Time Series Data Based on a Multi-View Learning Method.

Parallel Generative Adversarial Imputation Network for Multivariate Missing Time-Series Reconstruction and Its Application to Aeroengines

Conditional Lagrangian Wasserstein Flow for Time Series Imputation

Cross-modal missing time-series imputation using dense spatio-temporal transformer nets

BRITS: Bidirectional Recurrent Imputation for Time Series

A data imputation method for multivariate time series based on generative adversarial network.

Variational Auto-Encoders Based on the Shift Correction for Imputation of Specific Missing in Multivariate Time Series

Multiview data fusion technique for missing value imputation in multisensory air pollution dataset

Is Precise Recovery Necessary? A Task-Oriented Imputation Approach for Time Series Forecasting on Variable Subset

MuSDRI: Multi-Seasonal Decomposition Based Recurrent Imputation for Time Series

ImputeGAN: Generative Adversarial Network for Multivariate Time Series Imputation.

An Observed Value Consistent Diffusion Model for Imputing Missing Values in Multivariate Time Series

Feature Analysis for Incomplete Time Series Classification