Abstract:Accurate imputation of missing data is pivotal in real-world industrial applications. Traditional direct imputers, which utilize basic statistics to replace missing elements, offer a practical solution but struggle to adapt to the complex patterns in industrial data, leaving a gap in the research landscape. This study explores the untapped potential of direct imputers, enhancing their adaptability and capacity to handle complex patterns in industrial data through optimal transport (OT) theory, with a focus on preserving local sample-wise similarity as an exemplar. To these ends, we construct a Local Similarity Preserved Transport (LSPT) problem, with a solution algorithm based on the Frank-Wolfe technique to compute transport cost. Subsequently, we propose the LSPT-D framework, which employs the transport cost of LSPT for distribution matching, directing the gradient flow to the missing data points to update the imputations directly. This strategy maintains local similarity throughout the imputation process thereby enhancing the overall imputation quality. Our experiments demonstrate that LSPT-D outperform various baselines in industrial missing data imputation. Note to Practitioners —Accurate missing data imputation is essential for enhancing the reliability of data analytics and reducing decision-making risks in industrial automation. This study introduces LSPT-D, a non-parametric imputation technique based on OT technology. Unique to LSPT-D is its ability to preserve local similarity during the imputation process, rendering it particularly advantageous for datasets with varying operational phases and load conditions. In industrial applications, LSPT-D not only significantly improves imputation quality compared to various baseline methods but also maintains modest running costs. Additionally, it serves as an exemplar for developing OT-based imputation strategies that capitalize on the inherent properties of data to improve imputation performance. However, LSPT-D operates under the independent and identically distributed assumption and is thus best applied in scenarios where temporal dependencies, such as trends and seasonality, are minimal or have been previously neutralized.

No Imputation Needed: A Switch Approach to Irregularly Sampled Time Series

LS-SLAM: SLAM with Lebesgue Sampling

LSPT-D: Local Similarity Preserved Transport for Direct Industrial Data Imputation

SSIM—A Deep Learning Approach for Recovering Missing Time Series Sensor Data

ReCTSi: Resource-efficient Correlated Time Series Imputation Via Decoupled Pattern Learning and Completeness-aware Attentions

Irregularity-Informed Time Series Analysis: Adaptive Modelling of Spatial and Temporal Dynamics

Unleash The Power of Pre-Trained Language Models for Irregularly Sampled Time Series

Recover Missing Sensor Data with Iterative Imputing Network

A Survey on Principles, Models and Methods for Learning from Irregularly Sampled Time Series

A Review of Deep Learning Methods for Irregularly Sampled Medical Time Series Data

TSINR: Capturing Temporal Continuity via Implicit Neural Representations for Time Series Anomaly Detection

Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Series

Stochastic Sparse Sampling: A Framework for Variable-Length Medical Time Series Classification

Cross-modal missing time-series imputation using dense spatio-temporal transformer nets

Filling out the missing gaps: Time Series Imputation with Semi-Supervised Learning

PAITS: Pretraining and Augmentation for Irregularly-Sampled Time Series

A New Imputation Technique Based a Multi-Spike Neural Network to Handle Missing Data in the Internet of Things Network (IoT)

Imputation with Inter-Series Information from Prototypes for Irregular Sampled Time Series

SDA-GRIN for Adaptive Spatial-Temporal Multivariate Time Series Imputation

Switching Autoregressive Low-rank Tensor Models

ImputeFormer: Low Rankness-Induced Transformers for Generalizable Spatiotemporal Imputation