Abstract:The frequent missing values in radar-derived time-series tracks of aerial targets (RTT-AT) lead to significant challenges in subsequent data-driven tasks. However, the majority of imputation research focuses on random missing (RM) that differs significantly from common missing patterns of RTT-AT. The method for solving the RM may experience performance degradation or failure when applied to RTT-AT imputation. Conventional autoregressive deep learning methods are prone to error accumulation and long-term dependency loss. In this paper, a non-autoregressive imputation model that addresses the issue of missing value imputation for two common missing patterns in RTT-AT is proposed. Our model consists of two probabilistic sparse diagonal masking self-attention (PSDMSA) units and a weight fusion unit. It learns missing values by combining the representations outputted by the two units, aiming to minimize the difference between the missing values and their actual values. The PSDMSA units effectively capture temporal dependencies and attribute correlations between time steps, improving imputation quality. The weight fusion unit automatically updates the weights of the output representations from the two units to obtain a more accurate final representation. The experimental results indicate that, despite varying missing rates in the two missing patterns, our model consistently outperforms other methods in imputation performance and exhibits a low frequency of deviations in estimates for specific missing entries. Compared to the state-of-the-art autoregressive deep learning imputation model Bidirectional Recurrent Imputation for Time Series (BRITS), our proposed model reduces mean absolute error (MAE) by 31%~50%. Additionally, the model attains a training speed that is 4 to 8 times faster when compared to both BRITS and a standard Transformer model when trained on the same dataset. Finally, the findings from the ablation experiments demonstrate that the PSDMSA, the weight fusion unit, cascade network design, and imputation loss enhance imputation performance and confirm the efficacy of our design.

A Cross-Dimensional Attention Discriminating Masked Method for Building Energy Time-Series Data Imputation

Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation

An Improved Multi-Task Approach for SHM Missing Data Reconstruction Using Attentive Neural Process and Meta-Learning

Multiscale-attention Masked Autoencoder for Missing Data Imputation of Wind Turbines

Filling time-series gaps using image techniques: Multidimensional context autoencoder approach for building energy data imputation

Evaluation of data imputation approaches for multi-stream building systems data1

Interpretable deep learning model for building energy consumption prediction based on attention mechanism

TriD-MAE: A Generic Pre-trained Model for Multivariate Time Series with Missing Values

Multiple Imputation with Denoising Autoencoder using Metamorphic Truth and Imputation Feedback

Bagging Ensemble of Multilayer Perceptrons for Missing Electricity Consumption Data Imputation

An Improved Self-Attention for Long-Sequence Time-Series Data Forecasting with Missing Values

Building Energy Consumption Prediction Based on Temporal-Aware Attention and Energy Consumption States

Novel double-layer bidirectional LSTM network with improved attention mechanism for predicting energy consumption

Efficient Utilization of Missing Data in Cost-Sensitive Learning

Missing Value Imputation for Radar-Derived Time-Series Tracks of Aerial Targets Based on Improved Self-Attention-Based Network

Short-term building energy consumption prediction strategy based on modal decomposition and reconstruction algorithm

A transferred spatio-temporal deep model based on multi-LSTM auto-encoder for air pollution time series missing value imputation

A short-term energy consumption forecasting method for attention mechanisms based on spatio-temporal deep learning

Cross-modal missing time-series imputation using dense spatio-temporal transformer nets

Attention-based message passing and dynamic graph convolution for spatiotemporal data imputation

Data-Driven Copy-Paste Imputation for Energy Time Series