Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

A Spatio-Temporal Diffusion Model for Missing and Real-Time Financial Data Inference

Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation

PriSTI: A Conditional Diffusion Framework for Spatiotemporal Imputation

Spatiotemporal Imputation of Traffic Emissions with Self-Supervised Diffusion Model

Temporal Disentangled Contrastive Diffusion Model for Spatiotemporal Imputation

Diffusion Models for Multivariate Time Series Generation with Missing Values

An Observed Value Consistent Diffusion Model for Imputing Missing Values in Multivariate Time Series

RDPI: A Refine Diffusion Probability Generation Method for Spatiotemporal Data Imputation

The Nonparametric Estimation of Time- Dependent Diffusion Models

FastSTI: A Fast Conditional Pseudo Numerical Diffusion Model for Spatio-temporal Traffic Data Imputation

sasdim: self-adaptive noise scaling diffusion model for spatial time series imputation

Latent Space Score-based Diffusion Model for Probabilistic Multivariate Time Series Imputation

DiffSTOCK: Probabilistic relational Stock Market Predictions using Diffusion Models

Retrieval-Augmented Diffusion Models for Time Series Forecasting

On Semiparametrically Dynamic Functional-Coefficient Autoregressive Spatio-Temporal Models with Irregular Location Wide Nonstationarity

The Time Dependency Predictive Model on the Basis of Community Detection and Long-Short Term Memory.

A Hybrid Data-Driven Framework for Spatiotemporal Traffic Flow Data Imputation

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

Revisiting time-varying dynamics in stock market forecasting: A Multi-source sentiment analysis approach with large language model

Model and Forecast Stock Market Behavior Integrating Investor Sentiment Analysis and Transaction Data

MTSCI: A Conditional Diffusion Model for Multivariate Time Series Consistent Imputation