Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

Spatio-Temporal View GAIN for Data Imputation and Dynamic Soft Sensor

Denoising Diffusion Straightforward Models for Energy Conversion Monitoring Data Imputation

A Spatiotemporal Industrial Soft Sensor Modeling Scheme for Quality Prediction With Missing Data

A Missing Manufacturing Process Data Imputation Framework for Nonlinear Dynamic Soft Sensor Modeling and Its Application

A Probabilistic Just-in-Time Learning Framework for Soft Sensor Development with Missing Data

Robust spatial temporal imputation based on spatio-temporal generative adversarial nets

Deep Compressed Sensing Based Data Imputation for Urban Environmental Monitoring

Recover Missing Sensor Data with Iterative Imputing Network

Missing Data Repairs for Traffic Flow With Self-Attention Generative Adversarial Imputation Net

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Enhancing the Reliability and Accuracy of Data-Driven Dynamic Soft Sensor Based on Selective Dynamic Partial Least Squares Models

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Improving the Performance of Just-In-Time Learning-Based Soft Sensor Through Data Augmentation

A Graph-Based Approach for Missing Sensor Data Imputation

LSTGCN: Inductive Spatial Temporal Imputation Using Long Short Term Dependencies

SDA-GRIN for Adaptive Spatial-Temporal Multivariate Time Series Imputation

Continuous Imputation of Missing Values in Time Series Via Wasserstein Generative Adversarial Imputation Networks and Variational Auto-Encoders Model

A Deep Probabilistic Transfer Learning Framework for Soft Sensor Modeling With Missing Data

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

Imputation using information fusion technique for sensor generated incomplete data with high missing gap

Parallel Generative Adversarial Imputation Network for Multivariate Missing Time-Series Reconstruction and Its Application to Aeroengines