Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

Network Imputation for a Spatial Autoregression Model with Incomplete Data

Network Imputation for a Spatial Autoregression Model with Incomplete Data

AGNP: Network-wide Short-Term Probabilistic Traffic Speed Prediction and Imputation

A Bipartite Graph Based Method for Traffic Continuous Data Imputation

Estimating Spatial Autocorrelation with Sampled Network Data

A Latent-Factor-Model-Based Approach for Traffic Data Imputation with Road Network Information

A Note on Estimating Network Dependence in a Discrete Choice Model

Statistica Sinica Preprint No : SS-2017-0135 Title A Naive Least Squares Method for Spatial Autoregression with Covariates

Partially Specified Spatial Autoregressive Model with Artificial Neural Network

How Do Your Neighbors Disclose Your Information: Social-Aware Time Series Imputation

Approximate Least Squares Estimation for Spatial Autoregressive Models with Covariates

Parameter Estimation in Spatial Autoregressive Models with Missing Data and Measurement Errors

Autoregressive Model with Spatial Dependence and Missing Data

A NAIVE LEAST SQUARES METHOD FOR SPATIAL AUTOREGRESSION WITH COVARIATES

Network Autoregression for Incomplete Matrix-Valued Time Series

Missing data imputation for traffic flow based on improved local least squares

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

An Empirical Study of Dynamic Incomplete-Case Nearest Neighbor Imputation in Software Quality Data.

Subnetwork Estimation for Spatial Autoregressive Models in Large-scale Networks

Spatial Dynamic Panel Models with Missing Data

Multivariate Spatial Autoregressive Model for Large Scale Social Networks