Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

Data Imputation Using Least Squares Support Vector Machines in Urban Arterial Streets

Missing data imputation for traffic flow based on improved local least squares

Adaptive Rolling Smoothing with Heterogeneous Data for Traffic State Estimation and Prediction.

Missing Traffic Data: Comparison of Imputation Methods

A Latent-Factor-Model-Based Approach for Traffic Data Imputation with Road Network Information

A Kriging based spatiotemporal approach for traffic volume data imputation

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

A hybrid model for missing traffic flow data imputation based on clustering and attention mechanism optimizing LSTM and AdaBoost

A BPCA Based Missing Value Imputation and Its Impact on Traffic Incident Prediction

Learning traffic as videos: A spatio-temporal VAE approach to periodic traffic raster data imputation

An Experimental Evaluation of Imputation Models for Spatial-Temporal Traffic Data

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

A Novel Traffic Flow Data Imputation Method for Traffic State Identification and Prediction Based on Spatio-Temporal Transportation Big Data

A Hybrid Data-Driven Framework for Spatiotemporal Traffic Flow Data Imputation

Low-Rank Tensor and Hybrid Smoothness Regularization-Based Approach for Traffic Data Imputation With Multimodal Missing

Deep LSTM Recurrent Neural Networks for Arterial Traffic Volume Data Imputation

Short Term Traffic Flow Prediction of Urban Road Using Time Varying Filtering Based Empirical Mode Decomposition

Missing Value Imputation for Multi-view Urban Statistical Data via Spatial Correlation Learning

Peak Traffic Forecasting Using Nonparametric Approaches

Traffic Prediction With Missing Data: A Multi-Task Learning Approach

Dynamic road crime risk prediction with urban open data