Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

A Temporal and Spatial Correlation Based Missing Values Imputation Algorithm in Wireless Sensor Networks

A Spatial Correlation Based Adaptive Missing Data Estimation Algorithm in Wireless Sensor Networks

Temporal and Spatial Nearest Neighbor Values Based Missing Data Imputation in Wireless Sensor Networks

CIAM: an Adaptive 2-in-1 Missing Data Estimation Algorithm in Wireless Sensor Networks

Space-Time Correlation Based Fault Correction of Wireless Sensor Networks

SSIM—A Deep Learning Approach for Recovering Missing Time Series Sensor Data

Missing Value Imputation of Wireless Sensor Data for Environmental Monitoring

Exploring Inter-Sensor Correlation for Missing Data Estimation

A Double Weighted LS-SVM Model for Data Estimation in Wireless Sensor Networks

Using Temporal Correlation and Time Series to Detect Missing Activity-Driven Sensor Events.

Recover Missing Sensor Data with Iterative Imputing Network

Sparsity-based Spatial Interpolation in Wireless Sensor Networks.

Multiple Attributes-Based Data Recovery in Wireless Sensor Networks

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

JSSDR: Joint-Sparse Sensory Data Recovery in Wireless Sensor Networks

Multistage Large Segment Imputation Framework Based on Deep Learning and Statistic Metrics

A multiple linear regression data predicting method using correlation analysis for wireless sensor networks

A New Imputation Technique Based a Multi-Spike Neural Network to Handle Missing Data in the Internet of Things Network (IoT)

Data Loss and Reconstruction in Wireless Sensor Networks

Network Imputation for a Spatial Autoregression Model with Incomplete Data

Missing and Corrupted Data Recovery in Wireless Sensor Networks Based on Weighted Robust Principal Component Analysis