Abstract:With the advent of intelligent transportation systems (ITS), spatiotemporal traffic data has gained growing importance in real-time monitoring, prediction, and control of traffic. However, in practical implementations, data collection devices are often faced with malfunctions caused by various unpredictable disruptions, thereby resulting in the so-called "missing value problems." In realistic cases, the disruptions to the data collection devices are often associated with some key events (e.g., power cut and natural disasters), in addition, along with other disruptions the missing value problem could be in a complicated manner with both randomly and completely missing patterns. To perform the imputation task with such complicated missing patterns, we propose a hybrid spatiotemporal method which utilizes the time series properties by "prophet" model and captures the spatial residuals information by iterative random forest model. The spatiotemporal method first applies the temporal part to fill the missing value and then adopts the spatial part to acquire the residual component of the missing values. The results of the two components are integrated into the final imputations. Based on the PeMS freeway dataset (PeMS, 2019) and an urban road dataset under extensive artificially designed scenarios like randomly, clustered non-completely and completely missing patterns, we test our proposed approach with some existing techniques such as K-Nearest Neighbor (KNN), Seasonal-Trend decomposition using Loess (STL), Bayesian tensor decomposition, Denoising AutoEncoder (DAE). The test results indicate that the hybrid method achieves the best imputation quality for most missing patterns, particularly for those with completely or hybrid missing patterns. Furthermore, the hybrid model still performs well under extreme missing rates as high as 0.9, which validates the robustness of the model in extreme situations.

Extrapolation from participatory sensing data

Application of Participatory Sensing in Meteorological Information Service System

Data Extrapolation in Social Sensing for Disaster Response

Joint Source Selection and Data Extrapolation in Social Sensing for Disaster Response.

Social Media Meets Big Urban Data: A Case Study of Urban Waterlogging Analysis

Scalable Social Sensing of Interdependent Phenomena

Digital Urban Sensing: A Multi-layered Approach

A Spatiotemporal Approach for Traffic Data Imputation with Complicated Missing Patterns

Supersampling and Network Reconstruction of Urban Mobility

A Sensor-Based Simulation Method for Spatiotemporal Event Detection

DeepUrbanMomentum: An Online Deep-Learning System for Short-Term Urban Mobility Prediction

Participatory Sensing-Based Semantic and Spatial Analysis of Urban Emergency Events Using Mobile Social Media

PS-Sim: A Framework for Scalable Simulation of Participatory Sensing Data

Poster Abstract: A Dynamic Data-Driven Prediction Model for Sparse Collaborative Sensing Applications

Multi-Dimensional Urban Sensing in Sparse Mobile Crowdsensing

Deco: False Data Detection and Correction Framework for Participatory Sensing

ST-MVL: Filling Missing Values in Geo-Sensory Time Series Data

Revealing Urban Dynamics by Learning Online and Offline Behaviours Together

Toward the Imputation and Prediction of Condition Monitoring Data with Missing Values

Context-aware Real-Time Population Estimation for Metropolis