Abstract:Missing value problem in spatiotemporal traffic data has long been a challenging topic, in particular for large-scale and high-dimensional data with complex missing mechanisms and diverse degrees of missingness. Recent studies based on tensor nuclear norm have demonstrated the superiority of tensor learning in imputation tasks by effectively characterizing the complex correlations/dependencies in spatiotemporal data. However, despite the promising results, these approaches do not scale well to large data tensors. In this paper, we focus on addressing the missing data imputation problem for large-scale spatiotemporal traffic data. To achieve both high accuracy and efficiency, we develop a scalable tensor learning model—Low-Tubal-Rank Smoothing Tensor Completion (LSTC-Tubal)—based on the existing framework of Low-Rank Tensor Completion, which is well-suited for spatiotemporal traffic data that is characterized by multidimensional structure of location <math>×</math> time of day <math>×</math> day. In particular, the proposed LSTC-Tubal model involves a scalable tensor nuclear norm minimization scheme by integrating linear unitary transformation. Therefore, tensor nuclear norm minimization can be solved by singular value thresholding on the transformed matrix of each day while the day-to-day correlation can be effectively preserved by the unitary transform matrix. Before setting up the experiment, we consider some real-world data sets, including two large-scale 5-min traffic speed data sets collected by the California PeMS system with 11160 sensors: 1) PeMS-4W covers the data over 4 weeks (i.e., <math>288×28</math> time points), and 2) PeMS-8W covers the data over 8 weeks (i.e., <math>288×56</math> time points). We compare LSTC-Tubal with some state-of-the-art baseline models, and find that LSTC-Tubal can achieve competitively accuracy with a significantly lower computational cost. In addition, the LSTC-Tubal will also benefit other tasks in modeling large-scale spatiotemporal traffic data, such as network-level traffic forecasting.

Internet Traffic Tensor Completion with Tensor Nuclear Norm

Weighted Tensor Completion-Based Traffic State Estimation Model

A Novel Nonconvex Low-Rank Tensor Completion Approach for Traffic Sensor Data Recovery From Incomplete Measurements

Traffic matrix completion by weighted tensor nuclear norm minimization and time slicing

A Tensor Based Method for Missing Traffic Data Completion

Low-Rank Tensor and Hybrid Smoothness Regularization-Based Approach for Traffic Data Imputation With Multimodal Missing

Spatiotemporal traffic data completion with truncated minimax-concave penalty

Distributed neural tensor completion for network monitoring data recovery

@ A tensor-based method for missing traffic data completion (English)

A Novel Truncated Normal Tensor Completion Method for Multi-Source Fusion Data

A Biased Deep Tensor Factorization Network For Tensor Completion

Two New Low Rank Tensor Completion Methods Based on Sum Nuclear Norm

Scalable low-rank tensor learning for spatiotemporal traffic data imputation

Tensor recovery using the tensor nuclear norm based on nonconvex and nonlinear transformations

Tucker factorization-based tensor completion for robust traffic data imputation

Matrix completion by Truncated Nuclear Norm Regularization

NT-DPTC: A non-negative temporal dimension preserved tensor completion model for missing traffic data imputation

Tensor completion via multi-directional partial tensor nuclear norm with total variation regularization

Nonlinear Transform Induced Tensor Nuclear Norm for Tensor Completion

Graph Spectral Regularized Tensor Completion for Traffic Data Imputation

Low-Rank Tensor Completion by Truncated Nuclear Norm Regularization