Abstract:Missing value problem in spatiotemporal traffic data has long been a challenging topic, in particular for large-scale and high-dimensional data with complex missing mechanisms and diverse degrees of missingness. Recent studies based on tensor nuclear norm have demonstrated the superiority of tensor learning in imputation tasks by effectively characterizing the complex correlations/dependencies in spatiotemporal data. However, despite the promising results, these approaches do not scale well to large data tensors. In this paper, we focus on addressing the missing data imputation problem for large-scale spatiotemporal traffic data. To achieve both high accuracy and efficiency, we develop a scalable tensor learning model—Low-Tubal-Rank Smoothing Tensor Completion (LSTC-Tubal)—based on the existing framework of Low-Rank Tensor Completion, which is well-suited for spatiotemporal traffic data that is characterized by multidimensional structure of location <math>×</math> time of day <math>×</math> day. In particular, the proposed LSTC-Tubal model involves a scalable tensor nuclear norm minimization scheme by integrating linear unitary transformation. Therefore, tensor nuclear norm minimization can be solved by singular value thresholding on the transformed matrix of each day while the day-to-day correlation can be effectively preserved by the unitary transform matrix. Before setting up the experiment, we consider some real-world data sets, including two large-scale 5-min traffic speed data sets collected by the California PeMS system with 11160 sensors: 1) PeMS-4W covers the data over 4 weeks (i.e., <math>288×28</math> time points), and 2) PeMS-8W covers the data over 8 weeks (i.e., <math>288×56</math> time points). We compare LSTC-Tubal with some state-of-the-art baseline models, and find that LSTC-Tubal can achieve competitively accuracy with a significantly lower computational cost. In addition, the LSTC-Tubal will also benefit other tasks in modeling large-scale spatiotemporal traffic data, such as network-level traffic forecasting.

SLRTA: A sparse and low-rank tensor-based approach to internet traffic anomaly detection

A Novel Sequence Tensor Recovery Algorithm for Quick and Accurate Anomaly Detection

Structure Regularized Traffic Monitoring Model for Traffic Matrix Estimation and Anomaly Detection

Structure Regularized Traffic Monitoring for Traffic Matrix Estimation and Anomaly Detection by Link-Load Measurements.

Network Volume Anomaly Detection and Identification in Large-Scale Networks Based on Online Time-Structured Traffic Tensor Tracking

Toward urban traffic scenarios and more: a spatio-temporal analysis empowered low-rank tensor completion method for data imputation

Convolutional Low-Rank Tensor Representation for Structural Missing Traffic Data Imputation

A Parallel Low Rank Matrix Optimization Method for Recovering Internet Traffic Network Data Via Link Flow Measurement.

Low-rank on Graphs plus Temporally Smooth Sparse Decomposition for Anomaly Detection in Spatiotemporal Data

Tensor-Based Traffic Recovery of Industrial Network by BCD-Inspired Neural Approximation to Latent Nonlinearity and Sparsity

Scalable low-rank tensor learning for spatiotemporal traffic data imputation

A Novel Nonconvex Low-Rank Tensor Completion Approach for Traffic Sensor Data Recovery From Incomplete Measurements

Low-Rank Tensor Completion with 3-D Spatiotemporal Transform for Traffic Data Imputation

Hankel-structured Tensor Robust PCA for Multivariate Traffic Time Series Anomaly Detection

GLOSS: Tensor-Based Anomaly Detection in Spatiotemporal Urban Traffic Data

Adaptive Anomaly Detection in Network Flows with Low-Rank Tensor Decompositions and Deep Unrolling

An accurate and practical algorithm for internet traffic recovery problem

Non-recurrent Traffic Congestion Detection with a Coupled Scalable Bayesian Robust Tensor Factorization Model

Anomaly Detection in Road Networks Using Sliding-Window Tensor Factorization

A Barzilai–Borwein Gradient Algorithm for Spatio-Temporal Internet Traffic Data Completion via Tensor Triple Decomposition

Recovery of Low-Rank Plus Compressed Sparse Matrices with Application to Unveiling Traffic Anomalies