Abstract:Complete traffic sensor data are considered to be one of the critical ingredients for intelligent transportation systems (ITSs). However, traffic measurements prevalently suffer from inevitable and ubiquitous missing values (MVs). Current missing data completion algorithms are difficult to leverage the global low-rank property and the fine-grained spatial–temporal structure simultaneously. To circumvent this problem, this work presents a novel collaborative nonconvex low-rank spatial–temporal data tensor completion model that can take full advantage of the inherent spatial–temporal characteristics of traffic measurement data. First, the tensor Schatten p-norm, as an effective nonconvex surrogate of rank function, is used to exploit the global multidimensional correlation of traffic data. Then, we present an elastic net self-representation method and utilize an autoregression model in order to simultaneously capture the self-similarity and the temporal continuity of traffic data acquired in the same sensor network. By integrating the above elements in a unified nonconvex learning model, our method can explore the inherent structure of traffic data from the viewpoints of both global multidimensional correlation and fine-grained spatial and temporal dependency. Then, in view of the general framework of the alternating directions method of multipliers (ADMMs), an efficient iterative algorithm is designed to solve our model. Besides, to optimize the parameter combination of the model, a Bayesian optimization (BO)-based parameter selection algorithm is developed, which avoids manual parameter adjustment. Extensive experiments and analyses on two real-world traffic datasets are carried out. The results demonstrate the advantages of our model under diverse missing patterns and missing ratios.

A Parallel Low Rank Matrix Optimization Method for Recovering Internet Traffic Network Data Via Link Flow Measurement.

An accurate and practical algorithm for internet traffic recovery problem

A Convergent Semi-Proximal Alternating Direction Method of Multipliers for Recovering Internet Traffics from Link Measurements

An Algorithm for Matrix Recovery of High-loss-rate Network Traffic Data

GraphSAGE-Based Traffic Speed Forecasting for Segment Network with Sparse Data

Recovery of Low-Rank Plus Compressed Sparse Matrices with Application to Unveiling Traffic Anomalies

Edge Computing-Empowered Large-Scale Traffic Data Recovery Leveraging Low-Rank Theory

Network traffic recovery from link-load measurements using tensor triple decomposition strategy for third-order traffic tensors

A Novel Nonconvex Low-Rank Tensor Completion Approach for Traffic Sensor Data Recovery From Incomplete Measurements

Analytical Optimized Traffic Flow Recovery for Large-scale Urban Transportation Network

$\ell_1$-minimization method for link flow correction

Tensor-Based Traffic Recovery of Industrial Network by BCD-Inspired Neural Approximation to Latent Nonlinearity and Sparsity

Structured Nonnegative Matrix Factorization for Traffic Flow Estimation of Large Cloud Networks

Low-Rank Tensor and Hybrid Smoothness Regularization-Based Approach for Traffic Data Imputation With Multimodal Missing

Estimating link flow through link speed with sparse flow data sampling

Low-rank Traffic Matrix Completion with Marginal Information

Network Volume Anomaly Detection and Identification in Large-Scale Networks Based on Online Time-Structured Traffic Tensor Tracking

Monitoring of Link Traffic Patterns Based on Random Matrix Theory

Low Rank Matrix Recovery via Robust Outlier Estimation

Fast Hybrid Algorithm for Big Matrix Recovery

Generalized network recovery based on topology and optimization for real-world systems