Abstract:The inference of traffic volume of the whole network from partial traffic measurements becomes increasingly critical for various network engineering tasks, such as capacity planning and anomaly detection. Previous studies indicate that the matrix completion is a possible solution for this problem. However, as a 2-D matrix cannot sufficiently capture the spatial-temporal features of traffic data, these approaches fail to work when the data missing ratio is high. To fully exploit hidden spatial-temporal structures of the traffic data, this paper models the traffic data as a 3-way traffic tensor and formulates the traffic data recovery problem as a low-rank tensor completion problem. However, the high computation complexity incurred by the conventional tensor completion algorithms prevents its practical application for the traffic data recovery. To reduce the computation cost, we propose a novel sequential tensor completion algorithm, which can efficiently exploit the tensor decomposition result based on the previous traffic data to derive the tensor decomposition upon arriving of new data. Furthermore, to better capture the changes of data correlation over time, we propose a dynamic sequential tensor completion algorithm. To the best of our knowledge, we are the first to propose sequential tensor completion algorithms to significantly speed up the traffic data recovery process. This facilitates the modeling of Internet traffic with the tensor to well exploit the hidden structures of traffic data for more accurate missing data inference. We have done extensive simulations with the real traffic trace as the input. The simulation results demonstrate that our algorithms can achieve significantly better performance compared with the literature tensor and matrix completion algorithms even when the data missing ratio is high.

Spatio-Temporal Kronecker Compressive Sensing for Traffic Matrix Recovery

A Compressive Sensing-Based Approach to End-to-End Network Traffic Reconstruction

Compressive sensing over strongly connected digraph and its application in traffic monitoring

Data Reconstruction in Internet Traffic Matrix

Joint Time-Frequency Sparse Estimation of Large-Scale Network Traffic

Mining Road Network Correlation for Traffic Estimation Via Compressive Sensing

A Compressive Sensing‐based Network Tomography Approach to Estimating Origin–destination Flow Traffic in Large‐scale Backbone Networks

A Novel Network Tomography Approach for Traffic Matrix Estimation Problem in Large-Scale IP Backbone Networks

Traffic Estimation In Road Networks Via Compressive Sensing

Low Cost Network Traffic Measurement and Fast Recovery Via Redundant Row Subspace-Based Matrix Completion.

A sparsity adaptive measurement algorithm for network traffic matrix

Recovery of Low-Rank Plus Compressed Sparse Matrices with Application to Unveiling Traffic Anomalies

Traffic Data Reconstruction via Adaptive Spatial-Temporal Correlations

An Accurate Approach for Traffic Matrix Estimation in Large-Scale Backbone Networks.

Spatio-temporal Tensor Completion for Imputing Missing Internet Traffic Data

Accurate Recovery of Internet Traffic Data: A Sequential Tensor Completion Approach

Compressive Sensing Approach to Urban Traffic Sensing

Accurate Recovery Of Internet Traffic Data Under Dynamic Measurements

Traffic Matrix Estimation for IP-over-WDM Networks Via Optical Bypass Techniques

End-to-End Network Traffic Reconstruction Via Network Tomography Based on Compressive Sensing

Accurate Recovery of Internet Traffic Data under Variable Rate Measurements