Abstract:Due to network operation and maintenance relying heavily on network traffic monitoring, traffic matrix analysis has been one of the most crucial issues for network management related tasks. However, it is challenging to reliably obtain the precise measurement in computer networks because of the high measurement cost, and the unavoidable transmission loss. Although some methods proposed in recent years allowed estimating network traffic from partial flow-level or link-level measurements, they often perform poorly for traffic matrix estimation nowadays. Despite strong assumptions like low-rank structure and the prior distribution, existing techniques are usually task-specific and tend to be significantly worse as modern network communication is extremely complicated and dynamic. To address the dilemma, this paper proposed a diffusion-based traffic matrix analysis framework named Diffusion-TM, which leverages problem-agnostic diffusion to notably elevate the estimation performance in both traffic distribution and accuracy. The novel framework not only takes advantage of the powerful generative ability of diffusion models to produce realistic network traffic, but also leverages the denoising process to unbiasedly estimate all end-to-end traffic in a plug-and-play manner under theoretical guarantee. Moreover, taking into account that compiling an intact traffic dataset is usually infeasible, we also propose a two-stage training scheme to make our framework be insensitive to missing values in the dataset. With extensive experiments with real-world datasets, we illustrate the effectiveness of Diffusion-TM on several tasks. Moreover, the results also demonstrate that our method can obtain promising results even with $5\%$ known values left in the datasets.

A Novel Method to Estimate IP Traffic Matrix

Traffic Matrix Estimation: A Neural Network Approach with Extended Input and Expectation Maximization Iteration

Estimating Traffic Flow in Large Road Networks Based on Multi-Source Traffic Data

Diffusion Models Meet Network Management: Improving Traffic Matrix Analysis with Diffusion-based Approach

Learning Based Methods for Traffic Matrix Estimation From Link Measurements

A Short-Term Traffic Flow Prediction Model for Road Networks Using Inverse Isochrones to Determine Dynamic Spatiotemporal Correlation Ranges

Time series matrix factorization prediction of internet traffic matrices

Research on Traffic Matrix Estimation

A Model Approach to Estimate Peer-to-Peer Traffic Matrices

Structured Nonnegative Matrix Factorization for Traffic Flow Estimation of Large Cloud Networks

Predicting Traffic Demand Matrix by Considering Inter-flow Correlations

City traffic flow character analysis and origin-destination estimation based on data mining

The Short-Term Predictability Of Traffic Flow

A cross-correlation-based method for spatial-temporal traffic analysis

Travel Time Estimation Method for Urban Road Based on Traffic Stream Directions

Traffic Measurement Model Based on Traffic Matrix Estimation

Traffic Matrix Estimation based on Denoising Diffusion Probabilistic Model

Urban Traffic Pattern Analysis and Applications Based on Spatio-Temporal Non-Negative Matrix Factorization

Traffic matrix completion by weighted tensor nuclear norm minimization and time slicing

An AI-Augmented Kalman Filter Approach to Monitoring Network Traffic Matrix

Traffic Matrix Prediction Based on Deep Learning for Dynamic Traffic Engineering