Abstract:Getting good statistical models of traffic on network links is a well-known, often-studied problem. A lot of attention has been given to correlation patterns and flow duration. The distribution of the amount of traffic per unit time is an equally important but less studied problem. We study a large number of traffic traces from many different networks including academic, commercial and residential networks using state-of-the-art statistical techniques. We show that traffic obeys the log-normal distribution which is a better fit than the Gaussian distribution commonly claimed in the literature. We also investigate an alternative heavy-tailed distribution (the Weibull) and show that its performance is better than Gaussian but worse than log-normal. We examine anomalous traces which exhibit a poor fit for all distributions tried and show that this is often due to traffic outages or links that hit maximum capacity. We demonstrate that the data we look at is stationary if we consider samples of 15- minute long or even 1-hour long. This gives confidence that we can use the distributions for estimation and modelling purposes. We demonstrate the utility of our findings in two contexts: predicting that the proportion of time traffic will exceed a given level (for service level agreement or link capacity estimation) and predicting 95th percentile pricing. We also show that the log-normal distribution is a better predictor than Gaussian or Weibull distributions in both contexts.

Long-term power-law fluctuation in Internet traffic

Taylor's power law for fluctuation scaling in traffic

Scaling Behaviors of Traffic in Computer Communication Networks

Fractal Analysis On Internet Traffic Time Series

Analysis of Scaling Behavior of Internet Packet Delay Based on High Density Measurement

Scale-free behavior of the Internet global performance

On the universality of the scaling of fluctuations in traffic on complex networks

Scaling and Memory in Recurrence Intervals of Internet Traffic

Fluctuations and pseudo long range dependence in network flows: A non-stationary Poisson process model

Scaling behavior of Internet packet delay dynamics based on small-interval measurements

Evolution on Power-Law Characteristics of the Internet Topology at Autonomous System Level

Non-stationary and Small-time Scaling Behavior of Internet Traffic

Self-organized Criticality of Computer Network Traffic

On the evolution of internet flow characteristics

Measurement and Statistics of Application Business in Complex Internet.

FLUCTUATIONS IN URBAN TRAFFIC NETWORKS

Traffic Flow Volume Fluctuation Analysis Using MF-DFA

Time Series Analysis of Computer Network Traffic in a Dedicated Link Aggregation

On the LRD of the Aggregated Traffic Flows in High-Speed Computer Networks

Internet Traffic Volumes Are Not Gaussian -- They Are Log-Normal: An 18-Year Longitudinal Study With Implications for Modelling and Prediction (Complete Version)

Analysis of Power Spectrum and 1/f Type Power Law in a Complex Computer Network Model