Abstract:Flow-level traffic measurement is important for network traffic accounting, traffic engineering, and network security. However, flow-level measurement in high speed networks poses great challenges due to the requirements of high packet processing speed and large memory size (high time/space complexity). To reduce these demanding requirements, sampling is usually used and samplers are deployed in the network. But sampling incurs information loss. To address this issue, this paper studies the tradeoff between sampling loss and complexity in distributed sampling system. We formulate the distributed sampling problem as a constrained optimization problem; specifically, maximizing the measurement coverage (i.e., the percentage of sampled traffic among the total traffic) and minimizing the complexity/budget. Considering the stochastic nature of traffic flows, we further formulate the optimization problem under two stochastic criteria: Stochastic Expected Value Optimization criterion (which is concerned with average performance) and Stochastic Chance Constrained Optimization criterion (which is concerned with the distribution of performance measure). Then we propose a Hybrid Intelligent algorithm to decide the optimal deployment strategy for monitors' placement and the sampling rate at each monitor. Equipped with the proposed algorithm, we are able to address the optimal tradeoff between measurement coverage and deployment cost for networks with random traffic, which has not been studied before. The extensive simulations and experiments demonstrate the effectiveness of our models and algorithm: with careful deployment, monitoring over a small fraction of nodes in a high speed network is sufficient to maintain a high level of measurement coverage.

Distributed Sampling Measurement Model in a Large-Scale High-Speed IP Networks

Measurement and Analysis on the Packet Delivery Performance in A Large Scale Sensor Network

Measurement And Qoe Modeling Of Broadband Home Networks With Large-Scale Crowdsourcing

An Analytical MAC Model for IEEE 802.15.4 Enabled Wireless Networks with Periodic Traffic

Stochastic Optimization of Distributed Sampling System Placement for Passive Measurement

Optimal Deployment of Distributed Passive Measurement Monitors.

Multi-Slot Distributed Measurement Selection: A Sparsity Learning Approach

Characterizing Network Anomaly Traffic with Euclidean Distance-Based Multiscale Fuzzy Entropy.

Internet Traffic Measurement Based on Non-Stationary Traffic Train Model

Time-Driven vs packet-driven: a deep study on traffic sampling

Distance Distribution-Based Modeling and Analysis for Pipelined-Forwarding Sensor Networks

Time Stratified Adaptive Packet Sampling Based on Traffic Load

Rethinking Fine-grained Measurement from Software-defined Perspective: A Survey

A novel spread estimation based abnormal flow detection in high-speed networks

A new connection degree calculation and measurement method for large scale network monitoring.

Dynamic Feature Analysis and Measurement for Large-Scale Network Traffic Monitoring

A nonstationary traffic train model for fine scale inference from coarse scale counts

Distributed Network Measurement - A Multi-Agent Approach

Handling high speed traffic measurement using network processors

IP traffic behavior characterization via semantic mining

Dynamic features measurement and analysis for large-scale networks