Abstract:Flow-level traffic measurement is important for network traffic accounting, traffic engineering, and network security. However, flow-level measurement in high speed networks poses great challenges due to the requirements of high packet processing speed and large memory size (high time/space complexity). To reduce these demanding requirements, sampling is usually used and samplers are deployed in the network. But sampling incurs information loss. To address this issue, this paper studies the tradeoff between sampling loss and complexity in distributed sampling system. We formulate the distributed sampling problem as a constrained optimization problem; specifically, maximizing the measurement coverage (i.e., the percentage of sampled traffic among the total traffic) and minimizing the complexity/budget. Considering the stochastic nature of traffic flows, we further formulate the optimization problem under two stochastic criteria: Stochastic Expected Value Optimization criterion (which is concerned with average performance) and Stochastic Chance Constrained Optimization criterion (which is concerned with the distribution of performance measure). Then we propose a Hybrid Intelligent algorithm to decide the optimal deployment strategy for monitors' placement and the sampling rate at each monitor. Equipped with the proposed algorithm, we are able to address the optimal tradeoff between measurement coverage and deployment cost for networks with random traffic, which has not been studied before. The extensive simulations and experiments demonstrate the effectiveness of our models and algorithm: with careful deployment, monitoring over a small fraction of nodes in a high speed network is sufficient to maintain a high level of measurement coverage.

SmtRPTG: Highly-Efficient Monitoring Scheme to Capture Network Status Changes Accurately

Robust Monitor Assignment for Large Scale Sensor Network Tomography

Data Gathering Optimization by Dynamic Sensing and Routing in Rechargeable Sensor Networks

Energy-Efficient Capture Of Stochastic Events By Global- And Local-Periodic Network Coverage

Globally Optimizing Network Utility with Spatiotemporally-Coupled Constraint in Rechargeable Sensor Networks

HyperSight: Towards Scalable, High-Coverage, and Dynamic Network Monitoring Queries

A Mathematical Model for Energy-Efficient Coverage and Detection in Wireless Sensor Networks

Unsourced Random Access for Distributed State Monitoring in Internet of Things

Optimal Deployment of Distributed Passive Measurement Monitors.

Energy-Efficient Capture of Stochastic Events under Periodic Network Coverage and Coordinated Sleep.

Near Optimal Data Gathering in Rechargeable Sensor Networks with a Mobile Sink

Stochastic Optimization of Distributed Sampling System Placement for Passive Measurement

TSN-Peeper: an Efficient Traffic Monitor in Time-Sensitive Networking

An Energy-Efficient Link Quality Monitoring Scheme for Wireless Networks.

Scalable Monitoring Via Threshold Compression in a Large Operational 3G Network.

Cost Efficient Internet Path Tracking Based on Routing Changes Prediction.

Efficient Top-k Monitoring of Abnormality in Sensor Networks

Optimal Scheduling for Quality of Monitoring in Wireless Rechargeable Sensor Networks

Efficient Global Monitoring Statistics for High-Dimensional Data

Accurate and Efficient Traffic Monitoring Using Adaptive Non-Linear Sampling Method

Design and Realization of Interactive Network Flow Monitoring System