Abstract:Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.

Monitoring Large Flows in Network

An Efficient Sampling And Classification Approach For Flow Detection In Sdn-Based Big Data Centers

A novel spread estimation based abnormal flow detection in high-speed networks

Heavykeeper: an Accurate Algorithm for Finding Top-K Elephant Flows

Tracking Millions of Flows in High Speed Networks for Application Identification

Dynamic features measurement and analysis for large-scale networks

ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement

Dynamic Feature Analysis and Measurement for Large-Scale Network Traffic Monitoring

Hierarchical Sketch: an Efficient Solution for Threshold-t Flows Measurement in High-Speed Networks

HashFlow For Better Flow Record Collection

An effective and accurate flow size measurement using funnel-shaped sketch

Detecting heavy flows in the SDN match and action model

ActiveGuardian: An accurate and efficient algorithm for identifying active elephant flows in network traffic

Continuous Flow Measurement with SuperFlow.

A new connection degree calculation and measurement method for large scale network monitoring.

Mining Frequent Patterns from Network Flows for Monitoring Network

Monitoring Abnormal Network Traffic Based on Blind Source Separation Approach

Flow-level Traffic Engineering in Conventional Networks with Hop-by-Hop Routing

Accurate and Efficient Traffic Monitoring Using Adaptive Non-Linear Sampling Method

Efficient and Accurate Flow Record Collection With HashFlow