Abstract:Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.

SSL : A S urrogate-Based Method for Large-Scale S tatistical Latency Measurement

SSL: ASurrogate-Based Method for Large-ScaleStatisticalLatencyMeasurement

A Light-Weight Statistical Latency Measurement Platform at Scale

SSLB: Self-Similarity-Based Load Balancing for Large-Scale Fog Computing

A novel delay-resilient remote memory attestation for smart grid

Stochastic Optimization of Distributed Sampling System Placement for Passive Measurement

Software-Defined Latency Monitoring In Data Center Networks

Multi-Slot Distributed Measurement Selection: A Sparsity Learning Approach

Poster: Q-Scanner: A Fast Scanning Tool for Large-Scale SSL/TLS Configurations Measurement

SSL-SP: A Semi-Supervised-Learning-Based Stream Partitioning Method for Scale Iterated Scheduling in Time-Sensitive Networks

Measuring and Evaluating TCP Splitting for Cloud Services

No-jump-into-latency in China's Internet!

Understanding IP Address Multiplexing with Large-Scale SSL/TLS Flow Analysis

An adaptive method for identifying heavy hitters combining sampling and data streaming counting

Simulation analysis of distance-aware graph-based semi-supervised learning

ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement

OblivSketch: Oblivious Network Measurement As a Cloud Service.

A novel spread estimation based abnormal flow detection in high-speed networks

Optimal Deployment of Distributed Passive Measurement Monitors.

An Efficient and Accurate Link Latency Monitoring Method for Low-Latency Software-Defined Networks

Distributed Real-Time Measurement Scheme for Local QoS States