Abstract:Software-defined measurement (SDM) is a simple and efficient way to deploy measurement tasks and collect measurement data. With SDM, it is convenient for operators to implement fine-grained network-wide measurements at the flow level, from which many important functions can benefit. The prior work provides mechanisms to distribute flows to monitors, such that each monitor can identify its non-overlapped subset of flows to measure, and a certain global performance criterion is optimized, such as load balance or flow coverage. Many applications of network management can benefit from a function that can find large flows efficiently, such as congestion control by dynamically scheduling large flows, caching of forwarding table entries, and network capacity planning. However, the current network-wide measurements neglect the diversity of different flows as they treat large flows and small flows equally. In this paper, we present a mechanism of accuracy-aware collaborative monitoring (ACM) to improve the measurement accuracies of large flows in network-wide measurements at the flow level. The structure of the sketch is an approximate counting algorithm, and a high-measurement accuracy can be achieved by merging the results from multiple monitors with sketches, which is termed as collaborative monitoring. The core idea of our method is to allocate more monitors to large flows and achieve the load balance to provide accuracy-aware monitoring. We modeled our problem as an integer–linear programming problem, which is NP-hard. Thus, we propose an approximation algorithm, named the improved longest processing time algorithm (iLPTA); we proved that its approximation ratio is (12+nl). We propose a two-stage online distribution algorithm (TODA). Moreover, we proved that its approximation ratio is (1+nl−1). The iLPTA is an offline approximation algorithm used to assign monitors for each flow, which prove the validity and feasibility of the core idea. The TODA is an online algorithm that attempts to achieve the load balance by selecting the monitor with the smallest load to a large flow. Our extensional experiment results verify the effectiveness of our proposed algorithms.

Scalable Monitoring Via Threshold Compression in a Large Operational 3G Network.

Threshold Compression for 3G Scalable Monitoring.

A Communication-Efficient Threshold Monitoring Method for Distributed Systems

Measurement And Qoe Modeling Of Broadband Home Networks With Large-Scale Crowdsourcing

Thresholded Monitoring in Distributed Data Streams

Remote Monitoring System Based on Mobile Network

HyperSight: Towards Scalable, High-Coverage, and Dynamic Network Monitoring Queries

Configuring Transmission Thresholds in IIoT Alarm Scenarios for Energy-Efficient Event Reporting

Μmon: Empowering Microsecond-level Network Monitoring with Wavelets

SmtRPTG: Highly-Efficient Monitoring Scheme to Capture Network Status Changes Accurately

Leveraging Spatial and Temporal Correlations for Network Traffic Compression

Exploring Scalable, Distributed Real-Time Anomaly Detection for Bridge Health Monitoring

Achieving the Scaling Law of SNR-Monitoring in Dynamic Wireless Networks

Deep Learning-Based Adaptive Compression and Anomaly Detection for Smart B5G Use Cases Operation

Algebra-based scalable overlay network monitoring: algorithms, evaluation, and applications

Admot: Compressive Sensing Techniques For Channel Monitoring In Multiple Access Networks

A Distributed Channel Allocation Strategy Based on A Threshold Scheme in Mobile Cellular Networks

ACM: Accuracy-Aware Collaborative Monitoring for Software-Defined Network-Wide Measurement

Scalable SUM-Shrinkage Schemes for Distributed Monitoring Large-Scale Data Streams

Novel Data Compression Algorithm for Transmission Line Condition Monitoring

Smart Traffic Monitoring System Using Computer Vision and Edge Computing