Abstract:Sketch-based method has emerged as a promising direction for per-flow measurement in data center networks. Usually in such a measurement system, a sketch data structure is placed as a whole at one switch for counting all passing packets, but when summarizing measurement results from multiple switches, the overall accuracy is generally constrained by a few individual switches with small-sized sketches due to their limited memory resources. To address this problem, in this paper, we present Distributed Sketch, a new method for per-flow network measurement in data center networks. In Distributed Sketch, each network path is associated with a logical sketch, whose data structure is collectively maintained by all the switches along the path; meanwhile, each switch multiplexes its physical sketch to the constructions of the logical sketches of all the paths it belongs to. With Distributed Sketch, switches collaborate to measure network flows, and the network-wide measurement workload is fairly distributed among all the switches in the network. We implement Distributed Sketch with P4 on commodity hardware programmable switch, and in particular, to overcome the limitation that hardware switches do not support float-point computation, we present an optimal approximation method that involves only integer operations. We also propose an In-band Network Telemetry (INT) based method for addressing the challenges in deploying Distributed Sketch in large-scale data centers. Experiment results and theoretical analysis show that our proposed method is lightweight regarding measurement overhead, and by aggregating and making fair uses of resources from all the switches in the network, Distributed Sketch achieves a higher measurement accuracy compared with the state-of-the-art solutions.

Bandwidth-efficient Microburst Measurement in Large-scale Datacenter Networks

Terra: Low-latency and Reliable Event Collection in Network Measurement

Escala: Timely Elastic Scaling of Control Channels in Network Measurement

Observing and Mitigating Micro-Burst Traffic in Data Center Networks

Measurement and Analysis on the Packet Delivery Performance in A Large Scale Sensor Network

MINT: Empowering Multiple Flow Definition Query for Network-Wide Measurement.

Measurement And Qoe Modeling Of Broadband Home Networks With Large-Scale Crowdsourcing

MTP: Avoiding Control Plane Overload with Measurement Task Placement

Toward Full-Coverage and Low-Overhead Profiling of Network-Stack Latency

Torp: Full-Coverage and Low-Overhead Profiling of Host-Side Latency

Multi-Stage Burst Localization Based on Spatio-Temporal Information Analysis for District Metered Areas in Water Distribution Networks

Micro-burst in Data Centers: Observations, Analysis, and Mitigations

Micro-burst in Data Centers: Observations, Implications, and Applications.

Buffer-Based High-Coverage and Low-Overhead Request Event Monitoring in the Cloud

BurstBalancer: Do Less, Better Balance for Large-scale Data Center Traffic

Buffer-based End-to-end Request Event Monitoring in the Cloud

On Efficient Bandwidth Allocation for Traffic Variability in Datacenters

FABMon: Enabling Fast and Accurate Network Available Bandwidth Estimation

Per-Flow Network Measurement With Distributed Sketch

Absorbing Micro-Burst Traffic by Enhancing Dynamic Threshold Policy of Data Center Switches

Scalable Application-Specific Measurement Framework for High Performance Network Video