Abstract:Sketch-based method has emerged as a promising direction for per-flow measurement in data center networks. Usually in such a measurement system, a sketch data structure is placed as a whole at one switch for counting all passing packets, but when summarizing measurement results from multiple switches, the overall accuracy is generally constrained by a few individual switches with small-sized sketches due to their limited memory resources. To address this problem, in this paper, we present Distributed Sketch, a new method for per-flow network measurement in data center networks. In Distributed Sketch, each network path is associated with a logical sketch, whose data structure is collectively maintained by all the switches along the path; meanwhile, each switch multiplexes its physical sketch to the constructions of the logical sketches of all the paths it belongs to. With Distributed Sketch, switches collaborate to measure network flows, and the network-wide measurement workload is fairly distributed among all the switches in the network. We implement Distributed Sketch with P4 on commodity hardware programmable switch, and in particular, to overcome the limitation that hardware switches do not support float-point computation, we present an optimal approximation method that involves only integer operations. We also propose an In-band Network Telemetry (INT) based method for addressing the challenges in deploying Distributed Sketch in large-scale data centers. Experiment results and theoretical analysis show that our proposed method is lightweight regarding measurement overhead, and by aggregating and making fair uses of resources from all the switches in the network, Distributed Sketch achieves a higher measurement accuracy compared with the state-of-the-art solutions.

Flow Traffic Measurement Algorithm Based on Two-layer Memory Hierarchy

Urban Traffic Flow Forecasting Based on Memory Time-Series Network.

Hierarchical Sketch: an Efficient Solution for Threshold-t Flows Measurement in High-Speed Networks

RFT: Toward Highly Reliable Flow Data Transmission in Network Measurement

A Physical-Aware Framework for Memory Network Design Space Exploration

DISCO: Memory Efficient and Accurate Flow Statistics for Network Measurement

HashFlow For Better Flow Record Collection

Tracking Millions of Flows in High Speed Networks for Application Identification

PriMe: Per-Flow Network Measurement by Combining SRAM with DRAM.

Efficient and Accurate Flow Record Collection With HashFlow

HybridSketch: A Memory-centric Precise Approach for Flow Measurement

Two-stage storage flow tracking system based on service identification system architecture

Memory Compression for Recursive Flow Classification Algorithm in Network Packet Processing Devices

An Infrastructure for Flow-Level Network-Wide Traffic Measurement Based on Netflow

Memory-Efficient Performance Monitoring on Programmable Switches with Lean Algorithms

Memory-Efficient Hypercube Flow Table for Packet Processing on Multi-Cores

Rethinking Fine-grained Measurement from Software-defined Perspective: A Survey

The Hardware Measurement System for High-Speed Network Flow

A novel spread estimation based abnormal flow detection in high-speed networks

CASE: Cache-assisted Stretchable Estimator for High Speed Per-Flow Measurement.

Per-Flow Network Measurement With Distributed Sketch