Abstract:Today's Internet applications exhibit increased diversity, while the Internet routers are still oblivious to this trend. To improve the end-to-end application QoS, one solution is to embed the application information explicitly in packet headers, but it will bring global changes. Another local solution is router-assisted traffic differentiation. To achieve this, the functionalities including packet identification and flow tracking inside the router are required. While most existing studies focus on the former, fewer efforts are put on the later. Given a large flow table is involved, how to track millions of concurrent flows in a cost-effective manner on a router's line card raises a great space-time challenge. To address this, we design an on-chip/off-chip flow tracking system to accommodate millions of flows and achieve the throughput at tens of Gigabits. By exploiting temporal locality and heavy-tailedness of Layer-4 traffic, we design the Adaptive Least Frequently Evicted (ALFE) replacement policy to catch elephant flows, therefore maintain a high cache hit rate. To alleviate performance penalty due to the cache misses, we organize the flow table in a fixed-allocated manner to fully utilize modern DRAM's burst feature. We have implemented a research prototype using FPGA for performance evaluation. The experiment results show that our system can reach 80% hit rate with a small-sized cache of 16K entries, while achieving 70Mpps throughput. This enables backbone line rate processing. Further, more than 40% power saving can be achieved by our system, which is fast and accurate with only 3% FPGA resource usage.

FlowMon-DPDK: Parsimonious Per-Flow Software Monitoring at Line Rate

FloWatcher-DPDK: Lightweight Line-Rate Flow-Level Monitoring in Software

Flow Anomaly Telemetry Driven by Programmable Data Plane

RFT: Toward Highly Reliable Flow Data Transmission in Network Measurement

CeMon: A Cost-Effective Flow Monitoring System in Software Defined Networks

Floware: Balanced Flow Monitoring in Software Defined Networks

Advancements in Traffic Processing Using Programmable Hardware Flow Offload

Μmon: Empowering Microsecond-level Network Monitoring with Wavelets

AMON: An Open Source Architecture for Online Monitoring, Statistical Analysis and Forensics of Multi-gigabit Streams

FlexMon: A flexible and fine-grained traffic monitor for programmable networks

High-speed Per-Flow Software Monitoring with Limited Resources

Tracking Millions of Flows in High Speed Networks for Application Identification

FlowCover: Low-cost flow monitoring scheme in software defined networks

Optimal Deployment of Distributed Passive Measurement Monitors.

FastKeeper: A Fast Algorithm for Identifying Top-k Real-time Large Flows

Flow Event Telemetry on Programmable Data Plane.

COP2: Continuously Observing Protocol Performance

An Efficient Adaptive Denoising Sketch for Per-flow Traffic Measurement

Accelerating network measurement in software

EffiView: Trigger-Based Monitoring Approach with Low Cost in SDN

Continuous Flow Measurement with SuperFlow.