Abstract:In-Band Network Telemetry (INT) is a novel framework for collecting telemetry items and switch internal state information from the data plane at line rate. With the support of programmable data planes and programming language P4, switches parse telemetry instruction headers and determine which telemetry items to attach using custom metadata. At the network edge, telemetry information is removed and the original packets are forwarded while telemetry reports are sent to a distributed stream processor for further processing by a network monitoring platform. In order to avoid excessive load on the stream processor, telemetry items should not be sent for each individual packet but rather when certain events are triggered. In this paper, we develop a programmable INT event detection mechanism in P4 that allows customization of which events to report to the monitoring system, on a per-flow basis, from the control plane. At the stream processor, we implement a fast INT report collector using the kernel bypass technique AF_XDP, which parses telemetry reports and streams them to a distributed Kafka cluster, which can apply machine learning, visualization and further monitoring tasks. In our evaluation, we use real-world traces from different data center workloads and show that our approach is highly scalable and significantly reduces the network overhead and stream processor load due to effective event pre-filtering inside the switch data plane. While the INT report collector can process around 3 Mpps telemetry reports per core, using event pre-filtering increases the capacity by 10-15x.

Flexible sampling-based in-band network telemetry in programmable data plane

OpenINT: Dynamic In-band Network Telemetry with Lightweight Deployment and Flexible Planning

Toward Security-Enhanced In-band Network Telemetry in Programmable Networks

In-band Network Telemetry Manipulation Attacks and Countermeasures in Programmable Networks.

DeltaINT: Toward General In-band Network Telemetry with Extremely Low Bandwidth Overhead

Programmable Event Detection for In-Band Network Telemetry

Information-Sensitive In-Band Network Telemetry in P4-Based Programmable Data Plane

Sel-INT: A Runtime-Programmable Selective In-Band Network Telemetry System

A General Delta-Based In-Band Network Telemetry Framework with Extremely Low Bandwidth Overhead

Lightweight Network-Wide Telemetry Without Explicitly Using Probe Packets

SD-INT: Towards Lightweight Network-Wide Passive INT in the Self-Driving Way

Deterministic and Probabilistic P4-Enabled Lightweight In-Band Network Telemetry

Reliable and Distributed Network Monitoring via In-band Network Telemetry

CLINT: Controller-Assisted Lightweight In-Band Network Telemetry

Flow Anomaly Telemetry Driven by Programmable Data Plane

Reducing the In band Network Telemetry overhead through the spatial sampling: Theory and experimental results

How to Use In-Band Network Telemetry Wisely: Network-Wise Orchestration of Sel-INT

Intelligence Enabled SDN Fault Localization Via Programmable In-band Network Telemetry

Highly-Efficient and Adaptive Network Monitoring: when INT Meets Segment Routing

AdapINT: A Flexible and Adaptive In-Band Network Telemetry System Based on Deep Reinforcement Learning

INT-path: Towards Optimal Path Planning for In-band Network-Wide Telemetry