Abstract:At present, public clouds have served millions of tenants. To provide reliable services, cloud vendors need to perceive health status of the cloud network by building a telemetry system to detect possible network failures. While telemetry systems for physical networks have been extensively studied, research on telemetry systems for virtual networks is still insufficient. Different from physical networks, we conclude that building a virtual network telemetry system faces new challenges of feasibility, efficiency, and effectiveness. Specifically, we need to 1) protect privacy of tenants and adapt to heterogeneous middleboxes at the data plane; 2) handle frequent virtual network topology updates and compress large-scale measurement paths for millions of tenants at the control plane; 3) analyze telemetry results to locate network failures at the analysis plane. To address these challenges, we present Zoonet, a proactive virtual network telemetry system for multi-tenant clouds. At the data plane, Zoonet uses host agent and arp-ping to protect tenants’ privacy and defines an elegant generalization of ping and traceroute, which can work on heterogeneous middleboxes. At the control plane, Zoonet conducts update batch processing and substantial probing path pruning to lessen the overhead. At the analysis plane, Zoonet reduces noises and aggregates alerts based on temporal and spatial correlation and conducts the hop-by-hop telemetry mode to locate failures. Zoonet has been deployed in Alibaba Cloud for over two years, covering tens of cloud regions, hundreds of thousands of servers. We become increasingly reliant on Zoonet as it reduces 86% of the personnel engaged in troubleshooting.

RD-Probe: Scalable Monitoring with Sufficient Coverage in Complex Datacenter Networks

A Distributed Abnormal Packet Generation Engine Based on MapReduce.

Detector: A Topology-Aware Monitoring System For Data Center Networks

INT-probe: Lightweight In-band Network-Wide Telemetry with Stationary Probes

Proactive Telemetry in Large-Scale Multi-Tenant Cloud Overlay Networks

Zero+: Monitoring Large-Scale Cloud-Native Infrastructure Using One-Sided RDMA

Zero Overhead Monitoring for Cloud-native Infrastructure Using RDMA

A Real-Time Trace-Level Root-Cause Diagnosis System in Alibaba Datacenters

Collie: Finding Performance Anomalies in RDMA Subsystems

X-RDMA: Effective RDMA Middleware in Large-scale Production Environments.

Piebridge: A Cross-Dr Scale Large Data Transmission Scheduling System

Poster Abstract: Enabling Reliable and High-Fidelity Data Center Sensing

Understanding Multi-Path Routing Algorithms in Datacenter Networks

DProbe: Profiling and Predicting Multi-tenant Deep Learning Workloads for GPU Resource Scaling.

Diagnosing Application-network Anomalies for Millions of IPs in Production Clouds.

Optimal Deployment of Distributed Passive Measurement Monitors.

ReProbe: An Architecture for Reconfigurable and Adaptive Probes

NetView: Towards on-demand network-wide telemetry in the data center

An Agent-Based Monitoring Framework for Distributed Complex Engineering Simulation System

Partial Probing for Scaling Overlay Routing

POSTER: CAVER: Enhancing RDMA Load Balancing by Hunting Less-Congested Paths