Abstract:Overlay network monitoring enables distributed Internet applications to detect and recover from path outages and periods of degraded performance within seconds. For an overlay network with n end hosts, existing systems either require O(n2) measurements, and thus lack scalability, or can only estimate the latency but not congestion or failures. Our earlier extended abstract [Y. Chen, D. Bindel, and R. H. Katz, "Tomography-based overlay network monitoring," Proceedings of the ACM SIGCOMM Internet Measurement Conference (IMC), 2003] briefly proposes an algebraic approach that selectively monitors k linearly independent paths that can fully describe all the O(n2) paths. The loss rates and latency of these k paths can be used to estimate the loss rates and latency of all other paths. Our scheme only assumes knowledge of the underlying IP topology, with links dynamically varying between lossy and normal. In this paper, we improve, implement, and extensively evaluate such a monitoring system. We further make the following contributions: i) scalability analysis indicating that for reasonably large n (e.g., 100), the growth of k is bounded as O(n log n), ii) efficient adaptation algorithms for topology changes, such as the addition or removal of end hosts and routing changes, iii) measurement load balancing schemes, iv) topology measurement error handling, and v) design and implementation of an adaptive streaming media system as a representative application. Both simulation and Internet experiments demonstrate we obtain highly accurate path loss rate estimation while adapting to topology changes within seconds and handling topology errors.

Available Bandwidth Measurement Algorithm for Spines Overlay Network

Prediction of Self-Similar Traffic and Its Application in Network Bandwidth Allocation

Edge-to-edge Bandwidth Estimation Based Packet Marker

A New Bandwidth Prediction Based Wireless Ad-Hoc Video Communication

Available Bandwidth Estimation in IEEE802.11b Network Based on Non-Intrusive Measurement

A NEW BOTTLENECK BANDWIDTH MEASUREMENT METHOD(PATHLINK) FOR RATE LIMITED NETWORKS

An Adaptive Bandwidth-Aware Overlay for the Maximum Throughput in the Unstructured Peer-to-Peer

An Available Bandwidth Measurement Method Based on the Parity-Packet Pair Model

Load-balanced Routing Heuristics for Bandwidth Allocation of AVB Flow in TSN

Trading Bandwidth for Playback Lag: Can Active Peers Help?

Pathwave: Combined Estimation of Network Link Capacity and Available Bandwidth Using Statistical Signal Processing

FABMon: Enabling Fast and Accurate Network Available Bandwidth Estimation

BLOR: Bandwidth and Latency Sensitive Overlay Routing for Flash Data Dissemination

AProbing: Estimating available bandwidth using ACK pair probing

Enhancing Low Latency Adaptive Live Streaming Through Precise Bandwidth Prediction

A Novel Bandwidth Estimation Scheme Used in Admission Control for Wireless Mesh Networks

DHBAM: Dynamic and Hierarchical Bandwidth Allocation Method

Algebra-based scalable overlay network monitoring: algorithms, evaluation, and applications

Elastic and Reliable Bandwidth Reservation Based on Distributed Traffic Monitoring and Control

Optimal Reference Path Selection Method on Path-Dependent P2P Overlay Network

Estimation of Statistical Bandwidth through Backlog Measurement