Abstract:Overlay network monitoring enables distributed Internet applications to detect and recover from path outages and periods of degraded performance within seconds. For an overlay network with n end hosts, existing systems either require O(n2) measurements, and thus lack scalability, or can only estimate the latency but not congestion or failures. Our earlier extended abstract [Y. Chen, D. Bindel, and R. H. Katz, "Tomography-based overlay network monitoring," Proceedings of the ACM SIGCOMM Internet Measurement Conference (IMC), 2003] briefly proposes an algebraic approach that selectively monitors k linearly independent paths that can fully describe all the O(n2) paths. The loss rates and latency of these k paths can be used to estimate the loss rates and latency of all other paths. Our scheme only assumes knowledge of the underlying IP topology, with links dynamically varying between lossy and normal. In this paper, we improve, implement, and extensively evaluate such a monitoring system. We further make the following contributions: i) scalability analysis indicating that for reasonably large n (e.g., 100), the growth of k is bounded as O(n log n), ii) efficient adaptation algorithms for topology changes, such as the addition or removal of end hosts and routing changes, iii) measurement load balancing schemes, iv) topology measurement error handling, and v) design and implementation of an adaptive streaming media system as a representative application. Both simulation and Internet experiments demonstrate we obtain highly accurate path loss rate estimation while adapting to topology changes within seconds and handling topology errors.

Network Monitor Problem in Passive Testing

Robust Monitor Assignment for Large Scale Sensor Network Tomography

Robust Network Tomography: K-Identifiability and Monitor Assignment

Study on Different Topology Manipulation Algorithms in Wireless Sensor Network

Coverage Quality Measuring and Optimization for Moving Target in Sensor Networks

A New Fault Detection Method for Computer Networks

On the Optimal Monitor Placement for Inferring Additive Metrics of Interested Paths.

Network Protocol System Monitoring - A Formal Approach with Passive Testing

Robust Monitor Assignment with Minimum Cost for Sensor Network Tomography.

An Algebraic Approach to Practical and Scalable Overlay Network Monitoring.

Bound-Based Network Tomography for Inferring Interesting Path Metrics.

Primal Dual Algorithm For Efficient Snmp Agent Deployment In Ip Network

Towards Easy-to-Monitor Networks: Network Design and Measurement Path Construction

Optimal Monitor Assignment for Preferential Link Tomography in Communication Networks.

Network Connectivity Automatic Test Based on Minimum Set Cover

A Passive-Measurement-Guided Tree Network Surveying and Mapping Model.

Optimal Deployment of Distributed Passive Measurement Monitors.

Algebra-based scalable overlay network monitoring: algorithms, evaluation, and applications

Approach for Topology Partitioning in Parallel Network Simulation

Partial Target Coverage Problem in Surveillance Sensor Networks

Study on the ZigBee Network Topology Visualization Reproduction Algorithm