Buffer-Based High-Coverage and Low-Overhead Request Event Monitoring in the Cloud

Kaihui Gao,Chen Sun,Shuai Wang,Dan Li,Yu Zhou,Hongqiang Harry Liu,Lingjun Zhu,Ming Zhang,Xiang Deng,Cheng Zhou,Lu Lu
DOI: https://doi.org/10.1109/TNET.2022.3224610
2023-01-01
Abstract:latency directly affects the performance of modern cloud applications. Due to various causes in hosts and networks, requests can suffer from request latency anomalies (RLAs), which may violate the Service-Level Agreement. However, existing performance monitoring tools have incomplete coverage and inconsistent semantics for monitoring requests and cannot accurately diagnose RLAs. This paper presents BufScope, a high-coverage and low-overhead request event monitoring system, which monitors buffers to capture most RLA-related abnormal events with consistent request-level semantics in the end-to-end datapath of request. First, BufScope models the datapath of request as a buffer chain and defines events based on three properties of buffers, so as to end-to-end monitor the root causes of RLA. Then, to achieve consistent semantics for captured events, BufScope designs a request level semantics injection mechanism to make events captured in networks have the victim requests' ID. Finally, BufScope offloads the semantics operations and event collection in software to SmartNICs for low CPU overhead. We have implemented BufScope on commodity SmartNICs and programmable switches. Evaluation results show that BufScope can diagnose 98% RLAs with < 0.08% network bandwidth overhead and 0.6% application throughput decline.
What problem does this paper attempt to address?