Low Latency Software Rate Limiters for Cloud Networks.

Keqiang He,Weite Qin,Qiwei Zhang,Wenfei Wu,Junjie Yang,Tian Pan,Chengchen Hu,Jiao Zhang,Brent Stephens,Aditya Akella,Ying Zhang
DOI: https://doi.org/10.1145/3106989.3107005
2017-01-01
Abstract:A lot of recent work has focused on reducing in network queueing latency in datacenter networks. In this paper, we focus on a less explored topic --- latency increases caused by queueing in rate limiters on the end-host. First, we show that latency can be increased by an order of magnitude by rate limiters in cloud networks. To solve this problem, we extend ECN marking into rate limiters and use a datacenter congestion control algorithm --- DCTCP. Unfortunately, while this reduces latency, it also leads to throughput oscillation. Thus, this solution is not sufficient. In this paper, we also analyze the specific reasons that ECN marking in software rate limiters leads to the throughput oscillation problem. Finally, we propose two potential solutions to design software rate limiters that can achieve stable high throughput and low latency.
What problem does this paper attempt to address?