D2T: Dynamic Dual Threshold Policy of Shared-Memory in Data Center Switches
Jiawei Huang,Hui Li,Zhaoyi Li,Zihao Chen,Jingling Liu,Jing Shao,Wenlu Zhang,Yijun Li,Sitan Li,Shengwen Zhou,Ping Zhong,Jianxin Wang,Wanchun Jiang,Yong Cui
DOI: https://doi.org/10.1109/icdcs60910.2024.00047
2024-01-01
Abstract:Nowadays the data center switches employ the on-chip shared buffer to absorb bursts and avoid packet loss during transient congestion. However, as the buffer-per-port-per-Gbps in production data centers decreases, it becomes more challenging to provide efficient buffer management to meet the requirements of heterogeneous traffic. We observe that typical shared buffer management policies have two steps: first, they identify short flows arriving at ports and then allocate more buffer room for these ports. Unfortunately, the lack of isolation between long and short flows leads to increased queue buildup and even packet loss of short flows. To address this limitation, we propose (DT)-T-2, which uses different queue length thresholds for long and short flows. Specifically, we first design a compact data structure to distinguish between long and short flows. Then when two kinds of flows coexist at the same port, the threshold of long flows will decrease to absorb the bursty short flows. We implement (DT)-T-2 at a P4-programmable switch and large-scale simulations. The results demonstrate that (DT)-T-2 reduces both average and tail flow completion times (FCT) of short flows by up to 29% and 62% compared with the state-of-the-art policies, respectively.