Triton: A Flexible Hardware Offloading Architecture for Accelerating Apsara Vswitch in Alibaba Cloud
Xing Li,Xiaochong Jiang,Ye Yang,Lilong Chen,Yi Wang,Chao Wang,Chao Xu,Yilong Lv,Bowen Yang,Taotao Wu,Haifeng Gao,Zikang Chen,Yisong Qiao,Hongwei Ding,Yijian Dong,Hang Yang,Jianming Song,Jianyuan Lu,Pengyu Zhang,Chengkun Wei,Zihui Zhang,Wenzhi Chen,Qinming He,Shunmin Zhu
DOI: https://doi.org/10.1145/3651890.3672224
2024-01-01
Abstract:Apsara vSwitch (AVS) is a per-host deployed forwarding component for instance network connectivity in the Alibaba Cloud. To meet the growing performance demands, we accelerated AVS by adopting the most widely used "Sep-path" offloading architecture, which introduces a separate hardware data path to speed up popular traffic. However, the deployment results prove that it is difficult to bridge the gap in performance and programming flexibility of the software and hardware data paths, resulting in unpredictable performance and low iteration velocity. This paper introduces Triton, a flexible hardware offloading architecture for accelerating AVS. Triton stands out with a unified data path, where each packet passes serially through software and hardware processing to ensure predictable performance. For flexibility, Triton implements an elegant workload distribution model, which offloads generic tasks to hardware but maintains dynamic logic in software. Additionally, Triton integrates a series of cutting-edge software-hardware co-designs, including vector packet processing and header-payload slicing, to mitigate software bottlenecks and enhance forwarding efficiency. The deployment results compared to our prior solution based on "Sep-path" reveal that Triton achieves predictable high bandwidth and packet rate, and notably improves the connection establishment rate by 72%, with only 2μs increase in latency. More importantly, the flexibility and iteration velocity of the software in Triton will save development costs and bolster maintenance efficiency for cloud vendors.