Vswitchlb: Stratified Load Balancing for Vswitch Efficiency in Data Centers

Xin Yin,Enge Song,Ye Yang,Yi Wang,Bowen Yang,Jianyuan Lu,Xing Li,Biao Lyu,Rong Wen,Shibo He,Yuanchao Shu,Shunmin Zhu

DOI: https://doi.org/10.1145/3663408.3663422

2024-01-01

Abstract:The virtual switch (vSwitch) serves as a fundamental element in cloud network, critical for high-performance and strongly isolated inter-VM forwarding in local and external networks. Similar to other multicore systems, a vSwitch with multiple cores also faces the issue of core load imbalance. As a major cloud provider, we pinpoint four cases of core load imbalance within the vSwitch in our cloud, stemming from unequal traffic distribution across virtual queues and RSS buckets, as well as from traffic patterns like heavy hitters and micro-bursts. To tackle the different load imbalance cases, we present vSwitchLB, a vSwitch load balance framework. Specifically, we introduce a load imbalance detection module, accompanied by dedicated techniques designed to address each specific type of imbalance. Our preliminary evaluation shows that vSwitchLB can accurately classify different load imbalances encountered in the vSwitch on our cloud and then prevent any single core of vSwitch from being flooded and overwhelmed.