Learning to Configure Converters in Hybrid Switching Data Center Networks

Jiaqi Zheng,Zhuoxuan Du,Zhenqing Zha,Zixuan Yang,Xiaofeng Gao,Guihai Chen
DOI: https://doi.org/10.1109/tnet.2023.3294803
2024-01-01
Abstract:Data centers heavily rely on scale-out architectures like fat-tree, BCube and VL2 to accommodate a large number of commodity servers. Since the traditional electrical network is demand-oblivious and cannot perfectly respond to the bursty traffic generated by big data applications, a growing trend is to design demand-aware topologies via introducing the converters with adjustable optical links, instead of adding more wiring links. However, little is known today about how to fully exploit the potential of the flexibility from the converters: the joint optimization on adjusting the optical links inside the converters and the routing in the whole network remains algorithmically challenging. In this paper, we design a set of customized converters for Diamond, VL2 and BCube topologies and initiate the optimization study in hybrid switching data center networks. As a case study, we introduce demand-aware load balancing problem (DLBP), i.e., a joint optimization on the physical layer (how the optical links interconnect inside the converter) and the network layer (how to determine the route especially for elephant flows in the whole network). We prove that DLBP is not only NP-hard, but also $\rho$ -inapproximation. Accordingly, we design two algorithms: the first one is an intuitive greedy algorithm and the second one uses reinforcement learning to improve upon the solution of the first one. Trace-driven evaluations show that our algorithms can reduce the traffic congestion by 12% on average.
What problem does this paper attempt to address?