HyFarM: Task Orchestration on Hybrid Far Memory for High Performance Per Bit

Jing Wang,Chao Li,Junyi Mei,Hao He,Taolei Wang,Pengyu Wang,Lu Zhang,Minyi Guo,Hanqing Wu,Dongbai Chen,Xiangwe Liu
DOI: https://doi.org/10.1109/ICCD56317.2022.00016
2022-01-01
Abstract:Tapping into secondary memory resources, i.e., far memory (FM), has shown huge potential to improve the cost-efficiency of data centers. Recent advances in both storage-based vertical FM and network-based horizontal FM have raised new questions about leveraging hybrid FM tiers to achieve the best performance per bit of memory. It is still unclear how to efficiently place tasks when far memory access is enabled. In this work, we propose HyFarM, a novel task management strategy for hybrid FM clusters. We analyze FM sensitivity and cooperatively co-locate tasks to enable high utilization and scalability. Further, by tapping into dynamic memory adaption within and across servers, our strategy allows one to consistently deliver high performance on memory-intensive tasks. We evaluate our design with a heavily instrumented testbench. Compared with the state-of-the-art designs, HyFarM respectively improves memory utilization and the overall performance per bit (PPB) by up to 17.6% and 20.5%, with minor overhead.
What problem does this paper attempt to address?