Improving the Efficiency of Serverless Computing Via Core-Level Power Management

Du Liu,Jing Wang,Xinkai Wang,Chao Li,Lu Zhang,Xiaofeng Hou,Xiaoxiang Shi,Minyi Guo
DOI: https://doi.org/10.1109/ccgrid59990.2024.00024
2024-01-01
Abstract:Serverless computing has recently become a significant application paradigm in data centers. However, existing power management methods focus on optimizations at the coarse-grained server level, making them unable to handle the characteristics of these short-lived, dynamic serverless functions. In this context, the unawareness of function-level characteristics by the existing power management systems can severely degrade the energy efficiency of the data centers. To address this challenge, we design a function-level power management system. Instead of relying on server-level schedulers, we propose a novel core-level scheduling policy for serverless functions that can efficiently allocate functions to the most suitable CPU core. Additionally, we propose a power management mechanism for serverless computing that can reduce system power consumption with functions’ QoS guaranteed. Our evaluation shows that our system achieves a maximum power saving of 8.5% and an average power saving of 8% across the majority of loads without incurring any loss in tail latency, as compared to the conventional server-level scheduling system.
What problem does this paper attempt to address?