ANT-Man: Towards Agile Power Management n the Microservice Era

Xiaofeng Hou,Chao Li,Jiacheng Liu,Lu Zhang,Yang Hu,Minyi Guo
DOI: https://doi.org/10.1109/SC41405.2020.00082
2020-01-01
Abstract:The emerging trend of decomposing cloud applications into microservices has raised new questions about managing the performance/power trade-off of a datacenter at microsecond-scale. We introduce ANT-Man, an Auto, Native and Transparent power Management framework that can exploit fine-grained microservice variability for system efficiency. To achieve this, ANT-Man abstracts away two major sources of latency overhead in traditional hierarchical power management frameworks. First, ANT-Man proposes an auto power budgeting scheme for reducing the power coordination latency at the datacenter level. It can proactively determine the power budget tailored to each individual microservice. Second, ANT-Man proposes a native and transparent power control scheme to overcome the power configuration latency for each microservice. It enables super-fast power budget enforcement with nanosecond-scale performance scaling. Extensive experiments on our prototyped system show that ANT-Man could slash power consumption by 7.8 similar to 43.5%, and in the meantime reduce the 95th tail latency by 9.7 similar to 12.5% compared to existing techniques.
What problem does this paper attempt to address?