Abstract:Current cloud data centers are fully virtualized for service consolidation and power/energy reduction. Although virtualization could reduce the real-time power consumption and overall energy consumption, the energy characteristics of hypervisors hosting different workloads have not been well profiled or understood thus far. In this study, we investigate the power and energy characteristics of four mainstream hypervisors and a container engine, namely VMware ESXi, Microsoft Hyper-V, KVM, XenServer, and Docker, on six different platforms (three mainstream 2U rack servers, one emerging ARM64 server, one desktop server, and one laptop) with power measurements made over prolonged periods. We use computation-intensive, memory-intensive, and mixed Web server-database workloads to explore the power and energy characteristics of different hypervisors in order to emulate realistic multi-tenant cloud environments. The results of extensive experiments conducted with four workload levels (very light, light, fair, and very heavy) indicate that the hypervisors exhibit different power and energy characteristics. Our findings are as follows. (1) Hypervisors exhibit different power and energy consumptions on the same hardware running the same workload. (2) Although mainstream hypervisors have different energy efficiencies aligned with different workload types and workload levels, no single hypervisor outperforms the other hypervisors on all platforms in terms of power or energy consumption. (3) Although container virtualization is considered as lightweight virtualization in terms of implementation and maintenance, it is essentially not more power-efficient than conventional virtualization technology. (4) Although the ARM64 server has low power consumption, it completes computation tasks with a long execution time and, sometimes, high energy consumption. Further, ARM64 servers have medium energy consumption per database operation for mixed workloads. The results presented in this paper can provide system designers and data center operators with useful insights for power-aware workload placement and virtual machine scheduling.

PM $^{2}$ VE: Power Metering Model for Virtualization Environments in Cloud Data Centers

Estimating Power Consumption of Containers and Virtual Machines in Data Centers

A Tree Regression-Based Approach for VM Power Metering

Towards VM Power Metering: A Decision Tree Method and Evaluations

A Framework to Evaluate and Predict Performances in Virtual Machines Environment

Power Metering for Virtual Machine in Cloud Computing-Challenges and Opportunities

A Robust Power Model Training Framework for Cloud Native Runtime Energy Metric Exporter

Virtual Machine Power Metering and Provisioning

Power-Aware and Performance-Guaranteed Virtual Machine Placement in the Cloud

EEDVMI: Energy-Efficient Dynamic Virtual Machines Integration

Power Management of Virtualized Cloud Computing Platform

A fine-grained performance-based decision model for virtualization application solution

Power Modeling for Effective Datacenter Planning and Compute Management

Analyzing & modeling the performance in Xen-based virtual cluster environment

An energy-efficient algorithm for virtual machine placement optimization in cloud data centers

Power Consumption of Virtualization Technologies: an Empirical Investigation

Adaptive Vm Management with Two Phase Power Consumption Cost Models in Cloud Datacenter

Optimizing Resource Consumption and Reducing Power Usage in Data Centers, A Novel Mathematical VM Replacement Model and Efficient Algorithm

An Energy Efficient Virtual Machine Placement Algorithm with Balanced Resource Utilization

Energy efficiency comparison of hypervisors

Two-Stage Performance Engineering of Container-based Virtualization