Abstract:Large-scale datacenters often host latency-sensitive services that have stringent Quality-of-Service requirement and experience diurnal load pattern. Co-locating best-effort applications that have no QoS requirement with the latency-sensitive services has been widely used to improve the resource utilization of datacenters with careful shared resource management. However, existing co-location techniques tend to result in the power overload problem on power constrained servers due to the ignorance of the power consumption. To this end, we propose Sturgeon, a runtime system proactively manages resources between co-located applications in a power constrained environment, to ensure the QoS of latency-sensitive services while maximizing the throughput of best-effort applications. Our investigation shows that, at a given load, there are multiple feasible resource configurations to meet both QoS requirement and power budget, while one of them yields the maximum throughput of best-effort applications. To find such a configuration, we establish models to accurately predict the performance and power consumption of the co-located applications. Sturgeon monitors the QoS of the services periodically, in order to eliminate the potential QoS violation caused by the unpredictable interference. Besides, when the datacenter hosts different types of applications to perform co-location, Sturgeon places applications with their preferable candidates to improve the overall throughput. The experimental results show that at server level Sturgeon improves the throughput of the best-effort application by 25.43 percent compared to the state-of-the-art technique, while guaranteeing the 95%-ile latency within the QoS target; at cluster level, Sturgeon improves the overall throughput of best-effort applications by 13.74 percent compared to the baseline.

Power-efficient Resource Management for Co-Located Virtualized Web Servers: A Stochastic Control Approach.

Autonomic Performance Management of Cloud Server Based on Adaptive Control Method

Quality of service aware power management for virtualized data centers.

Cooling-Aware Energy and Workload Management in Data Centers Via Stochastic Optimization

An Efficient Power-Aware Resource Scheduling Strategy in Virtualized Datacenters

A Stochastic Approach to Analysis of Energy-Aware Dvs-Enabled Cloud Datacenters

Adaptive Power Management Through Thermal Aware Workload Balancing in Internet Data Centers.

A Power and Performance Management Framework for Virtualized Server Clusters

Constrained Markov Control Model and Online Stochastic Optimization Algorithm for Power Conservation in Multimedia Server Cluster Systems

A Two-Tier Energy-Aware Resource Management for Virtualized Cloud Computing System

Energy-aware Application Performance Management in Virtualized Data Centers

VM Co-scheduling: Approximation of Optimal Co-scheduling in Data Center

Stochastic Load Balancing for Virtual Resource Management in Datacenters

A Strategy for Queuing Theory-Based Performance and Energy Management in Heterogeneous Data Centers

Stochastic Modeling of Dynamic Right-Sizing for Energy-Efficiency in Cloud Data Centers

QoS-aware energy-efficient workload routing and server speed control policy in data centers: a robust queueing theoretic approach

Virtualization-based autonomic resource management for multi-tier Web applications in shared data center

Performance Evaluation and Dynamic Optimization of Speed Scaling on Web Servers in Cloud Computing

Adaptive Preference-Aware Co-Location for Improving Resource Utilization of Power Constrained Datacenters

A dynamic optimization model for power and performance management of virtualized clusters

Stackelberg Game Approach for Energy-Aware Resource Allocation in Data Centers.