Abstract:We address the problem of under-utilization of resources in datacenters during cloud operations, specifically focusing on the challenge of online virtual machine (VM) scheduling. Rather than following the traditional approach of scheduling VMs based solely on their static flavors, we take into account their dynamic CPU utilization. We employ Gamma -robustness theory to manage the dynamic nature and introduce a novel variant of bin packing -(), which theoretically protects the Physical Machines (PMs) from hotspots formation within a specified probability alpha . We develop a scheduling algroithm named CloseRadiusFit and cold-start AI-based prediction algorithms for the online version of . To verify the quality of our approach towards the optimal solutions, we solve the Offline problem by designing a novel Mixed Integer Linear Programming (MILP) model and a combination of numerical upper and lower bounds. Our experimental results demonstrate that CloseRadiusFit achieves narrow gaps of 1.6% and 3.1% when compared to the lower and upper bounds, respectively. Note to Practitioners -A growing trend in the cloud industry involves overcommitting VMs on PMs. While this approach can ease the problem of low utilization of resources in datacenters, it also introduces a higher risk of hotspots due to resource contention and competition among VMs. In this work, we propose a novel method that leverages Gamma -robustness theory and introduce effective heuristics to achieve ultimate utilization of datacenter resources while ensuring desirable service quality. We validate our approach using real-world production data from Huawei Cloud, improving resource utilization by 125% over traditional flavor-based allocation methods, while maintaining the occurrence of hotspots below 5% ( alpha=0.05 ). Our solution only requires VMs' real utilization data that is typically already collected in cloud providers' production environments. Therefore, with minimal modifications to the existing scheduling system, cloud providers can easily implement our solution and reap its benefits. Moreover, in cases of the absence of historical utilization data for VMs (cold-start), we use machine learning to predict VM utilization statistics for our approach.

WarMops: A Workload-Aware Resource Management Optimization Strategy for IaaS Private Clouds

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

Optimization of Virtual Resource Management for Cloud Applications to Cope with Traffic Burst.

A Novel Energy-Aware and Resource Efficient Virtual Resource Allocation Strategy in IaaS Cloud

Service-Oriented Resource Allocation in Clouds: Pursuing Flexibility and Efficiency

Weight-based strategy for an I/O-intensive application at a cloud data center.

Integrating Resource Consumption and Allocation for Infrastructure Resources On-Demand

Hotspot-Aware Scheduling of Virtual Machines with Overcommitment for Ultimate Utilization in Cloud Datacenters

A Novel Approach to Improving Resource Utilization for Iaas

Dynamic Virtual Resource Management in Clouds Coping with Traffic Burst

A Runtime Available Resource Capacity Evaluation Model Based on the Concept of Similar Tasks.

Metrics based Workload Analysis Technique for IaaS Cloud

An Analytical Model of IaaS Architecture for Determining Resource Utilization

Defending against Co-residence Attack in Energy-Efficient Cloud: An Optimization based Real-time Secure VM Allocation Strategy

Multi-resource predictive workload consolidation approach in virtualized environments

A Toolkit for Modeling and Simulation of Real-Time Virtual Machine Allocation in a Cloud Data Center

Resource Pre-Allocation Algorithms for Low-Energy Task Scheduling of Cloud Computing

SSUR: An Approach to Optimizing Virtual Machine Allocation Strategy Based on User Requirements for Cloud Data Center

Optimal Resource Allocation Through Joint VM Selection and Placement in Private Clouds.

Energy Efficient Resource Selection and Allocation Strategy for Virtual Machine Consolidation in Cloud Datacenters