Abstract:Cloud datacenters typically require tenants to specify the resource demands for the virtual machines (VMs) they create using a set of pre-defined, fixed configurations, to ease the resource allocation problem. Unfortunately, this leads to low resource utilization of cloud datacenters as tenants are obligated to conservatively predict the maximum resource demand of their applications. We argue that instead of such a static VM resource allocation, a finer-grained dynamic resource allocation and scheduling can substantially improve the utilization of the datacenter resources by increasing the number of jobs accommodated and correspondingly, the cloud datacenter provider's revenue. The dynamic real-time scheduling of jobs can also ensure that the performance goals for the tenant VMs are achieved. Examining a typical publicly available cluster data center trace, we observe that a large number of jobs are short. Only a small proportion of jobs are long and which require substantial compute or memory resources. We propose an optimization based approach that exploits this division between the short and long jobs to dynamically allocate a cloud datacenter's resources to achieve significantly better utilization by increasing the number of jobs accommodated by the datacenter. We use a constraint programming solution to schedule the long jobs, and use simple heuristics to quickly, yet quite accurately schedule the short jobs. Using trace-driven simulations based on public traces collected on provider cluster we show that the overall revenue for the cloud provider can be improved by 30% over the traditional static VM resource allocation based on the coarse granularity specifications. We are able to increase the number of jobs accommodated using dynamic scheduling by 18%. We also compare the performance of our approach to multi-resource (CPU and memory) first-fit and best-fit algorithms and to the optimal offline solution, and demonstrate that our solution achieves within 76% - f the offline optimal solution.

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds

An Integrated Dynamic Resource Scheduling Framework in On-Demand Clouds.

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Prediction-based Dynamic Resource Scheduling for Virtualized Cloud Systems

Energy-efficient Collaborative Optimization for VM Scheduling in Cloud Computing.

DRL-Scheduling: an Intelligent QoS-Aware Job Scheduling Framework for Applications in Clouds

A dynamic resource allocation framework in the cloud

Dynamic Resource Balancing in Cloud Computing Framework

General Framework for Task Scheduling and Resource Provisioning in Cloud Computing Systems

Fine-grained multi-resource scheduling in cloud datacenters

QoS-aware and multi-objective virtual machine dynamic scheduling for big data centers in clouds

A Dynamic and Integrated Load-Balancing Scheduling Algorithm for Cloud Datacenters

A multi-objective trade-off framework for cloud resource scheduling based on the Deep Q-network algorithm

An Adaptive Management Approach Collaborating Heterogeneous Resources in Cloud Service Environments

Stochastic Resource Scheduling Via Bilayer Dynamic Markov Decision Process in Mobile Cloud Networks.

Design and Implementation of Adaptive Resource Co-Allocation Approaches for Cloud Service Environments

Dynamic Resource Allocation Based on Energy Utility Maximization Using Virtual Machines in Cloud Environment.

Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center

A Real-Time Scheduling Framework Based on Multi-core Dynamic Partitioning in Virtualized Environment

Dynamic multi-objective workflow scheduling for combined resources in cloud

A Threshold-Based Dynamic Resource Allocation Scheme For Cloud Computing