Abstract:We consider a market-based resource allocation model for batch jobs in cloud computing clusters. In our model, we incorporate the importance of the due date of a job rather than the number of servers allocated to it at any given time. Each batch job is characterized by the work volume of total computing units (e.g., CPU hours) along with a bound on maximum degree of parallelism. Users specify, along with these job characteristics, their desired due date and a value for finishing the job by its deadline. Given this specification, the primary goal is to determine the scheduling of cloud computing instances under capacity constraints in order to maximize the social welfare (i.e., sum of values gained by allocated users). Our main result is a new (CC-kċss-1)-approximation algorithm for this objective, where C denotes cloud capacity, k is the maximal bound on parallelized execution (in practical settings, k < C ) and s is the slackness on the job completion time, that is, the minimal ratio between a specified deadline and the earliest finish time of a job. Our algorithm is based on utilizing dual fitting arguments over a strengthened linear program to the problem. Based on the new approximation algorithm, we construct truthful allocation and pricing mechanisms, in which reporting the true value and other properties of the job (deadline, work volume, and the parallelism bound) is a dominant strategy for all users. To that end, we extend known results for single-value settings to provide a general framework for transforming allocation algorithms into truthful mechanisms in domains of single-value and multi-properties. We then show that the basic mechanism can be extended under proper Bayesian assumptions to the objective of maximizing revenues, which is important for public clouds. We empirically evaluate the benefits of our approach through simulations on data-center job traces, and show that the revenues obtained under our mechanism are comparable with an ideal fixed-price mechanism, which sets an on-demand price using oracle knowledge of users’ valuations. Finally, we discuss how our model can be extended to accommodate uncertainties in job work volumes, which is a practical challenge in cloud settings.

Cluster Scheduler on Heterogeneous Cloud

Research on Optimal Two Element Exchange Algorithm for Large Scale Cloud Computing Server Scheduling Problem

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Task Scheduling in Cloud Computing Based on The Cuckoo Search Algorithm

On-Line Scheduling of Parallel Jobs in Heterogeneous Multiple Clusters

Cloud Scheduling Algorithm Based on Fuzzy Clustering

Clustering-based Multi-objective Optimization Considering Fairness for Multi-workflow Scheduling on Clouds

CloudCoaster: Transient-aware Bursty Datacenter Workload Scheduling

Highly Complex Resource Scheduling for Stochastic Demands in Heterogeneous Clouds

Task scheduling in cloud environment: optimization, security prioritization and processor selection schemes

Scheduling Real-Time Parallel Applications in Cloud to Minimize Energy Consumption

Near-Optimal Scheduling Mechanisms for Deadline-Sensitive Jobs in Large Computing Clusters

Multi-objective scheduling of many tasks in cloud platforms.

Cost-Efficient Workflow Scheduling Algorithm for Applications With Deadline Constraint on Heterogeneous Clouds

Scheduling Data Intensive Workloads through Virtualization on MapReduce based Clouds

A Security and Cost Aware Scheduling Algorithm for Heterogeneous Tasks of Scientific Workflow in Clouds

Heuristic Cloudlet Allocation Approach Based On Optimal Completion Time And Earliest Finish Time

Workload-Aware Scheduling of Real-Time Jobs in Cloud Computing to Minimize Energy Consumption

Low Complexity Hierarchical Scheduling for Diverse Datacenter Jobs.

Job scheduling optimization based on resource load balance in cloud computing

ReAssigner: A Plug-and-Play Virtual Machine Scheduling Intensifier for Heterogeneous Requests