Abstract:In this article, we consider the dynamic allocation of bursty requests stochastically arriving at heterogeneous servers with uncertain setup times. Lower expected response time and less power consumption are desirable objectives of users and service providers respectively. However, sudden increase and decrease of cloud servers caused by bursty requests are rather challenging to get an appropriate trade-off between the two conflicting objectives which are closely related to the launched servers. The heterogeneity of the cloud servers further makes it more difficult to decide how to switch on and off servers and effectively and efficiently allocate bursty requests with balanced objectives. Based on a Markov decision process, a real-time bilevel decision-making model is constructed for unallocated requests which includes: whether to launch a server and which type of server to launch. A learn-and-deploy algorithm framework is proposed which contains two complementary stages. In the first stage, an effective offline bi-objective optimization algorithm is proposed to learn a set of policies, which provides helpful trade-off information for a decision-maker to choose a preferred policy a posteriori. In terms of the system status, a policy decides whether to launch a server according to a state-action table and which server to launch using a server priority sequence. In the second stage, a computationally efficient policy deployment method is proposed to search the corresponding action in the selected policy based on the current system status and apply it to the real-time system. Experimental studies over a large number of random and real instances have been conducted to validate the effectiveness of the proposed bilevel model and algorithm. Compared to the most recent existing method, the performance of the proposed approach can at most achieve an 80% improvement on power consumption and 20% improvement on response ti- e.

Performance Analysis for Heterogeneous Cloud Servers Using Queueing Theory

A Strategy for Queuing Theory-Based Performance and Energy Management in Heterogeneous Data Centers

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

A Bi-Objective Learn-and-Deploy Scheduling Method for Bursty and Stochastic Requests on Heterogeneous Cloud Servers

Load Balancing in Heterogeneous Server Clusters: Insights From a Product-Form Queueing Model

Performance Analysis of Mobile Cloud Computing With Bursty Demand: A Tandem Queue Model

A queueing-based model for performance management on cloud

Managing performance and power consumption tradeoff for multiple heterogeneous servers in cloud computing

Performance Evaluation of a Cloud Datacenter Using CPU Utilization Data

Energy and Performance Management in Large Data Centers: A Queuing Theory Perspective

Optimizing Virtual Machine Placement in Distributed Clouds with M/M/1 Servers

Stochastic Modeling and Performance Analysis of Migration-Enabled and Error-Prone Clouds

Highly Complex Resource Scheduling for Stochastic Demands in Heterogeneous Clouds

Probability-Based Online Algorithm for Switch Operation of Energy Efficient Data Center

Queuing Model with Customer Class Movement across Server Groups for Analyzing Virtual Machine Migration in Cloud Computing

A Task Scheduling Method For Energy-Performance Trade-Off In Clouds

A Probabilistic Model for Performance Analysis of Cloud Infrastructures

Burstiness-aware Server Consolidation Via Queuing Theory Approach in a Computing Cloud

MQWAGS: Research on Job Scheduling Algorithms Based on Cloud Computing

Toward Green Service in Cloud: from the Perspective of Scheduling

Zero Queueing for Multi-Server Jobs