Abstract:In this article, we consider the dynamic allocation of bursty requests stochastically arriving at heterogeneous servers with uncertain setup times. Lower expected response time and less power consumption are desirable objectives of users and service providers respectively. However, sudden increase and decrease of cloud servers caused by bursty requests are rather challenging to get an appropriate trade-off between the two conflicting objectives which are closely related to the launched servers. The heterogeneity of the cloud servers further makes it more difficult to decide how to switch on and off servers and effectively and efficiently allocate bursty requests with balanced objectives. Based on a Markov decision process, a real-time bilevel decision-making model is constructed for unallocated requests which includes: whether to launch a server and which type of server to launch. A learn-and-deploy algorithm framework is proposed which contains two complementary stages. In the first stage, an effective offline bi-objective optimization algorithm is proposed to learn a set of policies, which provides helpful trade-off information for a decision-maker to choose a preferred policy a posteriori. In terms of the system status, a policy decides whether to launch a server according to a state-action table and which server to launch using a server priority sequence. In the second stage, a computationally efficient policy deployment method is proposed to search the corresponding action in the selected policy based on the current system status and apply it to the real-time system. Experimental studies over a large number of random and real instances have been conducted to validate the effectiveness of the proposed bilevel model and algorithm. Compared to the most recent existing method, the performance of the proposed approach can at most achieve an 80% improvement on power consumption and 20% improvement on response ti- e.

Servers Location-allocation Problem with Promise of Response Time

Research on Optimal Two Element Exchange Algorithm for Large Scale Cloud Computing Server Scheduling Problem

New Queueing Model For The Location Problem

A new model for location problem with Stochastic demands

Multi-objective Optimization for Multi-depot Selection in Emergency Logistics with Time-varying Demand and Supply

Location selection for utility maximization with capacity constraints.

Study on On-line Scheduling Method of Urban Public Transport Based on Quick Response to Passengers' Needs

Location and Capacity Planning of Facilities with General Service-Time Distributions Using Conic Optimization

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

A feasible approach to predict the response time for 3-tier web application with service demand law

A Single-level Mixed-integer Programming Model for the Competitive Facility Location Problem

Throughputs Maximization of Stochastic Customer Orders under Two Production Schemes.

Dealing with congestion in the optimization of locating single-server battery swapping stations

A Bi-Objective Learn-and-Deploy Scheduling Method for Bursty and Stochastic Requests on Heterogeneous Cloud Servers

Group-Server Queues

A Reservation and Allocation Model for Shared-Parking Addressing the Uncertainty in Drivers’ Arrival/departure Time

Queuing Location with Target Customer Selection

Mobile Facility Routing Problem with Service-Time-Related Demand

A Theoretical Survey on Field Service Staffing Based on Response Time

Competitive Facility Location Problem with Foresight Considering Service Distance Limitations.

An integrated model for space determination and site selection of distribution centers