Abstract:Multi-server jobs are imperative in modern cloud computing systems. A noteworthy feature of multi-server jobs is that, they usually request multiple computing devices simultaneously for their execution. How to schedule multi-server jobs online with a high system efficiency is a topic of great concern. Firstly, the scheduling decisions have to satisfy the service locality constraints. Secondly, the scheduling decisions needs to be made online without the knowledge of future job arrivals. Thirdly, and most importantly, the actual service rate experienced by a job is usually in fluctuation because of the dynamic voltage and frequency scaling (DVFS) and power oversubscription techniques when multiple types of jobs co-locate. A majority of online algorithms with theoretical performance guarantees are proposed. However, most of them require the processing speeds to be knowable, thereby the job completion times can be exactly calculated. To present a theoretically guaranteed online scheduling algorithm for multi-server jobs without knowing actual processing speeds apriori, in this paper, we propose ESDP (Efficient Sampling-based Dynamic Programming), which learns the distribution of the fluctuated processing speeds over time and simultaneously seeks to maximize the cumulative overall utility. The cumulative overall utility is formulated as the sum of the utilities of successfully serving each multi-server job minus the penalty on the operating, maintaining, and energy cost. ESDP is proved to have a polynomial complexity and a logarithmic regret, which is a State-of-the-Art result. We also validate it with extensive simulations and the results show that the proposed algorithm outperforms several benchmark policies with improvements by up to 73%, 36%, and 28%, respectively.

Algorithms for Distributed Server Allocation Problem

Research on Optimal Two Element Exchange Algorithm for Large Scale Cloud Computing Server Scheduling Problem

A (32+Ε)-Approximation Algorithm for Scheduling on Two Parallel Machines with Job Delivery Coordination.

An Exponentially Convergent Distributed Algorithm for Resource Allocation Problem

A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs.

Polynomial-time server allocation algorithm in delay-sensitive internet-of-things monitoring services

Single Machine Batch Scheduling to Minimize the Sum of Total Flow Time and Batch Delivery Cost with an Unavailability Interval

A Dual Splitting Algorithm For Distributed Resource Allocation Problems

Migration Model for Distributed Server Allocation

Distributed Algorithm for a Finite Time Horizon Resource Allocation over a Directed Network

Maximizing Heterogeneous Server Utilization with Limited Availability Times for Divisible Loads Scheduling on Networked Systems

Optimal Resource Scheduling and Allocation in Distributed Computing Systems

The Modeling and Algorithms of Information Organization and Allocation Problem on Internet Communications

A distributed algorithm for optimal network resource allocation considering delay sensitive traffic

Online Scheduling on Two Parallel Machines with Release Dates and Delivery Times

Accelerated Distributed Allocation

On Optimal Server Allocation for Moldable Jobs with Concave Speed-Up

Learning to Schedule Multi-Server Jobs with Fluctuated Processing Speeds

A Subquadratic-Time Distributed Algorithm for Exact Maximum Matching

Distributed Scheduling Strategies for Processing Multiple Divisible Loads with Unknown Network Resources