An Optimal Control Framework for Online Job Scheduling with General Cost Functions

S. Rasoul Etesami

DOI: https://doi.org/10.48550/arXiv.1906.02644

2021-08-15

Abstract:We consider the problem of online job scheduling on a single machine or multiple unrelated machines with general job/machine-dependent cost functions. In this model, each job $j$ has a processing requirement (length) $v_{ij}$ and arrives with a nonnegative nondecreasing cost function $g_{ij}(t)$ if it has been dispatched to machine $i$, and this information is revealed to the system upon arrival of job $j$ at time $r_j$. The goal is to dispatch the jobs to the machines in an online fashion and process them preemptively on the machines so as to minimize the generalized completion time $\sum_{j}g_{i(j)j}(C_j)$. Here $i(j)$ refers to the machine to which job $j$ is dispatched, and $C_j$ is the completion time of job $j$ on that machine. It is assumed that jobs cannot migrate between machines and that each machine can work on a single job at any time instance. In particular, we are interested in finding an online scheduling policy whose objective cost is competitive with respect to a slower optimal offline benchmark, i.e., the one that knows all the job specifications a priori and is slower than the online algorithm. We first show that for the case of a single machine and special cost functions $g_j(t)=w_jg(t)$, with nonnegative nondecreasing $g(t)$, the highest-density-first rule is optimal for the generalized fractional completion time. We then extend this result by giving a speed-augmented competitive algorithm for the general nondecreasing cost functions $g_j(t)$ by utilizing a novel optimal control framework. This approach provides a principled method for identifying dual variables in different settings of online job scheduling with general cost functions. Using this method, we also provide a speed-augmented competitive algorithm for multiple unrelated machines with convex functions $g_{ij}(t)$, where the competitive ratio depends on the curvature of cost functions $g_{ij}(t)$.

Systems and Control,Computer Science and Game Theory

What problem does this paper attempt to address?

The paper attempts to address the problem of how to minimize the generalized integral completion time with a general cost function when scheduling online jobs on one or multiple unrelated machines. Specifically, the paper considers how to allocate jobs to different machines online, based on the processing requirements of the jobs and a non-negative, non-decreasing cost function, given the machine processing capabilities and job arrival times. Preemptive processing (i.e., jobs can be interrupted) is allowed to minimize the total cost. The key challenge here is to design an online scheduling strategy whose performance can compete with a slower offline optimal benchmark, which knows all job information in advance and processes at a slower speed.

The main contributions of the paper include:
1. Proving that the highest density first rule is optimal for special cost functions in the single-machine case.
2. Proposing a speed-augmented competitive algorithm based on an optimal control framework, suitable for general non-decreasing cost functions.
3. Providing principled solutions for online job scheduling in different scenarios by introducing dual variables.
4. For non-decreasing convex cost functions on multiple unrelated machines, proposing a speed-augmented competitive algorithm whose competitive ratio depends on the curvature of the cost function.

These contributions offer new insights and methods for solving complex cost optimization problems in online job scheduling.