Abstract:In modern computing systems, jobs' resource requirements often vary over time. Accounting for this temporal variability during job scheduling is essential for meeting performance goals. However, theoretical understanding on how to schedule jobs with time-varying resource requirements is limited. Motivated by this gap, we propose a \emph{new setting} of the stochastic bin-packing problem in service systems that allows for \emph{time-varying} job resource requirements, also referred to as `item sizes' in traditional bin-packing terms. In this setting, a job or `item' must be dispatched to a server or `bin' upon arrival. Its resource requirement may vary over time while in service, following a Markovian assumption. Once the job's service is complete, it departs from the system. Our goal is to minimize the expected number of active servers, or `non-empty bins', in steady state. Under our problem formulation, we develop a job dispatch policy, named Join-Reqesting-Server (JRS). Broadly, JRS lets each server independently evaluate its current job configuration and decide whether to accept additional jobs, balancing the competing objectives of maximizing throughput and minimizing the risk of resource capacity overruns. The JRS dispatcher then utilizes these individual evaluations to decide which server to dispatch each arriving job to. The theoretical performance guarantee of JRS is in the asymptotic regime where the job arrival rate scales large linearly with respect to a scaling factor $r$. We show that JRS achieves an additive optimality gap of $O(\sqrt{r})$ in the objective value, where the optimal objective value is $\Theta(r)$. When specialized to constant job resource requirements, our result improves upon the state-of-the-art $o(r)$ optimality gap. Our technical approach highlights a novel policy conversion framework that reduces the policy design problem into a single-server problem.

Service Scheduling for Random Requests with Quadratic Waiting Costs

A Receding Optimization Control Policy for Production Systems with Quadratic Inventory Costs

Scheduling in Parallel Queues with Randomly Varying Connectivity and Switchover Delay

Learning a Discrete Set of Optimal Allocation Rules in a Queueing System with Unknown Service Rate

Optimal Service Control Of A Serial Production Line With Unreliable Workstations And Random Demand

Optimal control of a two-phase heterogeneous service retrial queueing system with collisions and delayed vacations

Scheduling Servers with Stochastic Bilinear Rewards

Optimal Server Assignment in Multi-Server Queueing Systems with Random Connectivities

Two-types of service facilities in interconnected stochastic queueing and queueing-inventory system with marked Markovian arrival process

Quasi and metaheuristic optimization approach for service system with strategic policy and unreliable service

Scheduling Jobs with Stochastic Holding Costs

Non-clairvoyant Scheduling Games

Queueing Systems with Preferred Service Delivery Times and Multiple Customer Classes

Cost Optimization of the Queueing System with Degrading Service Rate, Bernoulli Vacation, and a Regular Vacation After Fixed Services

Robust Appointment Scheduling with Waiting Time Guarantees

A service system with randomly behaving on-demand agents

Near-Optimal Stochastic Bin-Packing in Large Service Systems with Time-Varying Item Sizes

Dynamic Scheduling of a Multiclass Make-to-Stock Queue

Single-Machine Scheduling Problems with Variable Processing Times and Past-Sequence-Dependent Delivery Times

On-line Service Scheduling

Dynamic Pricing and Matching for Two-Sided Queues