Abstract:In modern computing systems, jobs' resource requirements often vary over time. Accounting for this temporal variability during job scheduling is essential for meeting performance goals. However, theoretical understanding on how to schedule jobs with time-varying resource requirements is limited. Motivated by this gap, we propose a \emph{new setting} of the stochastic bin-packing problem in service systems that allows for \emph{time-varying} job resource requirements, also referred to as `item sizes' in traditional bin-packing terms. In this setting, a job or `item' must be dispatched to a server or `bin' upon arrival. Its resource requirement may vary over time while in service, following a Markovian assumption. Once the job's service is complete, it departs from the system. Our goal is to minimize the expected number of active servers, or `non-empty bins', in steady state. Under our problem formulation, we develop a job dispatch policy, named Join-Reqesting-Server (JRS). Broadly, JRS lets each server independently evaluate its current job configuration and decide whether to accept additional jobs, balancing the competing objectives of maximizing throughput and minimizing the risk of resource capacity overruns. The JRS dispatcher then utilizes these individual evaluations to decide which server to dispatch each arriving job to. The theoretical performance guarantee of JRS is in the asymptotic regime where the job arrival rate scales large linearly with respect to a scaling factor $r$. We show that JRS achieves an additive optimality gap of $O(\sqrt{r})$ in the objective value, where the optimal objective value is $\Theta(r)$. When specialized to constant job resource requirements, our result improves upon the state-of-the-art $o(r)$ optimality gap. Our technical approach highlights a novel policy conversion framework that reduces the policy design problem into a single-server problem.

Managing flexibility: optimal sizing and scheduling of flexible servers

Flexibility in an asymmetric system with prolonged service time at non-dedicated servers

Flexible System Design: A Perspective from Service Levels

Optimal Staffing for Online-to-Offline On-Demand Delivery Systems: In-House or Crowd-Sourcing Drivers?

Flexible Queueing Architectures

Optimal Service Control of a Flexible Production Line with Random Demand

Optimal scheduling of multiple sets of air separation units with frequent load-change operation

Optimal Scheduling of Power Systems with High Proportions of Renewable Energy Accounting for Operational Flexibility

Optimal Design of Process Flexibility for General Production Systems

Flexibility in Matching

Optimal Planning of Plant Flexibility: Problem Formulation and Performance Analysis.

Flow Shop Scheduling with Partial Resource Flexibility

On-line Service Scheduling

An Integrated Staff-Sizing Approach Considering Feasibility of Scheduling Decision

Near-Optimal Stochastic Bin-Packing in Large Service Systems with Time-Varying Item Sizes

Flexible Bus Route Optimization Scheduling Model

Microstructure and Flexible Optimizing Method of Scheduling Problem

Data-driven Integrated Home Service Staffing and Capacity Planning: Stochastic Optimization Approaches

Two-Sided Flexibility in Platforms

A Distributionally Robust Optimization Framework for Stochastic Assessment of Power System Flexibility in Economic Dispatch

A PageRank-like Measure for Evaluating Process Flexibility