Abstract:We consider the dynamic scheduling problem in a single-server multi-class queueing system, where the accumulated holding costs of a customer is a convexly increasing function of the time that the customer spends in the system. This problem was already addressed by van Mieghem in his seminal paper (Ann Appl Probab 5:808–833, 1995). He launched the so-called generalized rule and proved its asymptotic optimality in the heavy traffic limit. The optimal scheduling problem with convex holding costs have also been studied in many other papers. However, the holding costs in these papers are typically count-convex, i.e., the aggregate holding cost rate related to a class of customers increases convexly as a function of the current number of customers in this class, which is clearly different from the time-convex holding costs introduced in van Mieghem (Ann Appl Probab 5:808–833, 1995) and studied also in the present paper. We utilize the Whittle index approach to develop a novel heuristic policy for the dynamic scheduling problem with time-convex holding costs. Instead of the original open version of the continuous-time scheduling problem, we apply the Whittle index approach to the corresponding discrete-time closed version of the problem. As the main theoretical contribution, we prove that, for IHR service times, the discounted discrete-time problem is indexable and also give an explicit expression for the Whittle index itself. A special challenge in our model is the two-dimensional state space with an infinite number of possible states. By utilizing the discrete-time results, we develop a novel index policy for the original continuous-time problem and demonstrate, by numerical simulations, that this Whittle index policy outperforms the generalized rule. Thus, while the generalized rule is asymptotically optimal in the heavy traffic limit, it can still be improved in normal traffic conditions.

Simulation Optimization for Queues with Heavy-Tailed Service Times

Steady-State Analysis and Online Learning for Queues with Hawkes Arrivals

Optimal control of a two-phase heterogeneous service retrial queueing system with collisions and delayed vacations

A Weighted Fair Queuing Scheduling Algorithm With (M,K)-Firm Guarantee

A Stochastic Approximation Method for Simulation-Based Quantile Optimization

The Setting and Optimization of Quick Queue

Enhanced Wfq Algorithm With (M,K)-Firm Guarantee

Resource Allocation and Outpatient Appointment Scheduling Using Simulation Optimization

Exact sampling for some multi-dimensional queueing models with renewal input

Balancing Herding and Congestion in Service Systems: a Queueing Perspective

Whittle index approach to the multi-class queueing systems with convex holding costs and IHR service times

Online Learning and Optimization for Queues with Unknown Demand Curve and Service Distribution

Doubly Exponential Solution for Randomized Load Balancing Models with General Service Times

Simulation Optimization on Complex Job Shop Scheduling with Non-Identical Job Sizes.

An Optimality Algorithm for a Class of Closed Queuing Network by Using Oblivion Factor

Analysis of a Multi-server Queueing-inventory System with Non-homogeneous Poisson Arrivals

An online learning approach to dynamic pricing and capacity sizing in service systems

Optimization of a generalized M(k)/M/k queueing system

Many Server Queueing Models with Heterogeneous Servers and Parameter Uncertainty with Customer Contact Centre Applications

Optimal differentiated threshold characterization for multi-task stochastic deadline scheduling with queuing

Strategic behavior, social optimization, and revenue maximization in queues with infinite servers