Abstract:Consider a queuing system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue length and the remaining jobs are routed uniformly at random. A particular case, referred to as the marginal join-the-shortest-queue (MJSQ) policy, is one in which the $O(\sqrt{n})$ jobs are routed using the join-the-shortest-queue (JSQ) policy. Our first result provides a heavy traffic approximation theorem for such queuing systems. It turns out that, unlike the JSQ system, there is no state space collapse in the setting of MJSQ (and for the more general rank-based routing schemes) and one obtains a novel diffusion limit which is the constrained analogue of the well studied Atlas model (and other rank-based diffusions) arising from mathematical finance. Next, we prove an interchange of limits result which shows that the steady state of the queuing system is well approximated by that of the limiting diffusion, given explicitly in terms of product laws of Exponential random variables. Using these results, we compute the time asymptotic workload in the heavy traffic limit for the MJSQ system. We find the striking result that although in going from JSQ to MJSQ the communication cost is reduced by a factor of $\sqrt{n}$, the asymptotic workload increases only by a constant factor which can be made arbitrarily close to one by increasing a MJSQ parameter. When the system is overloaded ($\upsilon<0$) we show that although the $K$-dimensional MJSQ system is unstable, the steady state difference between the maximum and minimum queue lengths stays bounded in probability (in the heavy traffic parameter $n$).

Ergodic Risk Sensitive Control of Markovian Multiclass Many-Server Queues with Abandonment

Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues

Asymptotic analysis of a multiclass queueing control problem under heavy-traffic with model uncertainty

Learning a Discrete Set of Optimal Allocation Rules in a Queueing System with Unknown Service Rate

Many Server Queueing Models with Heterogeneous Servers and Parameter Uncertainty with Customer Contact Centre Applications

Scheduling in the High-Uncertainty Heavy Traffic Regime

Diffusion approximation for efficiency-driven queues: A space-time scaling approach

A Single Server Queue Control Problem in Heavy Traffic

Controlling arrival and service rates to reduce sensitivity of queueing systems with customer abandonment

Explicit solution for a network control problem in the large deviation regime

Diffusion Approximations for Some Multiclass Queueing Networks with FIFO Service Disciplines.

Admission Control for Double-ended Queues

Load Balancing in Parallel Queues and Rank-based Diffusions

Two sided ergodic singular control and mean field game for diffusions

Diffusion approximations for controlled stochastic networks: An asymptotic bound for the value function

Uniform Ergodicity and Ergodic-Risk Constrained Policy Optimization

Ergodic control of resource sharing networks: lower bound on asymptotic costs

Join-the-Shortest Queue with Abandonment: Critically Loaded and Heavily Overloaded Regimes

Optimal withdrawals in a general diffusion model with control rates subject to a state-dependent upper bound

Ergodicity of Regime-Switching Functional Diffusions with Infinite Delay and Application to a Numerical Algorithm for Stochastic Optimization

Optimal Admission and Queuing Control with Reneging Behavior under Premature Discharge Decisions