Abstract:Consider a queuing system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue length and the remaining jobs are routed uniformly at random. A particular case, referred to as the marginal join-the-shortest-queue (MJSQ) policy, is one in which the $O(\sqrt{n})$ jobs are routed using the join-the-shortest-queue (JSQ) policy. Our first result provides a heavy traffic approximation theorem for such queuing systems. It turns out that, unlike the JSQ system, there is no state space collapse in the setting of MJSQ (and for the more general rank-based routing schemes) and one obtains a novel diffusion limit which is the constrained analogue of the well studied Atlas model (and other rank-based diffusions) arising from mathematical finance. Next, we prove an interchange of limits result which shows that the steady state of the queuing system is well approximated by that of the limiting diffusion, given explicitly in terms of product laws of Exponential random variables. Using these results, we compute the time asymptotic workload in the heavy traffic limit for the MJSQ system. We find the striking result that although in going from JSQ to MJSQ the communication cost is reduced by a factor of $\sqrt{n}$, the asymptotic workload increases only by a constant factor which can be made arbitrarily close to one by increasing a MJSQ parameter. When the system is overloaded ($\upsilon<0$) we show that although the $K$-dimensional MJSQ system is unstable, the steady state difference between the maximum and minimum queue lengths stays bounded in probability (in the heavy traffic parameter $n$).

Steady-State Convergence of the Continuous-Time Routing System with General Distributions in Heavy Traffic

Heavy traffic limit theorems for a queue with Poisson ON/OFF long-range dependent sources and general service time distribution

Stationary Distribution Convergence of the Offered Waiting Processes for GI/GI/1+GI Queues in Heavy Traffic

Exponential Tail Bounds on Queues: A Confluence of Non-Asymptotic Heavy Traffic and Large Deviations

Tight matrices and heavy traffic steady state convergence in queueing networks

Asymptotic Product-form Steady-state for Multiclass Queueing Networks with SBP Service Policies in Multi-scale Heavy Traffic

Load Balancing in Parallel Queues and Rank-based Diffusions

Convergence of Approximate and Packet Routing Equilibria to Nash Flows Over Time

Heavy Traffic Joint Queue Length Distribution without Resource Pooling

A Single Server Queue Control Problem in Heavy Traffic

On the Rate of Convergence of the Power-of-Two-Choices to its Mean-Field Limit

Heavy-traffic queue length behavior in a switch under Markovian arrivals

Join-the-Shortest Queue with Abandonment: Critically Loaded and Heavily Overloaded Regimes

Congestion Control with Deterministic Service Delay Guarantee

Heavy Traffic Queue Length Behaviour in a Switch under Markovian Arrivals

Power-of-$d$ Choices Load Balancing in the Sub-Halfin Whitt Regime

Uniform polynomial rates of convergence for a class of Lévy-driven controlled SDEs arising in multiclass many-server queues

Simple and explicit bounds for multi-server queues with $1/(1-ρ)$ scaling

Closed queueing networks under congestion: non-bottleneck independence and bottleneck convergence

Asymptotic product-form steady-state for generalized Jackson networks in multi-scale heavy traffic

Queuing for an infinite bus line and aging branching process