Abstract:Consider a queuing system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue length and the remaining jobs are routed uniformly at random. A particular case, referred to as the marginal join-the-shortest-queue (MJSQ) policy, is one in which the $O(\sqrt{n})$ jobs are routed using the join-the-shortest-queue (JSQ) policy. Our first result provides a heavy traffic approximation theorem for such queuing systems. It turns out that, unlike the JSQ system, there is no state space collapse in the setting of MJSQ (and for the more general rank-based routing schemes) and one obtains a novel diffusion limit which is the constrained analogue of the well studied Atlas model (and other rank-based diffusions) arising from mathematical finance. Next, we prove an interchange of limits result which shows that the steady state of the queuing system is well approximated by that of the limiting diffusion, given explicitly in terms of product laws of Exponential random variables. Using these results, we compute the time asymptotic workload in the heavy traffic limit for the MJSQ system. We find the striking result that although in going from JSQ to MJSQ the communication cost is reduced by a factor of $\sqrt{n}$, the asymptotic workload increases only by a constant factor which can be made arbitrarily close to one by increasing a MJSQ parameter. When the system is overloaded ($\upsilon<0$) we show that although the $K$-dimensional MJSQ system is unstable, the steady state difference between the maximum and minimum queue lengths stays bounded in probability (in the heavy traffic parameter $n$).

A Joining Shortest Queue with MAP Inputs

A Two-Stage Queueing Network with Map Inputs and Buffer Sharing

Approximations for a Queueing Game Model with Join-the-Shortest-Queue Strategy

A Vacation Queue With Setup And Close-Down Times And Batch Markovian Arrival Processes

Join the Shortest Queue with Many Servers. The Heavy-Traffic Asymptotics

A Queueing Model with BMAP Arrivals and Heterogeneous Phase Type Group Services

Two-types of service facilities in interconnected stochastic queueing and queueing-inventory system with marked Markovian arrival process

A finite‐capacity queue with exhaustive vacation/close‐down/setup times and Markovian arrival processes

Analysis of an infinite-buffer batch-size-dependent service queue with discrete-time Markovian arrival process: D-$MAP/G_n^{(a,b)}/1$

Load Balancing in Parallel Queues and Rank-based Diffusions

The Evolution Process of Queues at Signalized Intersections under Batch Arrivals

A single server queue with batch arrivals and semi-Markov services

Double-ended queues with non-Poisson inputs and their effective algorithms

Joint Queue-Length Distribution for the Non-Preemptive Multi-Server Multi-Level Markovian Priority Queue

Balanced Routing with Partial Information in a Distributed Parallel Many-Server Queueing System

A two-class MAP/PH/1 weighted fair queueing system and its application to telecommunications

The non-preemptive 'Join the Shortest Queue–Serve the Longest Queue' service system with or without switch-over times

Optimal Control of State-Dependent Service Rates in a MAP/M/1 Queue

A MAP/G/1 Queue with Negative Customers

Matched Queues with Flexible and Impatient Customers

Double-End Queues with Non-Poisson Inputs and Their Effective Algorithms