Abstract:Consider a queuing system with $K$ parallel queues in which the server for each queue processes jobs at rate $n$ and the total arrival rate to the system is $nK-\upsilon \sqrt{n}$ where $\upsilon \in (0, \infty)$ and $n$ is large. We study rank-based routing policies in which $O(\sqrt{n})$ of the incoming jobs are routed to servers with probabilities depending on their ranked queue length and the remaining jobs are routed uniformly at random. A particular case, referred to as the marginal join-the-shortest-queue (MJSQ) policy, is one in which the $O(\sqrt{n})$ jobs are routed using the join-the-shortest-queue (JSQ) policy. Our first result provides a heavy traffic approximation theorem for such queuing systems. It turns out that, unlike the JSQ system, there is no state space collapse in the setting of MJSQ (and for the more general rank-based routing schemes) and one obtains a novel diffusion limit which is the constrained analogue of the well studied Atlas model (and other rank-based diffusions) arising from mathematical finance. Next, we prove an interchange of limits result which shows that the steady state of the queuing system is well approximated by that of the limiting diffusion, given explicitly in terms of product laws of Exponential random variables. Using these results, we compute the time asymptotic workload in the heavy traffic limit for the MJSQ system. We find the striking result that although in going from JSQ to MJSQ the communication cost is reduced by a factor of $\sqrt{n}$, the asymptotic workload increases only by a constant factor which can be made arbitrarily close to one by increasing a MJSQ parameter. When the system is overloaded ($\upsilon<0$) we show that although the $K$-dimensional MJSQ system is unstable, the steady state difference between the maximum and minimum queue lengths stays bounded in probability (in the heavy traffic parameter $n$).

Rank-based stochastic differential inclusions and diffusion limits for a load balancing model

Invariance principle and McKean-Vlasov limit for randomized load balancing in heavy traffic

Load Balancing in Parallel Queues and Rank-based Diffusions

Extremal Invariant Distributions of Infinite Brownian Particle Systems with Rank Dependent Drifts

Stochastic ranking process with space-time dependent intensities

Invariant distribution of duplicated diffusions and application to Richardson-Romberg extrapolation

How Discrete and Continuous Diffusion Meet: Comprehensive Analysis of Discrete Diffusion Models via a Stochastic Integral Framework

Constant Step Stochastic Approximations Involving Differential Inclusions: Stability, Long-Run Convergence and Applications

Remarks on Differential Inclusion limits of Stochastic Approximation

Learning and balancing unknown loads in large-scale systems

Existence of an infinite particle limit of stochastic ranking process

Doubly Exponential Solution for Randomized Load Balancing Models with General Service Times

Stochastic Langevin Differential Inclusions with Applications to Machine Learning

Size-biased diffusion limits and the inclusion process

Stochastic areas of diffusions and applications in risk theory

Large systems of diffusions interacting through their ranks

Apparent anomalous diffusion and non-Gaussian distributions in a simple mobile-immobile transport model with Poissonian switching

Heavy Traffic Scaling Limits for Shortest Remaining Processing Time Queues with Light Tailed Processing Time Distributions

Non-equilibrium phase transitions in active rank diffusions

Stable laws for random dynamical systems

The on-off network traffic model under intermediate scaling