Abstract:In general, obtaining the exact steady-state distribution of queue lengths is not feasible. Therefore, we establish bounds for the tail probabilities of queue lengths. Specifically, we examine queueing systems under Heavy-Traffic (HT) conditions and provide exponentially decaying bounds for the probability $\mathbb P(\epsilon q > x)$, where $\epsilon$ is the HT parameter denoting how far the load is from the maximum allowed load. Our bounds are not limited to asymptotic cases and are applicable even for finite values of $\epsilon$, and they get sharper as $\epsilon \to 0$. Consequently, we derive non-asymptotic convergence rates for the tail probabilities. Unlike other approaches such as moment bounds based on drift arguments and bounds on Wasserstein distance using Stein's method, our method yields sharper tail bounds. Furthermore, our results offer bounds on the exponential rate of decay of the tail, given by $-\frac{1}{x} \log \mathbb P(\epsilon q > x)$ for any finite value of $x$. These can be interpreted as non-asymptotic versions of Large Deviation (LD) results. We demonstrate our approach by presenting tail bounds for: (i) a continuous time Join-the-shortest queue (JSQ) load balancing system, (ii) a discrete time single-server queue and (iii) an $M/M/n$ queue. We not only bridge the gap between classical-HT and LD regimes but also explore the large system HT regimes for JSQ and $M/M/n$ systems. In these regimes, both the system size and the system load increase simultaneously. Our results also close a gap in the existing literature on the limiting distribution of JSQ in the super-NDS (a.k.a. super slowdown) regime. This contribution is of an independent interest. Here, a key ingredient is a more refined characterization of state space collapse for JSQ system, achieved by using an exponential Lyapunov function designed to approximate the $\ell_{\infty}$ norm.

Heavy Loads and Heavy Tails

Exponential Tail Bounds on Queues: A Confluence of Non-Asymptotic Heavy Traffic and Large Deviations

Heavy Traffic Scaling Limits for Shortest Remaining Processing Time Queues with Light Tailed Processing Time Distributions

Heavy traffic limit theorems for a queue with Poisson ON/OFF long-range dependent sources and general service time distribution

Heavy-Traffic Analysis Through Uniform Acceleration of Queues with Diminishing Populations

Invariance principle and McKean-Vlasov limit for randomized load balancing in heavy traffic

From the Central Limit Theorem to Heavy-Tailed Distributions

Queueing analysis with heavy-tailed network traffic

On the exact asymptotics for the stationary sojourn time distribution in a tandem of queues with light-tailed service times

Heavy-tailed asymptotics for a fluid model driven by an M/G/1 queue

A new approach in two-dimensional heavy-tailed distributions

Serve the shortest queue and Walsh Brownian motion

Heavy Traffic Joint Queue Length Distribution without Resource Pooling

A Heavy Traffic Theory of Matching Queues

Heavy Traffic Queue Length Behaviour in a Switch under Markovian Arrivals

Heavy-traffic asymptotic formulas for the multiclass M${}^X$/G/1 queue

Numerical Computations and Tail Asymptotics for Stationary Indices of a Discrete-time Queue

Heavy-traffic queue length behavior in a switch under Markovian arrivals

Scheduling in the High-Uncertainty Heavy Traffic Regime

Jumping Fluid Models and Delay Stability of Max-Weight Dynamics Under Heavy-Tailed Traffic

Delay Bounds for Networks with Heavy-Tailed and Self-Similar Traffic