Abstract:In general, obtaining the exact steady-state distribution of queue lengths is not feasible. Therefore, we establish bounds for the tail probabilities of queue lengths. Specifically, we examine queueing systems under Heavy-Traffic (HT) conditions and provide exponentially decaying bounds for the probability $\mathbb P(\epsilon q > x)$, where $\epsilon$ is the HT parameter denoting how far the load is from the maximum allowed load. Our bounds are not limited to asymptotic cases and are applicable even for finite values of $\epsilon$, and they get sharper as $\epsilon \to 0$. Consequently, we derive non-asymptotic convergence rates for the tail probabilities. Unlike other approaches such as moment bounds based on drift arguments and bounds on Wasserstein distance using Stein's method, our method yields sharper tail bounds. Furthermore, our results offer bounds on the exponential rate of decay of the tail, given by $-\frac{1}{x} \log \mathbb P(\epsilon q > x)$ for any finite value of $x$. These can be interpreted as non-asymptotic versions of Large Deviation (LD) results. We demonstrate our approach by presenting tail bounds for: (i) a continuous time Join-the-shortest queue (JSQ) load balancing system, (ii) a discrete time single-server queue and (iii) an $M/M/n$ queue. We not only bridge the gap between classical-HT and LD regimes but also explore the large system HT regimes for JSQ and $M/M/n$ systems. In these regimes, both the system size and the system load increase simultaneously. Our results also close a gap in the existing literature on the limiting distribution of JSQ in the super-NDS (a.k.a. super slowdown) regime. This contribution is of an independent interest. Here, a key ingredient is a more refined characterization of state space collapse for JSQ system, achieved by using an exponential Lyapunov function designed to approximate the $\ell_{\infty}$ norm.

On the exact asymptotics for the stationary sojourn time distribution in a tandem of queues with light-tailed service times

Numerical Computations and Tail Asymptotics for Stationary Indices of a Discrete-time Queue

Sojourns of fractional Brownian motion queues: transient asymptotics

Overlap Times in Tandem Queues: Identically Distributed Station Case

Asymptotic analysis of random partitions ∗

Exponential Tail Bounds on Queues: A Confluence of Non-Asymptotic Heavy Traffic and Large Deviations

The generalized join the shortest orbit queue system: Stability, exact tail asymptotics and stationary approximations

Asymptotic analysis of the sojourn time of a batch in a M[X]/M/1 processor sharing queue

Sojourn times in the M/G/1 FB queue with light-tailed service times

On the single-server queue with non-homogeneous Poisson input and general service time

Exact tail asymptotics for fluid models driven by an $M/M/c$ queue

Useful stochastic bounds in time-varying queues with service and patience times having general joint distribution

Heavy Loads and Heavy Tails

Light-Tailed Asymptotics of Stationary Probability Vectors of Markov Chains of Gi/G/1 Type

Perturbation Theory for the Asymptotic Decay Rates in the Queues with Markovian Arrival Process and/or Markovian Service Process – Correction

Moderate deviations of many-server queues in the Halfin-Whitt regime and weak convergence methods

A single server queue with batch arrivals and semi-Markov services

Exact asymptotics in an infinite-server system with overdispersed input

Join the Shortest Queue with Many Servers. The Heavy-Traffic Asymptotics

Asymptotics for sums of random variables with local subexponential behaviour

Time-dependent queue length distribution in queues fed by $K$ customers in a finite interval