Abstract:We consider the FCFS $GI/GI/n$ queue, and prove the first simple and explicit bounds that scale as $\frac{1}{1-\rho}$ under only the assumption that inter-arrival times have finite second moment, and service times have finite $2+\epsilon$ moment for some $\epsilon > 0$. Here $\rho$ denotes the corresponding traffic intensity. Conceptually, our results can be viewed as a multi-server analogue of Kingman's bound. Our main results are bounds for the tail of the steady-state queue length and the steady-state probability of delay. The strength of our bounds (e.g. in the form of tail decay rate) is a function of how many moments of the service distribution are assumed finite. Our bounds scale gracefully even when the number of servers grows large and the traffic intensity converges to unity simultaneously, as in the Halfin-Whitt scaling regime. Some of our bounds scale better than $\frac{1}{1-\rho}$ in certain asymptotic regimes. In these same asymptotic regimes we also prove bounds for the tail of the steady-state number in service. Our main proofs proceed by explicitly analyzing the bounding process which arises in the stochastic comparison bounds of Gamarnik and Goldberg for multi-server queues. Along the way we derive several novel results for suprema of random walks and pooled renewal processes which may be of independent interest. We also prove several additional bounds using drift arguments (which have much smaller pre-factors), and point out a conjecture which would imply further related bounds and generalizations. We also show that when all moments of the service distribution are finite and satisfy a mild growth rate assumption, our bounds can be strengthened to yield explicit tail estimates decaying as $O\big(\exp(-x^{\alpha})\big)$, with $\alpha \in (0,1)$ depending on the growth rate of these moments.

Coupling in the queue with impatience: case of several servers

Exponential Single Server Queues in an Interactive Random Environment

Perfect simulation of Markovian load balancing queueing networks in equilibrium

Long time behavior of a stochastically modulated infinite server queue

A single server queue with batch arrivals and semi-Markov services

Useful stochastic bounds in time-varying queues with service and patience times having general joint distribution

Stability of Parallel Server Systems

Exact Results for the Distribution of the Partial Busy Period for a Multi-Server Queue

Analysis of a Multi-server Queueing-inventory System with Non-homogeneous Poisson Arrivals

Comparison of Gradient Estimation Techniques for Queues with Non-Identical Servers.

Perfect Simulation of $M/G/c$ Queues

Join the Shortest Queue with Many Servers. The Heavy-Traffic Asymptotics

On the single-server queue with non-homogeneous Poisson input and general service time

Matched Queues with Flexible and Impatient Customers

A queueing system with batch renewal input and negative arrivals

Processor Sharing Queues with Impatience

Overlap Times in Tandem Queues: Identically Distributed Station Case

A two-station queue with dependent preparation and service times

Queuing for an infinite bus line and aging branching process

Simple and explicit bounds for multi-server queues with $1/(1-ρ)$ scaling