Abstract:We consider the first-come-first-serve (FCFS) [Formula: see text] queue and prove the first simple and explicit bounds that scale as [Formula: see text] under only the assumption that interarrival times have finite second moment, and service times have finite [Formula: see text] moment for some [Formula: see text]. Here, ρ denotes the corresponding traffic intensity. Conceptually, our results can be viewed as a multiserver analogue of Kingman’s bound. Our main results are bounds for the tail of the steady-state queue length and the steady-state probability of delay. The strength of our bounds (e.g., in the form of tail decay rate) is a function of how many moments of the service distribution are assumed finite. Our bounds scale gracefully, even when the number of servers grows large and the traffic intensity converges to unity simultaneously, as in the Halfin-Whitt scaling regime. Some of our bounds scale better than [Formula: see text] in certain asymptotic regimes. In these same asymptotic regimes, we also prove bounds for the tail of the steady-state number in service. Our main proofs proceed by explicitly analyzing the bounding process that arises in the stochastic comparison bounds of Gamarnik and Goldberg for multiserver queues. Along the way, we derive several novel results for suprema of random walks and pooled renewal processes, which may be of independent interest. We also prove several additional bounds using drift arguments (which have much smaller prefactors) and point out a conjecture that would imply further related bounds and generalizations. We also show that when all moments of the service distribution are finite and satisfy a mild growth rate assumption, our bounds can be strengthened to yield explicit tail estimates decaying as [Formula: see text], with [Formula: see text], depending on the growth rate of these moments. Funding: Financial support from the National Science Foundation [Grant 1333457] is gratefully acknowledged. Supplemental Material: The supplemental appendix is available at https://doi.org/10.1287/moor.2022.0131 .

On Universal Scaling of Distributed Queues under Load Balancing

Scalable Load Balancing in Networked Systems: Universality Properties and Stochastic Coupling Methods

Steady-State Analysis of Load Balancing with Coxian-$2$ Distributed Service Times

Load Balancing in the Non-Degenerate Slowdown Regime

Balanced Routing with Partial Information in a Distributed Parallel Many-Server Queueing System

Hyper-Scalable JSQ with Sparse Feedback

Load Balancing in Heterogeneous Server Clusters: Insights From a Product-Form Queueing Model

Load Balancing in Parallel Queues and Rank-based Diffusions

Power-of-$d$ Choices Load Balancing in the Sub-Halfin Whitt Regime

Zero Queueing for Multi-Server Jobs

Many-server asymptotics for Join-the-Shortest Queue in the Super-Halfin-Whitt Scaling Window

Simple and explicit bounds for multi-server queues with $1/(1-ρ)$ scaling

Queue-length balance equations in multiclass multiserver queues and their generalizations

Perfect simulation of Markovian load balancing queueing networks in equilibrium

We Are Impatient: Algorithms for Geographically Distributed Load Balancing with (Almost) Arbitrary Load Functions

Balanced Splitting: A Framework for Achieving Zero-wait in the Multiserver-job Model

Asymptotic Optimality of Balanced Routing

Stability of Parallel Server Systems

Simple and Explicit Bounds for Multiserver Queues with [math] Scaling

Learning While Scheduling in Multi-Server Systems with Unknown Statistics: MaxWeight with Discounted UCB

Asymptotic Optimality of the Speed-Aware Join-the-Shortest-Queue in the Halfin-Whitt Regime for Heterogeneous Systems