Abstract:We study the optimal scheduling problem for a Markovian multiclass queueing network with abandonment in the Halfin--Whitt regime, under the long run average (ergodic) risk sensitive cost criterion. The objective is to prove asymptotic optimality for the optimal control arising from the corresponding ergodic risk sensitive control (ERSC) problem for the limiting diffusion. In particular, we show that the optimal ERSC value associated with the diffusion-scaled queueing process converges to that of the limiting diffusion in the asymptotic regime. The challenge that ERSC poses is that one cannot express the ERSC cost as an expectation over the mean empirical measure associated with the queueing process, unlike in the usual case of a long run average (ergodic) cost. We develop a novel approach by exploiting the variational representations of the limiting diffusion and the Poisson-driven queueing dynamics, which both involve certain auxiliary controls. The ERSC costs for both the diffusion-scaled queueing process and the limiting diffusion can be represented as the integrals of an extended running cost over a mean empirical measure associated with the corresponding extended processes using these auxiliary controls. For the lower bound proof, we exploit the connections of the ERSC problem for the limiting diffusion with a two-person zero-sum stochastic differential game. We also make use of the mean empirical measures associated with the extended limiting diffusion and diffusion-scaled processes with the auxiliary controls. One major technical challenge in both lower and upper bound proofs, is to establish the tightness of the aforementioned mean empirical measures for the extended processes. We identify nearly optimal controls appropriately in both cases so that the existing ergodicity properties of the limiting diffusion and diffusion-scaled queueing processes can be used.

Exponential and Strong Ergodicity for Markov Processes with an Application to Queues

Exponential Single Server Queues in an Interactive Random Environment

$1/f^{3/2}$ noise in heavy traffic M/M/1 queue

Exponential ergodicity of branching processes with immigration and competition

Operator-Theoretical Treatment of Ergodic Theorem and Its Application to Dynamic Models in Economics

Shift Ergodicity for Stationary Markov Processes

Exponential Tail Bounds on Queues: A Confluence of Non-Asymptotic Heavy Traffic and Large Deviations

Perturbation Theory for the Asymptotic Decay Rates in the Queues with Markovian Arrival Process and/or Markovian Service Process – Correction

Notas sobre Teoría de colas y algunas aplicaciones

Lyapunov-type Conditions for Non-strong Ergodicity of Markov Processes

Exponential ergodicity of some Markov dynamical system with application to a Poisson driven stochastic differential equation

Positive recurrence of piecewise Ornstein-Uhlenbeck processes and common quadratic Lyapunov functions

Transition of $α$-mixing in Random Iterations with Applications in Queuing Theory

Ergodicity and Mixing of Sublinear Expectation System and Applications

Sojourns of fractional Brownian motion queues: transient asymptotics

Unbiased approximation of the ergodic measure for piecewise $α$-stable Ornstein-Uhlenbeck processes arising in queueing networks

Analysis of a Two-Stage Cycle Queue with State-Dependent Vacation Policy

Exponential and strong ergodicity for one-dimensional symmetric stable jump diffusions

Ergodic Risk Sensitive Control of Markovian Multiclass Many-Server Queues with Abandonment

Ergodic quasi-exchangeable stationary processes are isomorphic to Bernoulli processes

On transience of $M/G/\infty$ queues