Abstract:We study the optimal scheduling problem for a Markovian multiclass queueing network with abandonment in the Halfin--Whitt regime, under the long run average (ergodic) risk sensitive cost criterion. The objective is to prove asymptotic optimality for the optimal control arising from the corresponding ergodic risk sensitive control (ERSC) problem for the limiting diffusion. In particular, we show that the optimal ERSC value associated with the diffusion-scaled queueing process converges to that of the limiting diffusion in the asymptotic regime. The challenge that ERSC poses is that one cannot express the ERSC cost as an expectation over the mean empirical measure associated with the queueing process, unlike in the usual case of a long run average (ergodic) cost. We develop a novel approach by exploiting the variational representations of the limiting diffusion and the Poisson-driven queueing dynamics, which both involve certain auxiliary controls. The ERSC costs for both the diffusion-scaled queueing process and the limiting diffusion can be represented as the integrals of an extended running cost over a mean empirical measure associated with the corresponding extended processes using these auxiliary controls. For the lower bound proof, we exploit the connections of the ERSC problem for the limiting diffusion with a two-person zero-sum stochastic differential game. We also make use of the mean empirical measures associated with the extended limiting diffusion and diffusion-scaled processes with the auxiliary controls. One major technical challenge in both lower and upper bound proofs, is to establish the tightness of the aforementioned mean empirical measures for the extended processes. We identify nearly optimal controls appropriately in both cases so that the existing ergodicity properties of the limiting diffusion and diffusion-scaled queueing processes can be used.

Diffusion Approximation for a Re-entrant Network under the Priority Service Discipline

Diffusion Approximation for Queueing Networks under Priority Service Discipline

Existence Condition for the Diffusion Approximations of Multiclass Priority Queueing Networks

Diffusion Approximations for Some Multiclass Queueing Networks with FIFO Service Disciplines.

Diffusion Approximation for Re-entrant Lines under Non-preemptive FBFS Service Discipline

Diffusion Approximations for Kumar-Seidman Network under a Priority Service Discipline.

Diffusion approximation for efficiency-driven queues: A space-time scaling approach

Diffusion Approximations for Open Queueing Networks with Service Interruptions

Diffusion approximations for controlled stochastic networks: An asymptotic bound for the value function

Stability of a Multiclass Queuing Networks under Limited Priority Service Disciplines

Diffusion approximation of the stationary distribution of a two-level single server queue

Strong Approximations for a Kumar-Seidman Network under a Priority Service Discipline

Fluid limits and diffusion approximations for networks of multi-server queues in heavy traffic

Rate of Convergence of Fluid Approximation for Re-Entrant Lines under Fbfs Discipline

A note on non-existence of diffusion limits for serve-the-longest-queue when the buffers are equal in size

Ergodic Risk Sensitive Control of Markovian Multiclass Many-Server Queues with Abandonment

Stability of Multiclass Queueing Networks Under Priority Service Disciplines

Fluid and Diffusion Limits for Bike Sharing Systems

Diffusion Models for Double-ended Queues with Renewal Arrival Processes

A Stochastic Network Calculus Approach for NCS Performance Analysis

Brownian Approximations of Multiclass Open-Queueing Networks