Abstract:We consider a simple discrete-time controlled queueing system, where the controller has a choice of which server to use at each time slot and server performance varies according to a Markov modulated random environment. We explore the role of information in the system stability region. At the extreme cases of information availability, that is when there is either full information or no information, stability regions and maximally stabilizing policies are trivial. But in the more realistic cases where only the environment state of the selected server is observed, only the service successes are observed or only queue length is observed, finding throughput maximizing control laws is a challenge. To handle these situations, we devise a Partially Observable Markov Decision Process (POMDP) formulation of the problem and illustrate properties of its solution. We further model the system under given decision rules, using Quasi-Birth-and-Death (QBD) structure to find a matrix analytic expression for the stability bound. We use this formulation to illustrate how the stability region grows as the number of controller belief states increases. Our focus in this paper is on the simple case of two servers where the environment of each is modulated according to a two-state Markov chain. As simple as this case seems, there appear to be no closed form descriptions of the stability region under the various regimes considered. Our numerical approximations to the POMDP Bellman equations and the numerical solutions of the QBDs hint at a variety of structural results.

Stability Analysis for Multi-Class Multi-Queue Single Server System under Polling Table

Mean Cyclic Period of Polling Model with Two Classes of Objects in Each Queue

Analysis on polling system with two classes of objects in each queue

A polling system whose stability region depends on a whole distribution of service times

Analysis of a Multi-server Queueing-inventory System with Non-homogeneous Poisson Arrivals

Zero Queueing for Multi-Server Jobs

Stabilizing a Queue Subject to Action-Dependent Server Performance

The Role of Information in System Stability with Partially Observable Servers

Equilibrium balking behavior of customers and regulation measures in a multi-server queue with threshold policy

Analysis of polling system with high priority queue using twice gated service

Stability Conditions of a Preemptive Repeat Priority Queue with Customer Transfers

On deciding stability of multiclass queueing networks under buffer priority scheduling policies

Stability for Two-class Multiserver-job Systems

Queueing Theory and Network Applications

Heterogeneous Spectrum Aggregation: Coexistence from a Queue Stability Perspective

On the Stationary Distribution of Queue Lengths in a Multi-Class Priority Queueing System with Customer Transfers.

On Stability and Sojourn Time of Peer-to-Peer Queuing Systems

Equilibrium Balking Strategies of Customers in Markovian Queues with Two-Stage Working Vacations

Queuing Models for Peer-to-peer Systems

Queue-length balance equations in multiclass multiserver queues and their generalizations

Analysis of a priority queueing system with the enhanced fairness of servers scheduling