Abstract:In this paper, we study the optimal control of service rates in a queueing system with a Markovian arrival process (MAP) and exponential service times. The service rate is allowed to be state dependent, i.e., we can adjust the service rate according to the queue length and the phase of the MAP. The cost function consists of holding cost and operating cost. The goal is to find the optimal service rates that minimize the long-run average total cost. To achieve that, we use the matrix-analytic methods (MAM) together with the sensitivity-based optimization (SBO) theory. A performance difference formula is derived, which can quantify the difference of the long-run average total cost under any two different settings of service rates. Based on the difference formula, we show that the long-run average total cost is monotone in the service rate and the optimal control is a bang-bang control. We also show that, under some mild conditions, the optimal control policy of service rates is of a quasi-threshold-type. By utilizing the MAM theory, we propose a recursive algorithm to compute the value function related quantities. An iterative algorithm to efficiently find the optimal policy, which is similar to policy iteration, is proposed based on the SBO theory. We further study some special cases of the problem, such as the optimality of the threshold-type policy for the M/M/1 queue. Finally, a number of numerical examples are presented to demonstrate the main results and explore the impact of the phase of the MAP on the optimization in the MAP/M/1 queue.

Modeling and Optimization of M/G/1-Type Queueing Networks: an Efficient Sensitivity Analysis Approach

Modeling and Optimization of<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"><mml:mrow><mml:mi>M</mml:mi><mml:mo>/</mml:mo><mml:mi>G</mml:mi><mml:mo>/</mml:mo><mml:mn mathvariant="bold">1</mml:mn></mml:mrow></mml:math>-Type Queueing Networks: An Efficient Sensitivity Analysis Approach

Sensitivity Analysis and Estimates of the Performance for M/G/1 Queueing Systems

A Traffic Breakdown Model Based on Queueing Theory

SENSITIVITY ANALYSIS OF PERFORMANCEFOR M/G/1 QUEUEING SYSTEMS

Sensitivity analysis and cost optimization for state-dependent M/G/1/K queue with retrial orbit and admission control F -policy

Optimized M/M/c model and simulation for bank queuing system

Sensitivity Analysis of Performance in Queueing Systems with Phase-Type Service Distributions

Performance Optimization and Iteration Algorithm for Controlled M/G/1 Queuing Systems

Optimal Control of State-Dependent Service Rates in a MAP/M/1 Queue

Optimization of a generalized M(k)/M/k queueing system

A Stochastic Queuing Network Model for MPLS Adaptive Traffic Engineering

M/M/1 Model and the Solving by Using the Monte-Carlo Method

Optimal-Control And Scheduling In A Multiclass Queuing Network - Results And Conjectures

An extended GIX/M/1/N queueing model for evaluating the performance of AQM algorithms with aggregate traffic

A new TCP/AQM system analysis

Queueing analysis with heavy-tailed network traffic

Sensitivity Formulas of Performance in Closed State-Dependent Queueing Networks

Performance Gradient Estimation for M/G/1 Queueing System Using Nonstandard Analysis

Extended Queueing System GI~X/M/1/N for Evaluating the Performance of AQM Algorithms

Bi-objective optimization and reliability analysis in unreliable M/G/1 retrial queues with rational customers, reserved idle times and setup times