Sensitivity Analysis and Performance Optimization of a Class of Continuous Time Markov Chains

李衍杰,殷保群,奚宏生,代桂平
DOI: https://doi.org/10.3969/j.issn.0253-2778.2004.06.009
2004-01-01
Journal of University of Science and Technology of China
Abstract:Based on the potentials of continuous time Markov chains(CTMC) ,the sensitivity formulas and optimality equation of the chains,with can be used to design the online optimization algorithms,are presented under the discounted cost criteria by using the discounted Poisson equation.Moreover,the relationship of sensitivity formulas ,as well as that of the optimality equations,under the discounted cost criteria and the average cost criteria and the average cost criteria is established by using the vanishing discounted factor.
What problem does this paper attempt to address?