Optimization Of Semi-Markov Switching State-Space Control Processes For Network Communication Systems

Jiang Qi,Xi Hongsheng,Yin Baoqun
DOI: https://doi.org/10.1109/CHICC.2006.4347515
2007-01-01
Abstract:Motivated by optimization of network communication systems, this paper presents an event-driven semi-Markov switching state-space control process with hierarchical dynamic architectures. First, the semi-Markov kernel of the switching control process is constructed, and the sensitivity formula for performance derivatives under average criterion is derived. Then, an online optimization algorithm that combines policy gradient estimation and stochastic approximation is proposed. This analytic model is with constructional flexibility and scalability, and the proposed optimization algorithm is adaptive and with less computational cost. Finally, as an illustrative example, the load balancing problem in a streaming media server cluster is formulated and addressed.
What problem does this paper attempt to address?