Adaptive Optimization Algorithm of Timeout Policy for Dynamic Power Management

江琦,奚宏生,殷保群
DOI: https://doi.org/10.3321/j.issn:1001-0920.2008.04.003
2008-01-01
Abstract:Based on reinforcement learning,an adaptive online optimization algorithm of timeout policy is proposed for dynamic power management.A semi-Markov control processes based analytic framework is introduced for timeout policy driven power-managed systems.Then an adaptive optimization algorithm that combines gradient estimation online and stochastic approximation is derived.This algorithm doesn't depend on the prior knowledge of system parameters,and can achieve global optimum with less computational cost.As an illustrative example,the dynamic power management for wireless communication devices is formulated,and simulation results show the effectiveness of the proposed algorithm.
What problem does this paper attempt to address?