Dynamic Intermittent Q-Learning for Systems with Reduced Bandwidth

Yongliang Yang,Kyriakos G. Vamvoudakis,Henrique Ferraz,Hamidreza Modares
DOI: https://doi.org/10.1109/cdc.2018.8619242
2018-01-01
Abstract:This paper presents a Q-Iearning based dynamic intermittent mechanism to control linear systems evolving in continuous time. In contrast to existing event-triggered mechanisms, where complete knowledge of the system dynamics is required, the proposed dynamic intermittent control obviates this requirement while providing a quantified level of performance. An internal dynamical system will be introduced to generate the triggering condition. Then, a dynamic intermittent Q-Iearning is developed to learn the optimal value function and the hybrid controller. A qualitative performance analysis of the dynamic event-triggered control is given in comparison to the continuous-triggered control law to show the degree of suboptimality. The combined closed-loop system is written as an impulsive system, and it is proved to have an asymptotically stable equilibrium point without any Zeno behavior. A numerical simulation of an unknown unstable system is presented to show the efficacy of the proposed approach.
What problem does this paper attempt to address?