Q-learning based Robust Model Predictive Control for Uncertain Linear Systems

Jia Wang,Yuhan Zhang,Ying Yang
DOI: https://doi.org/10.1109/cac53003.2021.9727455
2021-01-01
Abstract:The Q-learning based robust model predictive control (RMPC) technique is proposed to solve constrained control problems of the linear system with multiplicative and additive uncertainty. The proposed method consists of RMPC mode and Q-learning mode. In the RMPC mode, only the effect of multiplicative uncertainty is restrained and the finite gain l <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</inf> stability of the real system can be guaranteed during the operation of RMPC modes. In the Q-learning mode, the feedback gain of the RMPC controller is improved by using the process data generated by a succession of RMPC modes, which leads to a reduction of l <inf xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</inf> gain from additive disturbance to system state. The case study shows the feasibility of the proposed approach.
What problem does this paper attempt to address?