Reinforcement Learning‐based Robust Optimal Output Regulation for Constrained Nonlinear Systems with Static and Dynamic Uncertainties

Peng Jin,Qian Ma,Guopeng Zhou,Guoying Miao
DOI: https://doi.org/10.1002/rnc.6475
IF: 3.8973
2022-01-01
International Journal of Robust and Nonlinear Control
Abstract:This article investigates the robust optimal output regulation problem for the constrained uncertain nonlinear systems. A two-step design framework is proposed to overcome the difficulties brought by uncertainties, constraint and performance optimization. First, the feedforward controller is designed by the internal model principle, and the robust output regulation problem is transformed into the robust stabilization problem. Then, the optimal control problem with input saturation is further considered in the robust feedback controller design process. With the help of a non-quadratic cost functional, actor-critic algorithm and robust redesign technique are brought together to design the constrained robust optimal feedback controller. Finally, stability analysis based on Lyapunov method shows that all the signals of the closed-loop system remain bounded, and the tracking error is uniformly ultimately bounded with arbitrarily small ultimate bound. Simulation results illustrate the effectiveness of the proposed methodology.
What problem does this paper attempt to address?