Adaptive Optimal Tracking Control of Servo Mechanisms via Generalized Policy Learning
Jun Zhao,Yongfeng Lv,Ziliang Zhao,Zhangu Wang
DOI: https://doi.org/10.1109/tim.2024.3457963
IF: 5.6
2024-09-27
IEEE Transactions on Instrumentation and Measurement
Abstract:Although tracking control of servo mechanisms has been extensively studied, optimal tracking control of servo mechanisms via reinforcement learning (RL) is still a challenging problem, especially when there is inevitable friction in actual servo mechanisms. This article presents an optimal tracking control approach of servo mechanism by using a generalized policy learning (GPL) algorithm, which avoids actor neural network (ANN) and solving the Hamilton-Jacobi–Bellman equation (HJBE) (the classic RL-based optimal control method generally requires solving HJBE, which is essentially a partial differential equation, and thus, it is not easy to solve directly; note that the method designed in this article does not require solving HJBE, avoiding larger errors caused by solving HJBE). To achieve this objective, an adaptive steady-state controller is developed to ensure the desired tracking performance while designing an adaptive optimal controller to further adjust the tracking error dynamics by using an optimal manner. To this end, a critic neural network (CNN) is employed to modify the specified optimal value function, and this is conducive to learning the critic with Bellman scheme. Moreover, the stability of the system is ensured through the Lyapunov theory. Finally, the efficacy of the proposed control technique is tested through simulations and experiments.
engineering, electrical & electronic,instruments & instrumentation