Abstract:It is necessary to consider the robustness in the tracking problem, which can effectively suppress the external disturbance to ensure the tracking performance. Different from previous tracking control methods, considering the robustness, completely unknown nonlinear system dynamics and constrained controller, we propose a data-based echo state network (ESN) approximated algorithm for a class of robust tracking problems. First, the robust tracking control problem (RTCP) is transformed into the optimal control problem of the according nominal system by designing a elaborate value function. To obtain the optimal control policy, we have to solve a Hamilton-Jacobi-Bellman equation (HJBE) about the augmented nominal system. It is well-known that modelling the accurate dynamics for the practical engineering applications is usually difficult, so the model-free integral reinforcement learning (IRL) algorithm is used to learn the optimal control policy and performance function simultaneously by only using systems data. In this IRL algorithm, a reservoir computing based ESN is used to approximate the performance function and control input. Contrast to other neural networks, ESN need not consider the choice of activation function, which can greatly reduce the difficulty and effort of neural network structure design. The output weights of the ESNs are iteratively updated towards the optimal ones by using least square algorithm and the pre-collected off-line system data. Then, using the converged output weights and ESNs, the tracking control input can be derived without knowing any system dynamic information. Finally, we demonstrate that the given system can be controlled to track the desired trajectory well under the proposed method by using two simulation examples.

An Analysis of IRL-Based Optimal Tracking Control of Unknown Nonlinear Systems with Constrained Input

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Operational Optimal Tracking Control for Industrial Multirate Systems Subject to Unknown Disturbances

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Optimal Asymptotic Tracking Control for Nonzero-Sum Differential Game Systems with Unknown Drift Dynamics via Integral Reinforcement Learning

Adaptive Optimal Tracking Controls of Unknown Multi-Input Systems Based on Nonzero-Sum Game Theory

Adaptive Optimal Tracking Control of Unknown Nonlinear Systems Using System Augmentation.

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

A Model-Free Resilient Tracking Control Scheme for Non-Affine Nonlinear Continuous Systems with Uncertainties

Approximate Optimal Curve Path Tracking Control for Nonlinear Systems with Asymmetric Input Constraints

Adaptive Dynamic Programming‐based Event‐triggered Optimal Tracking Control

Finite-horizon Neural Optimal Tracking Control for a Class of Nonlinear Systems with Unknown Dynamics

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Optimal Tracking Control of Nonlinear Multiagent Systems Using Internal Reinforce Q-Learning

Constrained Reinforcement Learning-Based Closed-Loop Reference Model for Optimal Tracking Control of Unknown Continuous-Time Systems

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems

Reinforcement Learning-Based Robust Optimal Tracking Control for Disturbed Nonlinear Systems

Echo State Network-Based Robust Tracking Control for Unknown Constrained Nonlinear Systems by Using Integral Reinforcement Learning

Data-based Robust Adaptive Control for a Class of Unknown Nonlinear Constrained-Input Systems Via Integral Reinforcement Learning