Abstract:It is necessary to consider the robustness in the tracking problem, which can effectively suppress the external disturbance to ensure the tracking performance. Different from previous tracking control methods, considering the robustness, completely unknown nonlinear system dynamics and constrained controller, we propose a data-based echo state network (ESN) approximated algorithm for a class of robust tracking problems. First, the robust tracking control problem (RTCP) is transformed into the optimal control problem of the according nominal system by designing a elaborate value function. To obtain the optimal control policy, we have to solve a Hamilton-Jacobi-Bellman equation (HJBE) about the augmented nominal system. It is well-known that modelling the accurate dynamics for the practical engineering applications is usually difficult, so the model-free integral reinforcement learning (IRL) algorithm is used to learn the optimal control policy and performance function simultaneously by only using systems data. In this IRL algorithm, a reservoir computing based ESN is used to approximate the performance function and control input. Contrast to other neural networks, ESN need not consider the choice of activation function, which can greatly reduce the difficulty and effort of neural network structure design. The output weights of the ESNs are iteratively updated towards the optimal ones by using least square algorithm and the pre-collected off-line system data. Then, using the converged output weights and ESNs, the tracking control input can be derived without knowing any system dynamic information. Finally, we demonstrate that the given system can be controlled to track the desired trajectory well under the proposed method by using two simulation examples.

A novel observer-based reinforcement learning for uncertain nonlinear systems with disturbances

Adaptive Robust Control of a Class of Uncertain Nonlinear Systems with Unknown Sinusoidal Disturbances

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Adaptive Observation-Based Efficient Reinforcement Learning for Uncertain Systems

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Neural Observer With Lyapunov Stability Guarantee for Uncertain Nonlinear Systems

Robust Safe Reinforcement Learning Control of Unknown Continuous-Time Nonlinear Systems with State Constraints and Disturbances

Online inverse reinforcement learning with unknown disturbances

NN Adaptive Optimal Tracking Control for a Class of Uncertain Nonstrict Feedback Nonlinear Systems

Event-Triggered Adaptive Neural Control for Full State-Constrained Nonlinear Systems with Unknown Disturbances

Echo State Network-Based Robust Tracking Control for Unknown Constrained Nonlinear Systems by Using Integral Reinforcement Learning

Observer-Based Adaptive Optimized Control for Stochastic Nonlinear Systems With Input and State Constraints

Observer-Based Optimal Backstepping Security Control for Nonlinear Systems Using Reinforcement Learning Strategy

State Observation for a Class of Uncertain Nonlinear Systems Via Deterministic Learning

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Observer-Based NN Control for Nonlinear Systems With Full-State Constraints and External Disturbances

A New Robust Adaptive Control Scheme For Non-Affine Nonlinear Systems Based On Shlnn Disturbance Observer

An Rbfn-Based Observer for Nonlinear Systems Via Deterministic Learning

Event-triggered adaptive neural tracking control of nonstrict-feedback nonlinear systems with unknown measurement

Optimal Robust Control of Nonlinear Systems with Unknown Dynamics via NN Learning with Relaxed Excitation