Abstract:It is necessary to consider the robustness in the tracking problem, which can effectively suppress the external disturbance to ensure the tracking performance. Different from previous tracking control methods, considering the robustness, completely unknown nonlinear system dynamics and constrained controller, we propose a data-based echo state network (ESN) approximated algorithm for a class of robust tracking problems. First, the robust tracking control problem (RTCP) is transformed into the optimal control problem of the according nominal system by designing a elaborate value function. To obtain the optimal control policy, we have to solve a Hamilton-Jacobi-Bellman equation (HJBE) about the augmented nominal system. It is well-known that modelling the accurate dynamics for the practical engineering applications is usually difficult, so the model-free integral reinforcement learning (IRL) algorithm is used to learn the optimal control policy and performance function simultaneously by only using systems data. In this IRL algorithm, a reservoir computing based ESN is used to approximate the performance function and control input. Contrast to other neural networks, ESN need not consider the choice of activation function, which can greatly reduce the difficulty and effort of neural network structure design. The output weights of the ESNs are iteratively updated towards the optimal ones by using least square algorithm and the pre-collected off-line system data. Then, using the converged output weights and ESNs, the tracking control input can be derived without knowing any system dynamic information. Finally, we demonstrate that the given system can be controlled to track the desired trajectory well under the proposed method by using two simulation examples.

Neuroadaptive Tracking Control of Affine Nonlinear Systems Using Echo State Networks Embedded With Multiclustered Structure and Intrinsic Plasticity

Distributed Adaptive Tracking Control for Unknown Nonlinear Networked Systems

Echo State Network-Based Robust Tracking Control for Unknown Constrained Nonlinear Systems by Using Integral Reinforcement Learning

Asymptotic Tracking Control for Uncertain MIMO Systems: A Biologically Inspired ESN Approach

Control of Nonaffine Nonlinear Discrete-Time Systems Using Reinforcement-Learning-Based Linearly Parameterized Neural Networks

Cooperative Tracking Control for Nonlinear MASs under Event-Triggered Communication.

Adaptive Neural Asymptotic Tracking Control for a Class of Stochastic Non-Strict-feedback Switched Systems

Adaptive critic-based tracking control of non-affine nonlinear discrete-time systems with unknown dynamics

Neural-Network-Based Adaptive Tracking Control for Nonlinear Multiagent Systems: The Observer Case

Adaptive Control of Uncertain Nonlinear Systems via Event-Triggered Communication and NN Learning

Cooperative ETM-Based Adaptive Neural Network Tracking Control for Nonlinear Pure-Feedback MASs: A Special-Shaped Laplacian Matrix Method

ESN Neural Networks Robust Attitude Tracking Control for Multi-Body Spacecraft

Neural Adaptive Tracking Controller for Robot Manipulators with Unknown Dynamics

Experience replay based online adaptive robust tracking control for partially unknown nonlinear systems with asymmetric constrained‐input

Hybrid Neural Adaptive Control for Practical Tracking of Markovian Switching Networks

Combining Robust Control and Machine Learning for Uncertain Nonlinear Systems Subject to Persistent Disturbances

Time-/Event-Triggered Adaptive Neural Asymptotic Tracking Control of Nonlinear Interconnected Systems With Unmodeled Dynamics and Prescribed Performance

Event-triggered Adaptive Tracking Control for Stochastic Nonlinear Systems With State Constraints

Event-Based Adaptive Neural Asymptotic Tracking Control for Networked Nonlinear Stochastic Systems

Neural-Network-Based Adaptive Event-Triggered Asymptotically Consensus Tracking Control for Nonlinear Nonstrict-Feedback MASs: An Improved Dynamic Surface Approach

Event-based adaptive neural network asymptotic tracking control for a class of nonlinear systems