Abstract:It is necessary to consider the robustness in the tracking problem, which can effectively suppress the external disturbance to ensure the tracking performance. Different from previous tracking control methods, considering the robustness, completely unknown nonlinear system dynamics and constrained controller, we propose a data-based echo state network (ESN) approximated algorithm for a class of robust tracking problems. First, the robust tracking control problem (RTCP) is transformed into the optimal control problem of the according nominal system by designing a elaborate value function. To obtain the optimal control policy, we have to solve a Hamilton-Jacobi-Bellman equation (HJBE) about the augmented nominal system. It is well-known that modelling the accurate dynamics for the practical engineering applications is usually difficult, so the model-free integral reinforcement learning (IRL) algorithm is used to learn the optimal control policy and performance function simultaneously by only using systems data. In this IRL algorithm, a reservoir computing based ESN is used to approximate the performance function and control input. Contrast to other neural networks, ESN need not consider the choice of activation function, which can greatly reduce the difficulty and effort of neural network structure design. The output weights of the ESNs are iteratively updated towards the optimal ones by using least square algorithm and the pre-collected off-line system data. Then, using the converged output weights and ESNs, the tracking control input can be derived without knowing any system dynamic information. Finally, we demonstrate that the given system can be controlled to track the desired trajectory well under the proposed method by using two simulation examples.

Integral reinforcement learning based decentralized optimal tracking control of unknown nonlinear large-scale interconnected systems with constrained-input.

Decentralized Adaptive Iterative Learning Control for Interconnected Systems with Uncertainties

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Distributed Adaptive Tracking Control for Unknown Nonlinear Networked Systems

A Decentralized Output Feedback Controller for a Class of Large-Scale Interconnected Nonlinear Systems

Decentralized adaptive iterative learning control for uncertain interconnected systems with state delay

Optimal Control for Constrained Discrete-Time Nonlinear Systems Based on Safe Reinforcement Learning.

Integral reinforcement learning‐based optimal tracking control for uncertain nonlinear systems under input constraint and specified performance constraints

Reinforcement Learning-Based Control for Nonlinear Discrete-Time Systems with Unknown Control Directions and Control Constraints

Decentralized control for a class of nonlinear interconnected systems using integral policy iteration

Neural Network-Based Adaptive Decentralized Learning Control for Interconnected Systems with Input Constraints

Decentralized Tracking Optimization Control for Partially Unknown Fuzzy Interconnected Systems via Reinforcement Learning Method

Neural-network-based decentralized control of continuous-time nonlinear interconnected systems with unknown dynamics

Reinforcement Learning-Based Control for a Class of Nonlinear Systems with Unknown Control Directions

NN/RISE-based asymptotic tracking control of uncertain nonlinear systems

Echo State Network-Based Robust Tracking Control for Unknown Constrained Nonlinear Systems by Using Integral Reinforcement Learning

Online reinforcement learning control of unknown nonaffine nonlinear discrete time systems

Decentralized Stabilization for a Class of Continuous-Time Nonlinear Interconnected Systems Using Online Learning Optimal Control Approach

Robust Integral Of Neural Network And Sign Of Tracking Error Control Of Uncertain Nonlinear Affine Systems Using State And Output Feedback

Reinforcement learning for optimal tracking of large-scale systems with multitime scales

Reinforcement learning-based decentralized fault tolerant control for constrained interconnected nonlinear systems