Abstract:In this article, a novel continuous-time optimal tracking controller is proposed for the single-input-single-output linear system with completely unknown dynamics. Unlike those existing solutions to the optimal tracking control problem, the proposed controller introduces an integral compensation to reduce the steady-state error and regulates the feedforward part simultaneously with the feedback part. An augmented system composed of the integral compensation, error dynamics, and desired trajectory is established to formulate the optimal tracking control problem. The input energy and tracking error of the optimal controller are minimized according to the objective function in the infinite horizon. With the application of reinforcement learning techniques, the proposed controller does not require any prior knowledge of the system drift or input dynamics. The integral reinforcement learning method is employed to approximate the Q-function and update the critic network on-line. And the actor network is updated with the deterministic learning method. The Lyapunov stability is proved under the persistence of excitation condition. A case study on a hydraulic loading system has shown the effectiveness of the proposed controller by simulation and experiment.

Iterative Learning Control for Linear Time-Variant Continuous Systems with Iteration-Varying Initial Conditions and Iteration-Varying Reference Trajectories.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Iterative Learning Control Of Varying Trajectories For Robot Manipulators

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

AN OPEN-CLOSED-LOOP PI-TYPE ITERATIVE LEARNING CONTROL SCHEME FOR DISCRETE NONLINEAR TIME-VARYING SYSTEMS AND ITS CONVERGENCE

Robust Adaptive Iterative Learning Control for Discrete-Time Nonlinear Systems With Time-Iteration-Varying Parameters.

A High-Order Internal Model Based Iterative Learning Control Scheme for Discrete Linear Time-Varying Systems

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

On Iterative Learning Control for MIMO Nonlinear Systems in the Presence of Time-Iteration-varying Parameters

Adaptive Iterative Learning Control Mechanism for Nonlinear Systems Subject to High-Order Internal Model

Adaptive Iterative Learning Control for Discrete-Time Systems with Non-Repetitiveness

On the Robustness of Open-Closed-loop PI-type Iterative Learning Controller for Nonlinear Systems

Iterative Learning Control of Non-Identical Desired Trajectories for a Class of Nonlinear Time-Varying Systems

Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Multiple Iteration‐varying High‐order Internal Models

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Discrete-time Nonlinear Systems with Time-iteration-varying Parameter

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Continuous-time Nonlinear Systems

Discrete-time adaptive iterative learning control with unknown control directions

Iterative Learning Control with Fixed Reference Batch and Exponential Learning Gain for Linear Systems

Iterative Learning Control Design with High‐order Internal Model for Discrete‐time Nonlinear Systems

Robust Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Both Parametric and Nonparametric Uncertainties

An Iterative Learning Control for Nonlinear Systems Without Arimoto's Assumptions.