Abstract:In this article, a novel continuous-time optimal tracking controller is proposed for the single-input-single-output linear system with completely unknown dynamics. Unlike those existing solutions to the optimal tracking control problem, the proposed controller introduces an integral compensation to reduce the steady-state error and regulates the feedforward part simultaneously with the feedback part. An augmented system composed of the integral compensation, error dynamics, and desired trajectory is established to formulate the optimal tracking control problem. The input energy and tracking error of the optimal controller are minimized according to the objective function in the infinite horizon. With the application of reinforcement learning techniques, the proposed controller does not require any prior knowledge of the system drift or input dynamics. The integral reinforcement learning method is employed to approximate the Q-function and update the critic network on-line. And the actor network is updated with the deterministic learning method. The Lyapunov stability is proved under the persistence of excitation condition. A case study on a hydraulic loading system has shown the effectiveness of the proposed controller by simulation and experiment.

Optimization-Based Learning Control for Nonlinear Time-Varying Systems

Design and Analysis of Data-Driven Learning Control: an Optimization-Based Approach.

A Learning-Based Optimal Tracking Controller for Continuous Linear Systems with Unknown Dynamics: Theory and Case Study

Robust Optimization-Based Iterative Learning Control for Nonlinear Systems with Nonrepetitive Uncertainties

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

Data-based Control Design for Learning Systems

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

Data-Based Control for Learning Systems with Nonlinear Dynamics: A Case Study

Data-Driven Iterative Learning Control for Nonlinear Discrete-Time MIMO Systems

A Data-Driven Design Of Optimal Ilc For Nonlinear Systems

Iterative Learning Control for Output Tracking of Nonlinear Systems with Unavailable State Information

Data-Based Optimization Control for Learning Systems

Quasi-Newton-type Optimized Iterative Learning Control for Discrete Linear Time Invariant Systems

Fast data-driven iterative learning control for linear system with output disturbance

A Data-Driven ILC Framework for a Class of Nonlinear Discrete-Time Systems

Hybrid Adaptive Iterative Learning Control of Non-uniform Trajectory Tracking for Nonlinear Time-delay Systems

Adaptive Discrete-Time Iterative Learning Control for Non-Linear Multiple Input Multiple Output Systems with Iteration-Varying Initial Error and Reference Trajectory

Tracking Control for Stochastic Learning Systems Over Changing Durations

Adaptive Learning Control for Nonlinear Systems with Randomly Varying Iteration Lengths.

Adaptive Iterative Learning Control for Nonlinear Time-Delay Output Feedback Systems

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems