Abstract:Reinforcement learning tracking control (ILC) is proposed to solve the traditional iterative learning control (ILC) problem. For unknown continuous dynamic systems, precision output tracking is achieved for a given trajectory after several times of trials. The controller is composed of a feedback part and a feedforward part, where the feedback part uses linear states feedback to stabilize the system and the feedforward part is a time-dependent signal to ensure precision tracking. The desired trajectory is defined in a finite time interval and the controller is applied repeatedly to the system with the feedforward signal updated by reinforcement learning in each trial. The tracking problem is treated as a black-box optimization problem where the integral quadratic tracking error is a cost to be minimized under input constraints. In order to apply reinforcement learning, the feedforward signal is approximated by spline interpolation of a few representative points distributed uniformly along the tracking time interval. A search strategy based on squeeze theorem is adopted to update the value of the representative points to achieve minimum tracking error cost. The cart pole example illustrates the effectiveness of the proposed method.

Iterative Learning Control with Unknown Control Direction: A Novel Data-Based Approach

Discrete-time adaptive iterative learning control with unknown control directions

Discrete-Time Adaptive Iterative Learning Control for High-Order Nonlinear Systems with Unknown Control Directions

On Iterative Learning Control for Remote Control Systems with Packet Losses.

Robust Iterative Learning Control Design Based on Gradient Method

Development and Expectation for Iterative Learning Control

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

Analysis of current cycle error assisted iterative learning control for discrete nonlinear time-varying systems

Adaptive Fuzzy Iterative Learning Control for Systems with Saturated Inputs and Unknown Control Directions

Data-Driven Iterative Learning Control for Nonlinear Discrete-Time MIMO Systems

Iterative Learning Control Design with High‐order Internal Model for Discrete‐time Nonlinear Systems

Iterative Learning Control with Data-Driven-Based Compensation.

On Iterative Learning Control for MIMO Nonlinear Systems in the Presence of Time-Iteration-varying Parameters

Adaptive Iterative Learning Control Mechanism for Nonlinear Systems Subject to High-Order Internal Model

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Continuous-time Nonlinear Systems

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Discrete-time Nonlinear Systems with Time-iteration-varying Parameter

Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Multiple Iteration‐varying High‐order Internal Models

Iterative learning control for remote control systems with communication delay and data dropout

Output-feedback adaptive learning control with unknown control direction

Output Tracking for Nonlinear Stochastic Systems by Iterative Learning Control.

Reinforcement Learning Tracking Control for Unknown Continuous Dynamic Systems