Abstract:Iterative learning control (ILC) is a powerful technique for high performance tracking in the presence of modeling errors for optimal control applications. There is extensive prior work showing its empirical effectiveness in applications such as chemical reactors, industrial robots and quadcopters. However, there is little prior theoretical work that explains the effectiveness of ILC even in the presence of large modeling errors, where optimal control methods using the misspecified model (MM) often perform poorly. Our work presents such a theoretical study of the performance of both ILC and MM on Linear Quadratic Regulator (LQR) problems with unknown transition dynamics. We show that the suboptimality gap, as measured with respect to the optimal LQR controller, for ILC is lower than that for MM by higher order terms that become significant in the regime of high modeling errors. A key part of our analysis is the perturbation bounds for the discrete Ricatti equation in the finite horizon setting, where the solution is not a fixed point and requires tracking the error using recursive bounds. We back our theoretical findings with empirical experiments on a toy linear dynamical system with an approximate model, a nonlinear inverted pendulum system with misspecified mass, and a nonlinear planar quadrotor system in the presence of wind. Experiments show that ILC outperforms MM significantly, in terms of the cost of computed trajectories, when modeling errors are high.

Open-Closed-Loop Pid-Type Iterative Learning Control for Linear Systems with Initial State Error

On the Robustness of Open-Closed-loop PI-type Iterative Learning Controller for Nonlinear Systems

Iterative learning control of linear distributed parameter systems-frequency domain design and analysis

Analysis of current cycle error assisted iterative learning control for discrete nonlinear time-varying systems

Robust Iterative Learning Control Design Based on Gradient Method

Iterative learning control of inhomogeneous distributed parameter systems - frequency domain design and analysis.

On Iterative Learning Control for Remote Control Systems with Packet Losses.

AN OPEN-CLOSED-LOOP PI-TYPE ITERATIVE LEARNING CONTROL SCHEME FOR DISCRETE NONLINEAR TIME-VARYING SYSTEMS AND ITS CONVERGENCE

A robust iterative learning control for linear system with variable initial state and trail length

Adaptive Iteration Learning Control with Iteration‐varying Event‐triggered Mechanism for Discrete‐time Nonlinear Systems with Random Initial States

Iterative Learning Control Design with High‐order Internal Model for Discrete‐time Nonlinear Systems

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Discrete-time Nonlinear Systems with Time-iteration-varying Parameter

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Continuous-time Nonlinear Systems

Research and application of iterative learning control for nonlinear systems

Robust iterative learning control for linear continuous systems with vector relative degree under varying input trail lengths and random initial state shifts

Integrated Design and Structure Analysis of Robust Iterative Learning Control System Based on a Two-Dimensional Model

Convergence Characteristics of PI-type Iterative Learning Control for Linear Time-invariant Systems

An Open-Closed-Loop Gradient-Type ILC Combined with Infinite Time Optimal Output LQR

An Iterative Learning Control Method for Nonlinear Systems with Randomly Varying Trial Lengths

On the Effectiveness of Iterative Learning Control

Robust two-dimensional iterative learning control for batch processes with state delay and time-varying uncertainties