Abstract:Iterative learning control (ILC) is a powerful technique for high performance tracking in the presence of modeling errors for optimal control applications. There is extensive prior work showing its empirical effectiveness in applications such as chemical reactors, industrial robots and quadcopters. However, there is little prior theoretical work that explains the effectiveness of ILC even in the presence of large modeling errors, where optimal control methods using the misspecified model (MM) often perform poorly. Our work presents such a theoretical study of the performance of both ILC and MM on Linear Quadratic Regulator (LQR) problems with unknown transition dynamics. We show that the suboptimality gap, as measured with respect to the optimal LQR controller, for ILC is lower than that for MM by higher order terms that become significant in the regime of high modeling errors. A key part of our analysis is the perturbation bounds for the discrete Ricatti equation in the finite horizon setting, where the solution is not a fixed point and requires tracking the error using recursive bounds. We back our theoretical findings with empirical experiments on a toy linear dynamical system with an approximate model, a nonlinear inverted pendulum system with misspecified mass, and a nonlinear planar quadrotor system in the presence of wind. Experiments show that ILC outperforms MM significantly, in terms of the cost of computed trajectories, when modeling errors are high.

An Improved Result of Multiple Model Iterative Learning Control

Multiple Model ILC for Continuous-Time Nonlinear Systems

Development and Expectation for Iterative Learning Control

Iterative Learning Model Predictive Control for a Class of Continuous/Batch Processes

Iterative Learning Control for MIMO Second-Order Hyperbolic Distributed Parameter Systems with Uncertainties

Multipoint Iterative Learning Model Predictive Control

On the Effectiveness of Iterative Learning Control

Adaptive Iterative Learning Control for MIMO Nonlinear Systems Performing Iteration-Varying Tasks

On Iterative Learning Control for MIMO Nonlinear Systems in the Presence of Time-Iteration-varying Parameters

Analysis of current cycle error assisted iterative learning control for discrete nonlinear time-varying systems

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Continuous-time Nonlinear Systems

Adaptive Iterative Learning Control for Discrete‐time Nonlinear Systems with Multiple Iteration‐varying High‐order Internal Models

Iteration-dependent High-order Internal Model Based Iterative Learning Control for Discrete-time Nonlinear Systems with Time-iteration-varying Parameter

Robust Model-Based Predictive Iterative Learning Control for Systems with Non-Repetitive Disturbances

An Adaptive Learning Control for MIMO Nonlinear System with Nonuniform Trial Lengths and Invertible Control Gain Matrix

Adaptive Discrete-Time Iterative Learning Control for Non-Linear Multiple Input Multiple Output Systems with Iteration-Varying Initial Error and Reference Trajectory

IMC-based iterative learning control for batch processes with uncertain time delay

Fault Tolerant Nonrepetitive Trajectory Tracking for MIMO Output Constrained Nonlinear Systems Using Iterative Learning Control

Research on the Iterative Learning Control Method for Linear Motor

Data-Driven Iterative Learning Control for Nonlinear Discrete-Time MIMO Systems

Iterative Rectifying Methods for Nonrepetitive Continuous-Time Learning Control Systems