Abstract:Iterative learning control (ILC) is a powerful technique for high performance tracking in the presence of modeling errors for optimal control applications. There is extensive prior work showing its empirical effectiveness in applications such as chemical reactors, industrial robots and quadcopters. However, there is little prior theoretical work that explains the effectiveness of ILC even in the presence of large modeling errors, where optimal control methods using the misspecified model (MM) often perform poorly. Our work presents such a theoretical study of the performance of both ILC and MM on Linear Quadratic Regulator (LQR) problems with unknown transition dynamics. We show that the suboptimality gap, as measured with respect to the optimal LQR controller, for ILC is lower than that for MM by higher order terms that become significant in the regime of high modeling errors. A key part of our analysis is the perturbation bounds for the discrete Ricatti equation in the finite horizon setting, where the solution is not a fixed point and requires tracking the error using recursive bounds. We back our theoretical findings with empirical experiments on a toy linear dynamical system with an approximate model, a nonlinear inverted pendulum system with misspecified mass, and a nonlinear planar quadrotor system in the presence of wind. Experiments show that ILC outperforms MM significantly, in terms of the cost of computed trajectories, when modeling errors are high.

Robust iterative learning control with quadratic performance index

Robust Iterative Learning Control Design Based on Gradient Method

Design of Robust Iterative Learning Control Based on H∞ Approach

Iterative learning control of linear distributed parameter systems-frequency domain design and analysis

Iterative Learning Control for MIMO Second-Order Hyperbolic Distributed Parameter Systems with Uncertainties

Robust Iterative Learning Control Design for Uncertain Time-Delay Systems Based on A Performance Index

LMI approach to robust monotonically convergent iterative learning control for uncertain linear discrete-time systems

Direct iterative LMI-based approach of mixed H-two / H-infinity robust control for uncertain systems

On the Effectiveness of Iterative Learning Control

Robust Optimization-Based Iterative Learning Control for Nonlinear Systems with Nonrepetitive Uncertainties

Robust iterative learning control and its application to high precision test bench

Design and Implementation of Novel LMI-Based Iterative Learning Robust Nonlinear Controller

Iterative Learning Control Algorithm Based on Vector Plots Analysis and Its Robustness

An Iterative Learning Control Scheme Based on 2-Dimensional Robust Predictive Control

An Iteration-Varying Dead-Zone Based Robust Adaptive Ilc For Discrete-Time Nonlinear Systems With Uncertainties

Linear Quadratic Control For Singulary Perturbed Systems With Actuator Failures: An Lmi Approach

Robust two-dimensional iterative learning control for batch processes with state delay and time-varying uncertainties

Simple LMI Based Learning Control Design

Robust Iterative Learning Control Design for Batch Processes with Uncertain Perturbations and Initialization

Robust Iterative Learning Control with Rectifying Action for Nonlinear Discrete Time-Delayed Systems

Design of Arbitrary-Order Robust Iterative Learning Control Based on Robust Control Theory