Abstract:We consider the infinite-horizon LQR control problem. Motivated by competitive analysis in online learning, as a criterion for controller design we introduce the dynamic regret, defined as the difference between the LQR cost of a causal controller (that has only access to past disturbances) and the LQR cost of the \emph{unique} clairvoyant one (that has also access to future disturbances) that is known to dominate all other controllers. The regret itself is a function of the disturbances, and we propose to find a causal controller that minimizes the worst-case regret over all bounded energy disturbances. The resulting controller has the interpretation of guaranteeing the smallest regret compared to the best non-causal controller that can see the future. We derive explicit formulas for the optimal regret and for the regret-optimal controller for the state-space setting. These explicit solutions are obtained by showing that the regret-optimal control problem can be reduced to a Nehari extension problem that can be solved explicitly. The regret-optimal controller is shown to be linear and can be expressed as the sum of the classical $H_2$ state-feedback law and an $n$-th order controller ($n$ is the state dimension), and its construction simply requires a solution to the standard LQR Riccati equation and two Lyapunov equations. Simulations over a range of plants demonstrate that the regret-optimal controller interpolates nicely between the $H_2$ and the $H_\infty$ optimal controllers, and generally has $H_2$ and $H_\infty$ costs that are simultaneously close to their optimal values. The regret-optimal controller thus presents itself as a viable option for control systems design.

Robust regret optimal control

Robust H∞ control for time-delay systems with additive controller uncertainty

Robust memoryless H∞ control for uncertain linear time-delay systems

A Memoryless Robust Stabilizing Controller for a Class of Uncertain Linear Time-Delay Systems

Robust Hinfinity Controller Design for Time-Varying Uncertain Linear Systems with Time-Varying State and Control Delays

Robust H-Infinity Control For Time-Delay Systems With Additive Controller Uncertainty

Robust memoryless H/sup /spl infin// control for uncertain linear time-delay systems

Robust control for a class of uncertain time-varying time-delay systems with actuator limit

Novel Robust Predictive Control Algorithm Based on Closed-Loop Optimization

Robust H/sub /spl infin// control for time-delay systems with additive controller uncertainty

Robust H∞ Control for a Class of Uncertain Dynamic Systems with Delayed States and Controls

Robust Iterative Learning Control Design Based on Gradient Method

Delay-dependent robust H∞ control for with parameter uncertainties and time delay

Delay-dependent Robusth∞ Control for a Class of Uncertain Switched Systems with Time Delay

Robust H ∞ Output Feedback Control for a Class of Uncertain Lur’e Systems with Time-Delays

Delay-dependent robust H∞ control for switched systems with parameter uncertainties and time delay

Robust control for uncertain linear systems with constraints on output

A System Level Approach to Regret Optimal Control

Regret-Optimal LQR Control

Regret Optimal Control for Uncertain Stochastic Systems

Robust LQ optimal controller designing for refining process